 AlpinDale
|
e0886ee929
feat: add `ProposerWorkerBase` abstract class
|
7 months ago |
|
AlpinDale
|
de62ceb18c
refactor: eliminate parallel worker per-step task scheduling overhead
|
7 months ago |
|
AlpinDale
|
e42d0b3455
possibly improve ngram efficiency
|
7 months ago |
|
AlpinDale
|
16f345c29a
fix circular reference with weakref
|
8 months ago |
|
AlpinDale
|
6e63d7a9db
fix memory usage with ngram spec decoding
|
8 months ago |
|
AlpinDale
|
ef733aee43
implement ExecuteModelData to reduce executor complexity
|
8 months ago |
|
AlpinDale
|
79901b76de
logprobs for target model (spec decoding)
|
8 months ago |
|
AlpinDale
|
723c6acb84
re-add ngram speculative decoding
|
8 months ago |
 AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
10 months ago |
