| .. |
|
__init__.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
batch_expansion.py
|
a94de94c44
refactor: combine the prefill and decode into a single API (#553)
|
пре 5 месеци |
|
interfaces.py
|
ef733aee43
implement ExecuteModelData to reduce executor complexity
|
пре 5 месеци |
|
metrics.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
multi_step_worker.py
|
a94de94c44
refactor: combine the prefill and decode into a single API (#553)
|
пре 5 месеци |
|
ngram_worker.py
|
de62ceb18c
refactor: eliminate parallel worker per-step task scheduling overhead
|
пре 5 месеци |
|
spec_decode_worker.py
|
344ddaac5a
properly disable speculative decoding
|
пре 5 месеци |
|
top1_proposer.py
|
e42d0b3455
possibly improve ngram efficiency
|
пре 5 месеци |
|
util.py
|
5b0c11d190
support pipeline parallel pynccl groups
|
пре 5 месеци |
AlpinDale
344ddaac5a
properly disable speculative decoding