 AlpinDale
|
4d4e767838
ci: take one of fixing lint issues
|
hace 4 meses |
 AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
hace 5 meses |
|
AlpinDale
|
4d1e613804
chore: minor simplifications
|
hace 5 meses |
|
AlpinDale
|
5b0c11d190
support pipeline parallel pynccl groups
|
hace 6 meses |
|
AlpinDale
|
79901b76de
logprobs for target model (spec decoding)
|
hace 6 meses |
|
AlpinDale
|
723c6acb84
re-add ngram speculative decoding
|
hace 6 meses |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hace 6 meses |
|
AlpinDale
|
46159b107a
formatting: pt1
|
hace 7 meses |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hace 7 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hace 8 meses |
