 AlpinDale
|
4d4e767838
ci: take one of fixing lint issues
|
vor 4 Monaten |
 AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 5 Monaten |
|
AlpinDale
|
4d1e613804
chore: minor simplifications
|
vor 5 Monaten |
|
AlpinDale
|
5b0c11d190
support pipeline parallel pynccl groups
|
vor 6 Monaten |
|
AlpinDale
|
79901b76de
logprobs for target model (spec decoding)
|
vor 6 Monaten |
|
AlpinDale
|
723c6acb84
re-add ngram speculative decoding
|
vor 6 Monaten |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
vor 6 Monaten |
|
AlpinDale
|
46159b107a
formatting: pt1
|
vor 7 Monaten |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 7 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
