 AlpinDale
|
4d4e767838
ci: take one of fixing lint issues
|
4 months ago |
 AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
5 months ago |
|
AlpinDale
|
4d1e613804
chore: minor simplifications
|
5 months ago |
|
AlpinDale
|
5b0c11d190
support pipeline parallel pynccl groups
|
6 months ago |
|
AlpinDale
|
79901b76de
logprobs for target model (spec decoding)
|
6 months ago |
|
AlpinDale
|
723c6acb84
re-add ngram speculative decoding
|
6 months ago |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
6 months ago |
|
AlpinDale
|
46159b107a
formatting: pt1
|
6 months ago |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
6 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
