 AlpinDale
|
cac8163f77
fix: request abort crashing pipeline parallel
|
5 meses atrás |
|
AlpinDale
|
63becc67c0
fix: prompt logprob detokenization
|
5 meses atrás |
 AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
5 meses atrás |
|
AlpinDale
|
f91f217bf8
fix: do not skip `prompt_logprobs` when `SamplingParams.detokenize=True`
|
5 meses atrás |
|
AlpinDale
|
9e73559eba
make use of batched rotary embedding kernels to support long context lora
|
6 meses atrás |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
6 meses atrás |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
7 meses atrás |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 meses atrás |
