 AlpinDale
|
5761ef8c35
feat: gemma-2 support
|
hai 5 meses |
 AlpinDale
|
0f4a9ee77b
quantized lm_head (#582)
|
hai 6 meses |
|
AlpinDale
|
c7bddcdef1
chore: skip for logits_scale == 1.0
|
hai 6 meses |
|
AlpinDale
|
e8b7f53321
allow prompt token IDs in the logits processor api
|
hai 6 meses |
|
AlpinDale
|
6fc1ec6e9a
fix redirects and improve low level debugging
|
hai 6 meses |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 6 meses |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hai 7 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 9 meses |
