| .. |
|
guided_decoding
|
313e198557
api: implement OpenAI-compatible tools API for Hermes/Mistral models (#993)
|
1 mês atrás |
|
layers
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
3 semanas atrás |
|
model_loader
|
b3f9ab3b72
quant: add tensor parallel support for bitsandbytes (#1052)
|
3 semanas atrás |
|
models
|
11f49b5341
fix: granite logit scale in logit computation (#1054)
|
3 semanas atrás |
|
__init__.py
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
1 mês atrás |
|
_custom_op.py
|
5d37ec1016
suppress tpu import warning (#696)
|
4 meses atrás |
|
parameter.py
|
83af2524f3
quants: add GPTQ and FBGEMM to AphroditeParameters (#987)
|
1 mês atrás |
|
pooling_metadata.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 meses atrás |
|
sampling_metadata.py
|
0b5588de5c
fix: add missing logit index increment in sampling metadata prep (#1059)
|
3 semanas atrás |
|
utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 meses atrás |
AlpinDale
0b5588de5c
fix: add missing logit index increment in sampling metadata prep (#1059)