| .. |
|
guided_decoding
|
313e198557
api: implement OpenAI-compatible tools API for Hermes/Mistral models (#993)
|
2 months ago |
|
layers
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
1 month ago |
|
model_loader
|
349a612338
chore: bump bitsandbytes version to latest; enable cuda graphs for 4bit bnb (#1123)
|
1 month ago |
|
models
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
1 month ago |
|
__init__.py
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
2 months ago |
|
_custom_op.py
|
5d37ec1016
suppress tpu import warning (#696)
|
6 months ago |
|
parameter.py
|
83af2524f3
quants: add GPTQ and FBGEMM to AphroditeParameters (#987)
|
2 months ago |
|
pooling_metadata.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
6 months ago |
|
sampling_metadata.py
|
f20f5c3491
samplers: improved DRY performance (#1108)
|
1 month ago |
|
utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
10 months ago |
AlpinDale
349a612338
chore: bump bitsandbytes version to latest; enable cuda graphs for 4bit bnb (#1123)