| .. |
|
guided_decoding
|
313e198557
api: implement OpenAI-compatible tools API for Hermes/Mistral models (#993)
|
vor 1 Monat |
|
layers
|
7ca63930c8
support deepseek_v3 model
|
vor 4 Wochen |
|
model_loader
|
f2b6dc3872
cpu: add support for W8A8 quantization via compressed-tensor (#1017)
|
vor 4 Wochen |
|
models
|
7ca63930c8
support deepseek_v3 model
|
vor 4 Wochen |
|
__init__.py
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
vor 1 Monat |
|
_custom_op.py
|
5d37ec1016
suppress tpu import warning (#696)
|
vor 4 Monaten |
|
parameter.py
|
cec4da1dab
quants: support w8a8 fp8 block-wise quantization from DS3
|
vor 4 Wochen |
|
pooling_metadata.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 4 Monaten |
|
sampling_metadata.py
|
f0cc35befe
sampler: pad dry sequence breakers tensor (#875)
|
vor 1 Monat |
|
utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
AlpinDale
7ca63930c8
support deepseek_v3 model