| .. |
|
compressed_tensors
|
201db10f02
models: add support for Phi3 MoE
|
2 weeks ago |
|
gguf_utils
|
8a71788372
Add OLMoE (#772)
|
2 months ago |
|
kernels
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 weeks ago |
|
utils
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
1 month ago |
|
__init__.py
|
f98e7b2f8c
feat: add HQQ quantization support (#795)
|
2 months ago |
|
aqlm.py
|
ccbda97416
fix: types in AQLM and GGUF for dynamo support (#736)
|
3 months ago |
|
autoquant.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
awq.py
|
edec2e9a9e
feat: migrate awq and awq_marlin to AphroditeParameter (#702)
|
3 months ago |
|
awq_marlin.py
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
1 month ago |
|
awq_triton.py
|
fcfcfc65e1
quants: add triton kernels for AWQ (#946)
|
2 weeks ago |
|
base_config.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
bitsandbytes.py
|
6bdff60aab
quant: support pre-quanted bitsandbytes checkpoints (#961)
|
2 weeks ago |
|
deepspeedfp.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
eetq.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
exl2.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
experts_int8.py
|
201db10f02
models: add support for Phi3 MoE
|
2 weeks ago |
|
fbgemm_fp8.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
fp6.py
|
73177656ed
feat: quant_llm support (#755)
|
3 months ago |
|
fp8.py
|
201db10f02
models: add support for Phi3 MoE
|
2 weeks ago |
|
gguf.py
|
0dfa6b60ec
core: support logprobs with multi-step scheduling (#963)
|
2 weeks ago |
|
gptq.py
|
ccbda97416
fix: types in AQLM and GGUF for dynamo support (#736)
|
3 months ago |
|
gptq_marlin.py
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
1 month ago |
|
gptq_marlin_24.py
|
5d9021969c
quants: update `qqq` and `gptq_marlin_24` to use AphroditeParameters (#921)
|
3 weeks ago |
|
hadamard.safetensors
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
|
hqq_marlin.py
|
f98e7b2f8c
feat: add HQQ quantization support (#795)
|
2 months ago |
|
kv_cache.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
marlin.py
|
799667737b
quantization: update marlin to use `AphroditeParameters` (#913)
|
3 weeks ago |
|
qqq.py
|
5d9021969c
quants: update `qqq` and `gptq_marlin_24` to use AphroditeParameters (#921)
|
3 weeks ago |
|
quip.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
quip_utils.py
|
8a71788372
Add OLMoE (#772)
|
2 months ago |
|
schema.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
|
squeezellm.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
tpu_int8.py
|
f4b62bf803
quant: update tpu_int8 to use AphroditeParameters (#959)
|
2 weeks ago |
AlpinDale
201db10f02
models: add support for Phi3 MoE