| .. |
|
compressed_tensors
|
4d4e767838
ci: take one of fixing lint issues
|
пре 5 месеци |
|
gguf_utils
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
utils
|
141672a0d4
kernels: disambiguate quantized types via a new ScalarType
|
пре 5 месеци |
|
__init__.py
|
2b85ffb1a5
chore: minor cleanups
|
пре 5 месеци |
|
aqlm.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
autoquant.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
awq.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
awq_marlin.py
|
141672a0d4
kernels: disambiguate quantized types via a new ScalarType
|
пре 5 месеци |
|
base_config.py
|
0e6c400b13
feat: re-add GGUF (#600)
|
пре 5 месеци |
|
bitsandbytes.py
|
d4c9fcd6e6
feat: support loading pre-quanted bnb checkpoints
|
пре 5 месеци |
|
deepspeedfp.py
|
6b1fdd07bd
chore: add isort and refactor formatting script and utils
|
пре 5 месеци |
|
eetq.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
exl2.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
fbgemm_fp8.py
|
a20e2ce155
fix: pass cutlass_fp8_supported correctly for fbgemm_fp8
|
пре 5 месеци |
|
fp8.py
|
4d4e767838
ci: take one of fixing lint issues
|
пре 5 месеци |
|
gguf.py
|
4d4e767838
ci: take one of fixing lint issues
|
пре 5 месеци |
|
gptq.py
|
208cd5405f
fix: cpu offloading with gptq
|
пре 5 месеци |
|
gptq_marlin.py
|
208cd5405f
fix: cpu offloading with gptq
|
пре 5 месеци |
|
gptq_marlin_24.py
|
141672a0d4
kernels: disambiguate quantized types via a new ScalarType
|
пре 5 месеци |
|
hadamard.safetensors
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
kv_cache.py
|
e81590d293
fix: `kv_cache_dtype=fp8` without scales for fp8 checkpoints
|
пре 5 месеци |
|
marlin.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
qqq.py
|
e3f07b22c3
feat: support for QQQ W4A8 quantization (#612)
|
пре 5 месеци |
|
quip.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
|
quip_utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
schema.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
пре 8 месеци |
|
squeezellm.py
|
9be43994fe
feat: fbgemm quantization support (#601)
|
пре 5 месеци |
AlpinDale
208cd5405f
fix: cpu offloading with gptq