| .. |
|
aqlm
|
ccbda97416
fix: types in AQLM and GGUF for dynamo support (#736)
|
3 months ago |
|
autoquant
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
awq
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
compressed_tensors
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
cutlass_w8a8
|
a401f8e05d
feat: per-tensor token epilogue kernels (#630)
|
4 months ago |
|
exl2
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
flute
|
0fd2b56836
wip
|
3 months ago |
|
fp6
|
73177656ed
feat: quant_llm support (#755)
|
3 months ago |
|
fp8
|
b0f262eec1
feat: FP8 quantization support for AMD ROCm (#729)
|
3 months ago |
|
gguf
|
ccbda97416
fix: types in AQLM and GGUF for dynamo support (#736)
|
3 months ago |
|
gptq
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
gptq_marlin
|
6144150398
chore: use scalar type to dispatch to different `gptq_marlin` kernels (#689)
|
4 months ago |
|
int8_kvcache
|
9810daa699
feat: INT8 KV Cache (#298)
|
10 months ago |
|
marlin
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
quip
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
squeezellm
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
quant_ops.h
|
0fd2b56836
wip
|
3 months ago |
AlpinDale
0fd2b56836
wip