AlpinDale 0fd2b56836 wip 3 месяцев назад
..
aqlm ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 месяцев назад
autoquant f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
awq f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
compressed_tensors f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
cutlass_w8a8 a401f8e05d feat: per-tensor token epilogue kernels (#630) 4 месяцев назад
exl2 f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
flute 0fd2b56836 wip 3 месяцев назад
fp6 73177656ed feat: quant_llm support (#755) 3 месяцев назад
fp8 b0f262eec1 feat: FP8 quantization support for AMD ROCm (#729) 3 месяцев назад
gguf ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 месяцев назад
gptq f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
gptq_marlin 6144150398 chore: use scalar type to dispatch to different `gptq_marlin` kernels (#689) 4 месяцев назад
int8_kvcache 9810daa699 feat: INT8 KV Cache (#298) 10 месяцев назад
marlin f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
quip f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
squeezellm f1d0b77c92 [0.6.0] Release Candidate (#481) 4 месяцев назад
quant_ops.h 0fd2b56836 wip 3 месяцев назад