AlpinDale 73177656ed feat: quant_llm support (#755) hace 3 meses
..
aqlm ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) hace 3 meses
autoquant f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
awq f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
compressed_tensors f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
cutlass_w8a8 a401f8e05d feat: per-tensor token epilogue kernels (#630) hace 4 meses
exl2 f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
fp6 73177656ed feat: quant_llm support (#755) hace 3 meses
fp8 b0f262eec1 feat: FP8 quantization support for AMD ROCm (#729) hace 3 meses
gguf ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) hace 3 meses
gptq f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
gptq_marlin 6144150398 chore: use scalar type to dispatch to different `gptq_marlin` kernels (#689) hace 4 meses
int8_kvcache 9810daa699 feat: INT8 KV Cache (#298) hace 10 meses
marlin f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
quip f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
squeezellm f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
quant_ops.h 73177656ed feat: quant_llm support (#755) hace 3 meses