AlpinDale ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 ヶ月 前
..
aqlm ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 ヶ月 前
autoquant f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
awq f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
compressed_tensors f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
cutlass_w8a8 a401f8e05d feat: per-tensor token epilogue kernels (#630) 4 ヶ月 前
exl2 f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
fp8 b0f262eec1 feat: FP8 quantization support for AMD ROCm (#729) 3 ヶ月 前
gguf ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 ヶ月 前
gptq f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
gptq_marlin 6144150398 chore: use scalar type to dispatch to different `gptq_marlin` kernels (#689) 4 ヶ月 前
int8_kvcache 9810daa699 feat: INT8 KV Cache (#298) 10 ヶ月 前
marlin f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
quip f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
squeezellm f1d0b77c92 [0.6.0] Release Candidate (#481) 4 ヶ月 前
quant_ops.h ccbda97416 fix: types in AQLM and GGUF for dynamo support (#736) 3 ヶ月 前