 AlpinDale
|
ba371fbbbd
feat: AWQ marlin kernels (#603)
|
vor 5 Monaten |
|
AlpinDale
|
9be43994fe
feat: fbgemm quantization support (#601)
|
vor 5 Monaten |
 AlpinDale
|
517676249c
chore: update the compressed-tensors config
|
vor 5 Monaten |
|
AlpinDale
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
vor 5 Monaten |
|
AlpinDale
|
690110a051
feat: bitsandbytes quantization
|
vor 5 Monaten |
|
AlpinDale
|
0307da9e15
refactor: bitsandbytes -> autoquant
|
vor 5 Monaten |
|
AlpinDale
|
f4ea11b982
feat: initial support for activation quantization
|
vor 6 Monaten |
|
AlpinDale
|
c66b1b57b1
Marlin 2:4 sparsity (#555)
|
vor 6 Monaten |
|
AlpinDale
|
1e35cef979
feat: add arctic snowflake model (#551)
|
vor 6 Monaten |
|
AlpinDale
|
f22b700ee4
feat: marlin kernels for GPTQ (#547)
|
vor 6 Monaten |
|
AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
vor 6 Monaten |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 6 Monaten |
|
AlpinDale
|
42998e423c
better quant verification
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
