 AlpinDale
|
cec4da1dab
quants: support w8a8 fp8 block-wise quantization from DS3
|
vor 1 Monat |
 AlpinDale
|
dcb36de9c4
quants: add support for NVIDIA's ModelOpt checkpoints (#1013)
|
vor 1 Monat |
|
AlpinDale
|
83af2524f3
quants: add GPTQ and FBGEMM to AphroditeParameters (#987)
|
vor 1 Monat |
|
AlpinDale
|
6bdff60aab
quant: support pre-quanted bitsandbytes checkpoints (#961)
|
vor 1 Monat |
|
AlpinDale
|
f4b62bf803
quant: update tpu_int8 to use AphroditeParameters (#959)
|
vor 1 Monat |
|
AlpinDale
|
5cb2e998d8
quants: update compressed tensors lifecycle to remove `prefix` from `create_weights` (#924)
|
vor 1 Monat |
|
AlpinDale
|
5d9021969c
quants: update `qqq` and `gptq_marlin_24` to use AphroditeParameters (#921)
|
vor 1 Monat |
|
AlpinDale
|
799667737b
quantization: update marlin to use `AphroditeParameters` (#913)
|
vor 1 Monat |
|
AlpinDale
|
afc9a28aa0
chore: add AphroditeParameter support for FP8 quant (#902)
|
vor 1 Monat |
|
AlpinDale
|
e182d00256
feat: AWQ quantization for InternVL (#867)
|
vor 1 Monat |
|
AlpinDale
|
f98e7b2f8c
feat: add HQQ quantization support (#795)
|
vor 2 Monaten |
|
AlpinDale
|
edec2e9a9e
feat: migrate awq and awq_marlin to AphroditeParameter (#702)
|
vor 4 Monaten |
|
AlpinDale
|
4f6020cc86
chore: migrate gptq_marlin to AphroditeParameters (#699)
|
vor 4 Monaten |
|
AlpinDale
|
df208ab4e9
fix: fp8 checkpoints with fused linear modules (#677)
|
vor 4 Monaten |
|
AlpinDale
|
f1e1d0bd3d
feat: introduce `BaseAphroditeParameter` (#646)
|
vor 4 Monaten |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 4 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 10 Monaten |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
vor 10 Monaten |
|
AlpinDale
|
705821a7fe
feat: AQLM quantization support (#293)
|
vor 10 Monaten |
|
AlpinDale
|
72229a94da
feat: better marlin kernels (#285)
|
vor 10 Monaten |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
vor 11 Monaten |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
vor 1 Jahr |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 1 Jahr |
|
AlpinDale
|
801eda0b7a
feat: support GPTQ 2, 3, and 8bit quants (#181)
|
vor 1 Jahr |
|
AlpinDale
|
7c6fdea535
fix: GPTQ warnings and exllama states (#171)
|
vor 1 Jahr |
|
AlpinDale
|
62b2c4119d
feat: re-write GPTQ and refactor exllama kernels (#152)
|
vor 1 Jahr |
|
AlpinDale
|
2b1ba581f9
feat: re-implement GPTQ (#141)
|
vor 1 Jahr |
|
AlpinDale
|
e7b6a2d5a0
chore: tensor parallel refactors part 2 (#116)
|
vor 1 Jahr |
