 AlpinDale
|
5884e0b904
add bitnetforcausallm support
|
преди 6 месеца |
|
AlpinDale
|
f4ea11b982
feat: initial support for activation quantization
|
преди 6 месеца |
|
AlpinDale
|
6fc1ec6e9a
fix redirects and improve low level debugging
|
преди 6 месеца |
|
AlpinDale
|
7d23892501
static and dynamic fp8
|
преди 6 месеца |
 AlpinDale
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
преди 6 месеца |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
преди 7 месеца |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
преди 9 месеца |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
преди 11 месеца |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
преди 11 месеца |
|
AlpinDale
|
705821a7fe
feat: AQLM quantization support (#293)
|
преди 11 месеца |
|
AlpinDale
|
72229a94da
feat: better marlin kernels (#285)
|
преди 11 месеца |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
преди 1 година |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
преди 1 година |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
преди 1 година |
|
AlpinDale
|
801eda0b7a
feat: support GPTQ 2, 3, and 8bit quants (#181)
|
преди 1 година |
|
AlpinDale
|
7c6fdea535
fix: GPTQ warnings and exllama states (#171)
|
преди 1 година |
|
AlpinDale
|
62b2c4119d
feat: re-write GPTQ and refactor exllama kernels (#152)
|
преди 1 година |
|
AlpinDale
|
2b1ba581f9
feat: re-implement GPTQ (#141)
|
преди 1 година |
|
AlpinDale
|
e7b6a2d5a0
chore: tensor parallel refactors part 2 (#116)
|
преди 1 година |
