 AlpinDale
|
968bde81bf
fix: tensor parallel with GPTQ and AWQ quants (#307)
|
10 months ago |
|
AlpinDale
|
c41462cfcd
feat: exllamav2 quantization (#305)
|
10 months ago |
|
AlpinDale
|
705821a7fe
feat: AQLM quantization support (#293)
|
10 months ago |
 TearGosling
|
80e8a14949
feat: add pygchat Jinja template (#218)
|
11 months ago |
 AlpinDale
|
8635901c76
fix: s-lora vocab embeddings
|
11 months ago |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
11 months ago |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
11 months ago |
|
AlpinDale
|
c0aac15421
feat: S-LoRA support (#222)
|
11 months ago |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
11 months ago |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
