Author | SHA1 Message | Date |
---|---|---|
AlpinDale | 8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) | 11 months ago |
AlpinDale | 801eda0b7a feat: support GPTQ 2, 3, and 8bit quants (#181) | 1 year ago |
AlpinDale | 62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152) | 1 year ago |
AlpinDale | 887e03669a feat: add exllamav2 for GPTQ (#99) | 1 year ago |