Autor | SHA1 Nachricht | Datum |
---|---|---|
|
8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) | vor 1 Jahr |
|
801eda0b7a feat: support GPTQ 2, 3, and 8bit quants (#181) | vor 1 Jahr |
|
b9b295d74e chore: backlogs 1 (#191) | vor 1 Jahr |
|
62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152) | vor 1 Jahr |
|
887e03669a feat: add exllamav2 for GPTQ (#99) | vor 1 Jahr |