Commit History

Author SHA1 Message Date
  AlpinDale 8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) 11 months ago
  AlpinDale 801eda0b7a feat: support GPTQ 2, 3, and 8bit quants (#181) 1 year ago
  AlpinDale 62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152) 1 year ago
  AlpinDale 887e03669a feat: add exllamav2 for GPTQ (#99) 1 year ago