Author | SHA1 Message | Date |
---|---|---|
AlpinDale | 5b0c11d190 support pipeline parallel pynccl groups | 6 months ago |
AlpinDale | 9e73559eba make use of batched rotary embedding kernels to support long context lora | 6 months ago |
AlpinDale | e87c32bed3 feat: full tensor parallel for LoRA layers (#545) | 6 months ago |
AlpinDale | c0aac15421 feat: S-LoRA support (#222) | 1 year ago |