| .. |
|
layers
|
d9b65e6c5f
feat: DeepSeek MoE support (#237)
|
11 months ago |
|
megatron
|
85c92acfb3
fix: do not initialize all-reduce at world_size=1
|
11 months ago |
|
models
|
d9b65e6c5f
feat: DeepSeek MoE support (#237)
|
11 months ago |
|
__init__.py
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 year ago |
|
hf_downloader.py
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
1 year ago |
|
loader.py
|
c0aac15421
feat: S-LoRA support (#222)
|
1 year ago |
|
metadata.py
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
1 year ago |
|
sampling_metadata.py
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
11 months ago |
|
utils.py
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
AlpinDale
85c92acfb3
fix: do not initialize all-reduce at world_size=1