 AlpinDale
|
4ec08af18b
chore: update fused MoE weight loading (#700)
|
vor 4 Monaten |
|
AlpinDale
|
0e558e9b2f
fix: loading chameleon model with TP>1 (#695)
|
vor 4 Monaten |
|
AlpinDale
|
3f712cd287
feat: add progress bar for loading individual weight modules (#640)
|
vor 4 Monaten |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 4 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 9 Monaten |
|
AlpinDale
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
vor 9 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 10 Monaten |
|
AlpinDale
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
vor 10 Monaten |
|
AlpinDale
|
7d6ba53602
feat: fused top-k kernels for MoE (#273)
|
vor 10 Monaten |
|
AlpinDale
|
224b87b484
feat: add fused mixtral moe support (#238)
|
vor 10 Monaten |
|
AlpinDale
|
842912d022
feat: on-the-fly gguf conversion (#250)
|
vor 11 Monaten |
|
AlpinDale
|
d9b65e6c5f
feat: DeepSeek MoE support (#237)
|
vor 11 Monaten |
|
AlpinDale
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
vor 11 Monaten |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 11 Monaten |
|
AlpinDale
|
97f37c1cb2
fix: use tensor parallel for quantized mixtral (#213)
|
vor 11 Monaten |
 AlpinDale
|
193287b2ef
fix: mixtral unused import
|
vor 1 Jahr |
|
AlpinDale
|
53d391e1f2
merge 'dev' into 'main'
|
vor 1 Jahr |
|
AlpinDale
|
7e72ce0a73
feat: mixtral tensor parallelism (#193)
|
vor 1 Jahr |
|
AlpinDale
|
b9b295d74e
chore: backlogs 1 (#191)
|
vor 1 Jahr |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
vor 1 Jahr |
 g4rg
|
fe57bb7ad2
feat: add rope scaling to mixtral (#174)
|
vor 1 Jahr |
|
AlpinDale
|
7d91e9e0f2
feat: CUDA graphs (#172)
|
vor 1 Jahr |
|
AlpinDale
|
725be3e0de
feat: mixtral HF with expert parallelism (#167)
|
vor 1 Jahr |
|
AlpinDale
|
730357c7d5
chore: implement lazy module loader for models (#165)
|
vor 1 Jahr |
|
AlpinDale
|
2755a48d51
merge dev branch into main (#153)
|
vor 1 Jahr |
|
AlpinDale
|
87277c76e4
feat: Mixtral 8x7B support (#155)
|
vor 1 Jahr |
