AlpinDale
|
a1f18f17e6
modify the cache engine and model runner/worker to support mamba states
|
hai 9 meses |
AlpinDale
|
7fd3bd4bf2
add selective scan kernels
|
hai 9 meses |
AlpinDale
|
44b02e94cd
add forward kernels for causal depthwise conv1d
|
hai 9 meses |
AlpinDale
|
1dccb03b17
incorrect comparison for hadamard and punica checks
|
hai 9 meses |
AlpinDale
|
0b1aad2924
split requirements
|
hai 9 meses |
AlpinDale
|
a304f76d89
feat: Intel CPU support (#403)
|
hai 9 meses |
AlpinDale
|
95faf27d2b
fix build for 7.5
|
hai 9 meses |
AlpinDale
|
2c512a0824
CMake build system (#395)
|
hai 9 meses |
AlpinDale
|
41f5af0426
add python nccl wrapper, remove cupy
|
hai 9 meses |
AlpinDale
|
0f1399c135
feat: attention refactor part 2
|
hai 9 meses |
AlpinDale
|
d1786645a3
fix formatting
|
hai 9 meses |
AlpinDale
|
4415f0d1f1
conflicts with _is_neuron()
|
hai 9 meses |
AlpinDale
|
9534fcfb7b
fix: build error
|
hai 9 meses |
AlpinDale
|
29c241c115
fix: explicitly disallow installation on non-linux platforms (#373)
|
hai 9 meses |
AlpinDale
|
3d6695cfbb
feat: add approximate gelu activation kernels (#370)
|
hai 9 meses |
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
hai 9 meses |
AlpinDale
|
e120404436
Revert "feat: CMake Build System Generator (#332)"
|
hai 10 meses |
AlpinDale
|
ad6802690f
feat: CMake Build System Generator (#332)
|
hai 10 meses |
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hai 10 meses |
AlpinDale
|
c41462cfcd
feat: exllamav2 quantization (#305)
|
hai 10 meses |
sgsdxzy
|
94c1543cae
fix: typo in marlin kernel path (#295)
|
hai 10 meses |
AlpinDale
|
e0c35bb353
feat: bitsandbytes and `--load-in{4,8}bit` support (#294)
|
hai 10 meses |
AlpinDale
|
705821a7fe
feat: AQLM quantization support (#293)
|
hai 10 meses |
AlpinDale
|
13d850334e
fix: navi support (#283)
|
hai 10 meses |
AlpinDale
|
7d6ba53602
feat: fused top-k kernels for MoE (#273)
|
hai 11 meses |
AlpinDale
|
4360684667
fix: cuda version in wheel
|
hai 11 meses |
AlpinDale
|
f99eb2c874
fix: hadamard tensors not included in wheel
|
hai 11 meses |
AlpinDale
|
d9b65e6c5f
feat: DeepSeek MoE support (#237)
|
hai 11 meses |
AlpinDale
|
aebd68c632
feat: backport kernels (#235)
|
hai 11 meses |
AlpinDale
|
5d288aa76c
feat: add fast hadamard transformation kernels (#232)
|
hai 11 meses |