 AlpinDale
|
00acf371f9
rocm: fused topk softmax
|
il y a 7 mois |
|
AlpinDale
|
0307da9e15
refactor: bitsandbytes -> autoquant
|
il y a 7 mois |
|
AlpinDale
|
4ab4c5c87c
oops
|
il y a 7 mois |
|
AlpinDale
|
d45c846c8c
do not build sm_90a for cuda 11
|
il y a 7 mois |
|
AlpinDale
|
f4ea11b982
feat: initial support for activation quantization
|
il y a 7 mois |
 AlpinDale
|
2313c97e3d
add cutlass w8a8 kernels (#556)
|
il y a 7 mois |
|
AlpinDale
|
c66b1b57b1
Marlin 2:4 sparsity (#555)
|
il y a 7 mois |
|
AlpinDale
|
251568470e
initial nvidia fp8 e4m3 for kv cache
|
il y a 7 mois |
|
AlpinDale
|
e3f2ea4850
make punica kernels work with rocm
|
il y a 7 mois |
|
AlpinDale
|
f22b700ee4
feat: marlin kernels for GPTQ (#547)
|
il y a 7 mois |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
il y a 8 mois |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
il y a 10 mois |
|
AlpinDale
|
e120404436
Revert "feat: CMake Build System Generator (#332)"
|
il y a 1 an |
|
AlpinDale
|
ad6802690f
feat: CMake Build System Generator (#332)
|
il y a 1 an |
