 AlpinDale
|
61aed092a5
rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066)
|
hace 6 días |
|
AlpinDale
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
hace 1 semana |
|
AlpinDale
|
239a8cae25
torch.compile: register all-reduce operations as custom ops (#1050)
|
hace 1 semana |
|
AlpinDale
|
8976805f90
kernel: asymmetric AQ AZP quantization kernels (#1048)
|
hace 1 semana |
|
AlpinDale
|
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)
|
hace 1 semana |
|
AlpinDale
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
hace 1 semana |
|
AlpinDale
|
a113309876
kernel: add meta functions for ops to prevent graph breaks (#1019)
|
hace 1 semana |
|
AlpinDale
|
fcfcfc65e1
quants: add triton kernels for AWQ (#946)
|
hace 2 semanas |
|
AlpinDale
|
9f3e7c86e2
feat: add fused Marlin MoE kernel (#934)
|
hace 2 semanas |
|
AlpinDale
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
hace 1 mes |
|
AlpinDale
|
bfc8988116
feat: add cuda sampling kernels for top_k and top_p (#828)
|
hace 1 mes |
|
AlpinDale
|
f98e7b2f8c
feat: add HQQ quantization support (#795)
|
hace 2 meses |
|
AlpinDale
|
73177656ed
feat: quant_llm support (#755)
|
hace 3 meses |
|
AlpinDale
|
ccbda97416
fix: types in AQLM and GGUF for dynamo support (#736)
|
hace 3 meses |
|
AlpinDale
|
b0f262eec1
feat: FP8 quantization support for AMD ROCm (#729)
|
hace 3 meses |
|
AlpinDale
|
5d37ec1016
suppress tpu import warning (#696)
|
hace 3 meses |
|
AlpinDale
|
a401f8e05d
feat: per-tensor token epilogue kernels (#630)
|
hace 4 meses |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 4 meses |
