 AlpinDale
|
815736fc54
feat: add cuda kernels for sampling
|
vor 5 Monaten |
 AlpinDale
|
ba371fbbbd
feat: AWQ marlin kernels (#603)
|
vor 5 Monaten |
|
AlpinDale
|
c8f5424d72
add scale_ub inputs to fp8 dynamic per-token quant
|
vor 5 Monaten |
|
AlpinDale
|
196e6b64f1
feat: add fp8 dynamic per-token quant kernel
|
vor 5 Monaten |
|
AlpinDale
|
dd18c5042c
move prepare_inputs to the GPU (#596)
|
vor 5 Monaten |
|
AlpinDale
|
f5d52320da
Port mamba kernels to Aphrodite (#595)
|
vor 5 Monaten |
|
AlpinDale
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
vor 5 Monaten |
|
AlpinDale
|
ad24e74a99
feat: FP8 weight-only quantization support for Ampere GPUs
|
vor 5 Monaten |
|
AlpinDale
|
5be90c3859
Mamba infrastrucuture support (#586)
|
vor 5 Monaten |
|
AlpinDale
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
vor 5 Monaten |
|
AlpinDale
|
5b464d36ea
feat: bias epilogue support for cutlass kernels
|
vor 5 Monaten |
|
AlpinDale
|
cd9ed8623b
fix: cuda version check for fp8 support in the cutlass kernels
|
vor 5 Monaten |
|
AlpinDale
|
7e54c3916d
chore: factor out epilogues from cutlass kernels
|
vor 5 Monaten |
|
AlpinDale
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
vor 5 Monaten |
