AlpinDale 0e6c400b13 feat: re-add GGUF (#600) 4 месяцев назад
..
all_reduce 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 5 месяцев назад
attention dc1b59df9c fix: compiler warnings for _C and _moe 4 месяцев назад
backup f8dfac6372 chore: attention refactor and upstream sync apr01 (#365) 9 месяцев назад
core 141672a0d4 kernels: disambiguate quantized types via a new ScalarType 4 месяцев назад
cpu 141672a0d4 kernels: disambiguate quantized types via a new ScalarType 4 месяцев назад
hadamard 5d288aa76c feat: add fast hadamard transformation kernels (#232) 11 месяцев назад
mamba dc1b59df9c fix: compiler warnings for _C and _moe 4 месяцев назад
moe 141672a0d4 kernels: disambiguate quantized types via a new ScalarType 4 месяцев назад
prepare_inputs dd18c5042c move prepare_inputs to the GPU (#596) 4 месяцев назад
punica 848731f527 chore: add punica sizes for mistral nemo 4 месяцев назад
quantization 0e6c400b13 feat: re-add GGUF (#600) 4 месяцев назад
activation_kernels.cu 5fbd93797d fix: beta value in gelu_tanh kernel being divided by 0.5 4 месяцев назад
cache.h 32bdbd1ee4 chore: add fp8 support to `reshape_and_cache_flash` 4 месяцев назад
cache_kernels.cu 32bdbd1ee4 chore: add fp8 support to `reshape_and_cache_flash` 4 месяцев назад
cuda_compat.h 00acf371f9 rocm: fused topk softmax 5 месяцев назад
cuda_utils.h 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 5 месяцев назад
cuda_utils_kernels.cu 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 5 месяцев назад
dispatch_utils.h dc1b59df9c fix: compiler warnings for _C and _moe 4 месяцев назад
layernorm_kernels.cu dc1b59df9c fix: compiler warnings for _C and _moe 4 месяцев назад
ops.h dd18c5042c move prepare_inputs to the GPU (#596) 4 месяцев назад
pos_encoding_kernels.cu 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 5 месяцев назад
reduction.cuh aba03b4756 feat: dynamic per-token activation quantization 5 месяцев назад
torch_bindings.cpp 0e6c400b13 feat: re-add GGUF (#600) 4 месяцев назад