AlpinDale e32f506e17 chore: gpu arch guard for cutlass w8a8 kernels 7 months ago
..
all_reduce 9d81716bfd [v0.5.3] Release Candidate (#388) 10 months ago
attention ced1b36b8b feat: support head size of 192 7 months ago
backup f8dfac6372 chore: attention refactor and upstream sync apr01 (#365) 11 months ago
cpu ba02fb65c9 fix: pos encodings for CPU 7 months ago
hadamard 5d288aa76c feat: add fast hadamard transformation kernels (#232) 1 year ago
moe 00acf371f9 rocm: fused topk softmax 7 months ago
punica 3bdeb3e116 fix: clang formatting for all kernels (#558) 7 months ago
quantization e32f506e17 chore: gpu arch guard for cutlass w8a8 kernels 7 months ago
activation_kernels.cu 3d6695cfbb feat: add approximate gelu activation kernels (#370) 11 months ago
cache.h 3bdeb3e116 fix: clang formatting for all kernels (#558) 7 months ago
cache_kernels.cu 3bdeb3e116 fix: clang formatting for all kernels (#558) 7 months ago
cuda_compat.h 00acf371f9 rocm: fused topk softmax 7 months ago
cuda_utils.h 31c95011a6 feat: FP8 E5M2 KV Cache (#226) 1 year ago
cuda_utils_kernels.cu 31c95011a6 feat: FP8 E5M2 KV Cache (#226) 1 year ago
dispatch_utils.h f8dfac6372 chore: attention refactor and upstream sync apr01 (#365) 11 months ago
layernorm_kernels.cu 9d81716bfd [v0.5.3] Release Candidate (#388) 10 months ago
ops.h 696f2cd59c add phi3_small support with blocksparse attention 7 months ago
pos_encoding_kernels.cu e702f587cf feat: add batched RoPE kernels (#371) 11 months ago
pybind.cpp 3bdeb3e116 fix: clang formatting for all kernels (#558) 7 months ago
reduction.cuh 9d81716bfd [v0.5.3] Release Candidate (#388) 10 months ago