| .. |
|
all_reduce
|
29eaded422
fix and re-enable custom all-reduce
|
vor 9 Monaten |
|
attention
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
backup
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 9 Monaten |
|
cpu
|
fb23720c72
fix CPU build
|
vor 9 Monaten |
|
hadamard
|
5d288aa76c
feat: add fast hadamard transformation kernels (#232)
|
vor 11 Monaten |
|
moe
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
punica
|
c0aac15421
feat: S-LoRA support (#222)
|
vor 11 Monaten |
|
quantization
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
activation_kernels.cu
|
3d6695cfbb
feat: add approximate gelu activation kernels (#370)
|
vor 9 Monaten |
|
cache.h
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
cache_kernels.cu
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
cuda_compat.h
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
cuda_utils.h
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
vor 11 Monaten |
|
cuda_utils_kernels.cu
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
vor 11 Monaten |
|
dispatch_utils.h
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 9 Monaten |
|
layernorm_kernels.cu
|
40f63268ee
disable new layernorm kernels for CUDA < 12.0
|
vor 9 Monaten |
|
ops.h
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
pos_encoding_kernels.cu
|
e702f587cf
feat: add batched RoPE kernels (#371)
|
vor 9 Monaten |
|
pybind.cpp
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
|
reduction.cuh
|
071269e406
feat: FP8 E4M3 KV Cache (#405)
|
vor 9 Monaten |
AlpinDale
40f63268ee
disable new layernorm kernels for CUDA < 12.0