| .. |
|
attention
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
quantization
|
d9c1d4f6e5
add awq support
|
1 year ago |
|
activation.cpp
|
32844c1522
add GELU kernels and remove compile bloat
|
1 year ago |
|
activation_kernels.cu
|
32844c1522
add GELU kernels and remove compile bloat
|
1 year ago |
|
attention.cpp
|
24c78e7306
optimization: multi-query attention kernel
|
1 year ago |
|
cache.cpp
|
081545bde6
fix: various CUDA kernel tweaks
|
1 year ago |
|
cache_kernels.cu
|
32844c1522
add GELU kernels and remove compile bloat
|
1 year ago |
|
dispatch_utils.h
|
32844c1522
add GELU kernels and remove compile bloat
|
1 year ago |
|
layernorm.cpp
|
081545bde6
fix: various CUDA kernel tweaks
|
1 year ago |
|
layernorm_kernels.cu
|
32844c1522
add GELU kernels and remove compile bloat
|
1 year ago |
|
pos_encoding.cpp
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
pos_encoding_kernels.cu
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
quantization.cpp
|
d9c1d4f6e5
add awq support
|
1 year ago |
|
reduction.cuh
|
081545bde6
fix: various CUDA kernel tweaks
|
1 year ago |
AlpinDale
d9c1d4f6e5
add awq support