| .. |
|
attention
|
4e71bd1d12
feat: add PagedAttention V2 kernels (#76)
|
hai 1 ano |
|
quantization
|
887e03669a
feat: add exllamav2 for GPTQ (#99)
|
hai 1 ano |
|
activation.cpp
|
32844c1522
add GELU kernels and remove compile bloat
|
hai 1 ano |
|
activation_kernels.cu
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
hai 1 ano |
|
attention.cpp
|
4e71bd1d12
feat: add PagedAttention V2 kernels (#76)
|
hai 1 ano |
|
cache.cpp
|
081545bde6
fix: various CUDA kernel tweaks
|
hai 1 ano |
|
cache_kernels.cu
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
hai 1 ano |
|
cuda_utils.cpp
|
75c27d3e65
massive overhaul
|
hai 1 ano |
|
cuda_utils_kernels.cu
|
75c27d3e65
massive overhaul
|
hai 1 ano |
|
dispatch_utils.h
|
32844c1522
add GELU kernels and remove compile bloat
|
hai 1 ano |
|
layernorm.cpp
|
081545bde6
fix: various CUDA kernel tweaks
|
hai 1 ano |
|
layernorm_kernels.cu
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
hai 1 ano |
|
pos_encoding.cpp
|
45f6d9f923
initial refactor commit
|
hai 1 ano |
|
pos_encoding_kernels.cu
|
3d72f05c7b
feat: flattened 1D tensor -> 2D tensor (#85)
|
hai 1 ano |
|
quantization.cpp
|
887e03669a
feat: add exllamav2 for GPTQ (#99)
|
hai 1 ano |
|
reduction.cuh
|
081545bde6
fix: various CUDA kernel tweaks
|
hai 1 ano |
AlpinDale
887e03669a
feat: add exllamav2 for GPTQ (#99)