| .. |
|
all_reduce
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
attention
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
vor 2 Monaten |
|
backup
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
vor 2 Monaten |
|
core
|
f1ea7711bd
core: do not compile ScalarType for torch < 2.4.0 (#938)
|
vor 2 Monaten |
|
cpu
|
a113309876
kernel: add meta functions for ops to prevent graph breaks (#1019)
|
vor 2 Monaten |
|
cutlass_extensions
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
vor 3 Monaten |
|
hadamard
|
5d288aa76c
feat: add fast hadamard transformation kernels (#232)
|
vor 1 Jahr |
|
mamba
|
0256ed236b
feat: windows support (#790)
|
vor 4 Monaten |
|
moe
|
9f3e7c86e2
feat: add fused Marlin MoE kernel (#934)
|
vor 2 Monaten |
|
prepare_inputs
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
vor 2 Monaten |
|
punica
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
quantization
|
a113309876
kernel: add meta functions for ops to prevent graph breaks (#1019)
|
vor 2 Monaten |
|
rocm
|
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)
|
vor 2 Monaten |
|
sampling
|
bfc8988116
feat: add cuda sampling kernels for top_k and top_p (#828)
|
vor 3 Monaten |
|
activation_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
cache.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
cache_kernels.cu
|
0256ed236b
feat: windows support (#790)
|
vor 4 Monaten |
|
cuda_compat.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
cuda_utils.h
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
vor 3 Monaten |
|
cuda_utils_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
dispatch_utils.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
layernorm_kernels.cu
|
e14223dce5
kernel: use `cub::BlockReduce` instead of custom impl (#895)
|
vor 2 Monaten |
|
ops.h
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
vor 2 Monaten |
|
permute_cols.cu
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
vor 3 Monaten |
|
pos_encoding_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
torch_bindings.cpp
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
vor 2 Monaten |
AlpinDale
4a7cb8f232
rocm: add custom paged attention kernels for ROCm (#1043)