| .. |
|
all_reduce
|
6b75a66c60
fix: unsafe all-reduce sync (#1118)
|
hai 2 semanas |
|
attention
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
hai 1 mes |
|
backup
|
3bb0f07461
chore: rename `task_handler` to `worker` (#985)
|
hai 1 mes |
|
core
|
f1ea7711bd
core: do not compile ScalarType for torch < 2.4.0 (#938)
|
hai 1 mes |
|
cpu
|
8976805f90
kernel: asymmetric AQ AZP quantization kernels (#1048)
|
hai 1 mes |
|
cutlass_extensions
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
hai 2 meses |
|
flash_attn
|
7fffa507ff
build: build flash attention kernels inside aphrodite (#1085)
|
hai 3 semanas |
|
hadamard
|
5d288aa76c
feat: add fast hadamard transformation kernels (#232)
|
hai 1 ano |
|
mamba
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
hai 1 mes |
|
moe
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
hai 1 semana |
|
prepare_inputs
|
1390915778
multi-step: add support for flashinfer attention backend (#1033)
|
hai 1 mes |
|
punica
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
quantization
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
hai 1 semana |
|
rocm
|
61aed092a5
rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066)
|
hai 1 mes |
|
sampling
|
bfc8988116
feat: add cuda sampling kernels for top_k and top_p (#828)
|
hai 3 meses |
|
xqa
|
949f974c59
(1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)
|
hai 3 semanas |
|
activation_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
cache.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
cache_kernels.cu
|
0256ed236b
feat: windows support (#790)
|
hai 3 meses |
|
cuda_compat.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
cuda_utils.h
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
hai 2 meses |
|
cuda_utils_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
dispatch_utils.h
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
layernorm_kernels.cu
|
e14223dce5
kernel: use `cub::BlockReduce` instead of custom impl (#895)
|
hai 2 meses |
|
ops.h
|
525edc1283
build: fix compilation for causal_conv1d_fwd kernel signature (#1057)
|
hai 1 mes |
|
permute_cols.cu
|
93bc863591
feat: Machete Kernels for Hopper GPUs (#842)
|
hai 2 meses |
|
pos_encoding_kernels.cu
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hai 5 meses |
|
torch_bindings.cpp
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
hai 1 semana |
AlpinDale
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)