AlpinDale fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119) há 1 semana atrás
..
all_reduce 6b75a66c60 fix: unsafe all-reduce sync (#1118) há 2 semanas atrás
attention 3bb0f07461 chore: rename `task_handler` to `worker` (#985) há 1 mês atrás
backup 3bb0f07461 chore: rename `task_handler` to `worker` (#985) há 1 mês atrás
core f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) há 1 mês atrás
cpu 8976805f90 kernel: asymmetric AQ AZP quantization kernels (#1048) há 1 mês atrás
cutlass_extensions 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) há 2 meses atrás
flash_attn 7fffa507ff build: build flash attention kernels inside aphrodite (#1085) há 3 semanas atrás
hadamard 5d288aa76c feat: add fast hadamard transformation kernels (#232) há 1 ano atrás
mamba 9bdf8d5bfa mamba: enable continuous batching for mamba kernels (#1055) há 1 mês atrás
moe fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119) há 1 semana atrás
prepare_inputs 1390915778 multi-step: add support for flashinfer attention backend (#1033) há 1 mês atrás
punica f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
quantization fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119) há 1 semana atrás
rocm 61aed092a5 rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066) há 1 mês atrás
sampling bfc8988116 feat: add cuda sampling kernels for top_k and top_p (#828) há 3 meses atrás
xqa 949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115) há 3 semanas atrás
activation_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
cache.h f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
cache_kernels.cu 0256ed236b feat: windows support (#790) há 3 meses atrás
cuda_compat.h f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
cuda_utils.h 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) há 2 meses atrás
cuda_utils_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
dispatch_utils.h f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
layernorm_kernels.cu e14223dce5 kernel: use `cub::BlockReduce` instead of custom impl (#895) há 2 meses atrás
ops.h 525edc1283 build: fix compilation for causal_conv1d_fwd kernel signature (#1057) há 1 mês atrás
permute_cols.cu 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) há 2 meses atrás
pos_encoding_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) há 5 meses atrás
torch_bindings.cpp fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119) há 1 semana atrás