AlpinDale 61aed092a5 rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066) 4 dni temu
..
all_reduce 239a8cae25 torch.compile: register all-reduce operations as custom ops (#1050) 1 tydzień temu
attention 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 tygodni temu
backup 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 tygodni temu
core f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) 2 tygodni temu
cpu 8976805f90 kernel: asymmetric AQ AZP quantization kernels (#1048) 1 tydzień temu
cutlass_extensions 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 miesiąc temu
hadamard 5d288aa76c feat: add fast hadamard transformation kernels (#232) 11 miesięcy temu
mamba 9bdf8d5bfa mamba: enable continuous batching for mamba kernels (#1055) 1 tydzień temu
moe 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) 2 tygodni temu
prepare_inputs 1390915778 multi-step: add support for flashinfer attention backend (#1033) 1 tydzień temu
punica f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
quantization 8976805f90 kernel: asymmetric AQ AZP quantization kernels (#1048) 1 tydzień temu
rocm 61aed092a5 rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066) 4 dni temu
sampling bfc8988116 feat: add cuda sampling kernels for top_k and top_p (#828) 1 miesiąc temu
activation_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
cache.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
cache_kernels.cu 0256ed236b feat: windows support (#790) 2 miesięcy temu
cuda_compat.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
cuda_utils.h 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 miesiąc temu
cuda_utils_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
dispatch_utils.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
layernorm_kernels.cu e14223dce5 kernel: use `cub::BlockReduce` instead of custom impl (#895) 3 tygodni temu
ops.h 525edc1283 build: fix compilation for causal_conv1d_fwd kernel signature (#1057) 1 tydzień temu
permute_cols.cu 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 miesiąc temu
pos_encoding_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 miesięcy temu
torch_bindings.cpp 9bdf8d5bfa mamba: enable continuous batching for mamba kernels (#1055) 1 tydzień temu