1
0
AlpinDale 61aed092a5 rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066) 4 өдөр өмнө
..
all_reduce 239a8cae25 torch.compile: register all-reduce operations as custom ops (#1050) 1 долоо хоног өмнө
attention 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 долоо хоног өмнө
backup 3bb0f07461 chore: rename `task_handler` to `worker` (#985) 2 долоо хоног өмнө
core f1ea7711bd core: do not compile ScalarType for torch < 2.4.0 (#938) 2 долоо хоног өмнө
cpu 8976805f90 kernel: asymmetric AQ AZP quantization kernels (#1048) 1 долоо хоног өмнө
cutlass_extensions 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 сар өмнө
hadamard 5d288aa76c feat: add fast hadamard transformation kernels (#232) 11 сар өмнө
mamba 9bdf8d5bfa mamba: enable continuous batching for mamba kernels (#1055) 1 долоо хоног өмнө
moe 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) 2 долоо хоног өмнө
prepare_inputs 1390915778 multi-step: add support for flashinfer attention backend (#1033) 1 долоо хоног өмнө
punica f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
quantization 8976805f90 kernel: asymmetric AQ AZP quantization kernels (#1048) 1 долоо хоног өмнө
rocm 61aed092a5 rocm: add support for FP8 KV cache in the custom paged attention kkernels (#1066) 4 өдөр өмнө
sampling bfc8988116 feat: add cuda sampling kernels for top_k and top_p (#828) 1 сар өмнө
activation_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
cache.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
cache_kernels.cu 0256ed236b feat: windows support (#790) 2 сар өмнө
cuda_compat.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
cuda_utils.h 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 сар өмнө
cuda_utils_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
dispatch_utils.h f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
layernorm_kernels.cu e14223dce5 kernel: use `cub::BlockReduce` instead of custom impl (#895) 3 долоо хоног өмнө
ops.h 525edc1283 build: fix compilation for causal_conv1d_fwd kernel signature (#1057) 1 долоо хоног өмнө
permute_cols.cu 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) 1 сар өмнө
pos_encoding_kernels.cu f1d0b77c92 [0.6.0] Release Candidate (#481) 4 сар өмнө
torch_bindings.cpp 9bdf8d5bfa mamba: enable continuous batching for mamba kernels (#1055) 1 долоо хоног өмнө