| .. |
|
all_reduce
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
attention
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
4 months ago |
|
backup
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
9 months ago |
|
cpu
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
4 months ago |
|
hadamard
|
5d288aa76c
feat: add fast hadamard transformation kernels (#232)
|
11 months ago |
|
mamba
|
f5d52320da
Port mamba kernels to Aphrodite (#595)
|
4 months ago |
|
moe
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
prepare_inputs
|
dd18c5042c
move prepare_inputs to the GPU (#596)
|
4 months ago |
|
punica
|
4f42985b5c
feat: qwen2 lora shapes
|
5 months ago |
|
quantization
|
ba371fbbbd
feat: AWQ marlin kernels (#603)
|
4 months ago |
|
sampling
|
815736fc54
feat: add cuda kernels for sampling
|
4 months ago |
|
activation_kernels.cu
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
4 months ago |
|
cache.h
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
4 months ago |
|
cache_kernels.cu
|
9d7beaa5b9
chore: separate kv_scale into k_scale and v_scale
|
4 months ago |
|
cuda_compat.h
|
00acf371f9
rocm: fused topk softmax
|
5 months ago |
|
cuda_utils.h
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
cuda_utils_kernels.cu
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
dispatch_utils.h
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
layernorm_kernels.cu
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
ops.h
|
815736fc54
feat: add cuda kernels for sampling
|
4 months ago |
|
pos_encoding_kernels.cu
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
reduction.cuh
|
aba03b4756
feat: dynamic per-token activation quantization
|
5 months ago |
|
registration.h
|
156f577f79
feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)
|
5 months ago |
|
torch_bindings.cpp
|
815736fc54
feat: add cuda kernels for sampling
|
4 months ago |
AlpinDale
815736fc54
feat: add cuda kernels for sampling