david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)		3 weeks ago
..
cubin	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_common.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl_common.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl_common.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl_precompiled.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_impl_precompiled.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_runner.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
decoder_xqa_runner.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
env_utils.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
env_utils.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
torch_bindings.cpp	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
xqa_kernel_cubin.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
xqa_kernel_launcher.cu	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
xqa_kernel_launcher.cuh	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
xqa_ops.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago
xqa_params.h	949f974c59 (1/N) XQA: integrate the XQA CUDA kernels within Aphrodite (#1115)	3 weeks ago