david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)		2 weeks ago
..
marlin_moe_kernel.h	fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)	2 weeks ago
marlin_moe_kernel_ku4b8.cu	fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)	2 weeks ago
marlin_moe_kernel_ku4b8.h	fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)	2 weeks ago
marlin_moe_kernel_ku8b128.cu	fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)	2 weeks ago
marlin_moe_kernel_ku8b128.h	fa84f8102e kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)	2 weeks ago