david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 64801bbda63dbf193908b6e526ee06b809aad33a

AlpinDale 73177656ed feat: quant_llm support (#755)		преди 3 месеца
..
configs.h	73177656ed feat: quant_llm support (#755)	преди 3 месеца
fp6_linear.cu	73177656ed feat: quant_llm support (#755)	преди 3 месеца
kernel_matmul.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
kernel_reduction.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
ptx_cp.async.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
ptx_mma.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
utils_core.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
utils_gmem.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца
utils_parallel_dequant.cuh	73177656ed feat: quant_llm support (#755)	преди 3 месеца