david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ control-vectors

AlpinDale e7e847c3df fix: turn off cutlass scaled_mm for ada lovelace cards		преди 4 месеца
..
broadcast_load_epilogue_c2x.hpp	54f4f1e7f3 allow the cutlass kernels to take scales that reside on the GPU	преди 5 месеца
broadcast_load_epilogue_c3x.hpp	94f4e278ff fix: illegal mem access for cutlass fp8 kernels	преди 5 месеца
common.hpp	051daa0435 fix: add cutlass2x fallback kernels	преди 5 месеца
scaled_mm_c2x.cu	5b464d36ea feat: bias epilogue support for cutlass kernels	преди 5 месеца
scaled_mm_c3x.cu	b03b4d4c8c fix: compute cutlass 3.x epilogues in fp32 instead of 16	преди 5 месеца
scaled_mm_entry.cu	e7e847c3df fix: turn off cutlass scaled_mm for ada lovelace cards	преди 4 месеца