david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ e13a66925cf2d117b26d0e062e2c62f82dc7f7dd

AlpinDale d8f9f0ec16 fix: prefix prefill kernels for fp32 data type		7 달 전
..
blocksparse_attention	a2d476183f fix: remove scipy and re-implement CSR matrix	7 달 전
__init__.py	9d81716bfd [v0.5.3] Release Candidate (#388)	10 달 전
ipex_attn.py	805fa8721d feat: use intel_extension_for_pytorch for CPU backend	7 달 전
paged_attn.py	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	7 달 전
prefix_prefill.py	d8f9f0ec16 fix: prefix prefill kernels for fp32 data type	7 달 전
triton_flash_attn.py	8e11259e90 missing triton autoconfig for rocm flash attn	8 달 전