david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ a409431c40a58345feac649856a895444cae74b3 - Gogs

123456

psutil
numpy
torch >= 2.0.0
transformers >= 4.28.0
mypy
pytest