david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 229733d39fd501ce3a172c6fe48d25cc2c2b2b85

mirror of https://github.com/PygmalionAI/aphrodite-engine

AlpinDale c240ac58e0 chore: update openai example		1 year ago
..
api_client.py	ba1c825b79 feat: add API examples	1 year ago
gradio_server.py	39e1c0b1df chore: add demo gradio server	1 year ago
openai_client.py	c240ac58e0 chore: update openai example	1 year ago