david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 017b42c51788aa67d15f3eb7c2cef3a7ec0dfae7

AlpinDale c05a45f22f chore: minor updates to throughput benchmark and llm class		7 miesięcy temu
..
kobold	9d81716bfd [v0.5.3] Release Candidate (#388)	10 miesięcy temu
openai	a07fc83bc8 chore: proper util for aphrodite version	7 miesięcy temu
__init__.py	e52de7de70 feat: add API endpoint with FastAPI	1 rok temu
cli.py	9d81716bfd [v0.5.3] Release Candidate (#388)	10 miesięcy temu
llm.py	c05a45f22f chore: minor updates to throughput benchmark and llm class	7 miesięcy temu