david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ b753ff7870b5787d9e34cb56b717f51aa6b830e6

AlpinDale c05a45f22f chore: minor updates to throughput benchmark and llm class		7 luni în urmă
..
kobold	9d81716bfd [v0.5.3] Release Candidate (#388)	10 luni în urmă
openai	a07fc83bc8 chore: proper util for aphrodite version	7 luni în urmă
__init__.py	e52de7de70 feat: add API endpoint with FastAPI	1 an în urmă
cli.py	9d81716bfd [v0.5.3] Release Candidate (#388)	10 luni în urmă
llm.py	c05a45f22f chore: minor updates to throughput benchmark and llm class	7 luni în urmă