david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 0f4a9ee77be8a5a4a58d8a13d66eaab4e42bcf9e

AlpinDale 63b735bc2a chore: optimize v2 block manager to match the performance of v1		7 meses atrás
..
kobold	9d81716bfd [v0.5.3] Release Candidate (#388)	10 meses atrás
openai	63b735bc2a chore: optimize v2 block manager to match the performance of v1	7 meses atrás
__init__.py	e52de7de70 feat: add API endpoint with FastAPI	1 ano atrás
cli.py	9d81716bfd [v0.5.3] Release Candidate (#388)	10 meses atrás
llm.py	c0c336aaa3 refactor: registry for processing model inputs; quick_gelu; clip model support	7 meses atrás