david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)		1 week ago
..
llm	3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)	1 week ago
openai	5b03d67abb Core: add output streaming support to multi-step + async (#1112)	2 weeks ago
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
conftest.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
test_chat_utils.py	f644e10449 vlm: enable multimodal inputs for the LLM class (#992)	1 month ago