david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)		vor 1 Woche
..
llm	3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)	vor 1 Woche
openai	5b03d67abb Core: add output streaming support to multi-step + async (#1112)	vor 3 Wochen
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	vor 3 Monaten
conftest.py	c6c91edab7 ci: update & overhaul test units (#769)	vor 3 Monaten
test_chat_utils.py	f644e10449 vlm: enable multimodal inputs for the LLM class (#992)	vor 1 Monat