david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)		il y a 1 semaine
..
llm	3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)	il y a 1 semaine
openai	5b03d67abb Core: add output streaming support to multi-step + async (#1112)	il y a 3 semaines
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	il y a 3 mois
conftest.py	c6c91edab7 ci: update & overhaul test units (#769)	il y a 3 mois
test_chat_utils.py	f644e10449 vlm: enable multimodal inputs for the LLM class (#992)	il y a 1 mois