david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)		1 неделя назад
..
llm	3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)	1 неделя назад
openai	5b03d67abb Core: add output streaming support to multi-step + async (#1112)	3 недель назад
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	3 месяцев назад
conftest.py	c6c91edab7 ci: update & overhaul test units (#769)	3 месяцев назад
test_chat_utils.py	f644e10449 vlm: enable multimodal inputs for the LLM class (#992)	1 месяц назад