david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ rejection_sampling_kernels

AlpinDale 0f72141ca2 api: support multiple input images		1 month ago
..
llm	f61acdd3ec api: add json_schema to OpenAI server (#915)	1 month ago
openai	0f72141ca2 api: support multiple input images	1 month ago
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	2 months ago
conftest.py	c6c91edab7 ci: update & overhaul test units (#769)	2 months ago
test_chat_utils.py	0f72141ca2 api: support multiple input images	1 month ago