david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 172dee25731746a9e8f916ba2d4a8c6b71c16f02

AlpinDale 3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)		1 week ago
..
__init__.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
test_encode.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
test_generate.py	3e6addcc2c LLM: enable batched inference for llm.chat() API (#1120)	1 week ago
test_generate_multiple_loras.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
test_guided_generate.py	c6c91edab7 ci: update & overhaul test units (#769)	3 months ago
test_lazy_outlines.py	f61acdd3ec api: add json_schema to OpenAI server (#915)	2 months ago
test_prompt_validation.py	16e5b2be8b fix: empty prompt crashing the server (#912)	2 months ago