david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/typ_p_threshold

AlpinDale 3e3bb75300 typical_threshold -> typical_p_sigma		10 months ago
..
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 year ago
api_server.py	398a97338a feat: enable lora loading/unloading via API (#337)	10 months ago
protocol.py	3e3bb75300 typical_threshold -> typical_p_sigma	10 months ago
samplers.json	36ac0e8527 add to api	10 months ago
serving_chat.py	e42a78381a feat: switch from pylint to ruff (#322)	10 months ago
serving_completions.py	e42a78381a feat: switch from pylint to ruff (#322)	10 months ago
serving_engine.py	398a97338a feat: enable lora loading/unloading via API (#337)	10 months ago