david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ c1fa7e856723fc178663fd34d22b28fa2f95fc03

AlpinDale c1fa7e8567 chore: fix datatype check (#65)		1 anno fa
..
common	c1fa7e8567 chore: fix datatype check (#65)	1 anno fa
endpoints	16bf6b61a3 fix: requests stalling in KAI non-streaming endpoint (#46)	1 anno fa
engine	0495c50a3e GPTQ+exllama support (#21)	1 anno fa
modeling	a6a4220fa6 feat: refactor megatron and quants (#57)	1 anno fa
processing	cbeeabeb9a feat: mistral support (#20)	1 anno fa
task_handler	c1fa7e8567 chore: fix datatype check (#65)	1 anno fa
transformers_utils	cbeeabeb9a feat: mistral support (#20)	1 anno fa
__init__.py	a6fb3d54e0 bump version to v0.3.4	1 anno fa