david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 801eda0b7a3c3c44ca165c95b461800a31bb770c

AlpinDale 801eda0b7a feat: support GPTQ 2, 3, and 8bit quants (#181)		1 年之前
..
common	b9b295d74e chore: backlogs 1 (#191)	1 年之前
endpoints	b9b295d74e chore: backlogs 1 (#191)	1 年之前
engine	b9b295d74e chore: backlogs 1 (#191)	1 年之前
modeling	801eda0b7a feat: support GPTQ 2, 3, and 8bit quants (#181)	1 年之前
processing	b9b295d74e chore: backlogs 1 (#191)	1 年之前
task_handler	7d91e9e0f2 feat: CUDA graphs (#172)	1 年之前
transformers_utils	e59e7f0a99 feat: yi support (#104)	1 年之前
__init__.py	282675e4a1 bump version to 0.4.3	1 年之前
py.typed	1c988a48b2 fix logging and add py.typed	1 年之前