david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 62b2c4119d2aa9e2bb5406d99bbdf9a4ff04276b

AlpinDale 62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152)		1 yıl önce
..
__init__.py	1334a833a4 feat: AMD ROCm support (#95)	1 yıl önce
awq.py	62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152)	1 yıl önce
base_config.py	0d51eac374 feat: awq for all models (#124)	1 yıl önce
gptq.py	62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152)	1 yıl önce
squeezellm.py	62b2c4119d feat: re-write GPTQ and refactor exllama kernels (#152)	1 yıl önce