david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/perplexity

drummerv e59dd4a90d fix: openai gguf chat template (#312)		преди 10 месеца
..
common	c41462cfcd feat: exllamav2 quantization (#305)	преди 10 месеца
endpoints	e59dd4a90d fix: openai gguf chat template (#312)	преди 10 месеца
engine	c41462cfcd feat: exllamav2 quantization (#305)	преди 10 месеца
kv_quant	9810daa699 feat: INT8 KV Cache (#298)	преди 10 месеца
lora	a1d8ab9f3e fix: lora on quantized models (barred gguf) (#292)	преди 10 месеца
modeling	968bde81bf fix: tensor parallel with GPTQ and AWQ quants (#307)	преди 10 месеца
processing	c2d77b1822 chore: logging refactor (#302)	преди 10 месеца
task_handler	c2d77b1822 chore: logging refactor (#302)	преди 10 месеца
transformers_utils	e59dd4a90d fix: openai gguf chat template (#312)	преди 10 месеца
__init__.py	ff898c2c80 bump version to 0.5.0 (#303)	преди 10 месеца
py.typed	1c988a48b2 fix logging and add py.typed	преди 1 година