david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 5d288aa76c2eaf8bc44b5287027575b7c4324b47

AlpinDale 5d288aa76c feat: add fast hadamard transformation kernels (#232)		1 жил өмнө
..
common	c3a221eb02 feat: GGUF, QuIP#, and Marlin support (#228)	1 жил өмнө
endpoints	59df05f341 feat: add `/metrics` route for kobold (#229)	1 жил өмнө
engine	c3a221eb02 feat: GGUF, QuIP#, and Marlin support (#228)	1 жил өмнө
lora	c0aac15421 feat: S-LoRA support (#222)	1 жил өмнө
modeling	5d288aa76c feat: add fast hadamard transformation kernels (#232)	1 жил өмнө
processing	c0aac15421 feat: S-LoRA support (#222)	1 жил өмнө
task_handler	c3a221eb02 feat: GGUF, QuIP#, and Marlin support (#228)	1 жил өмнө
transformers_utils	c0aac15421 feat: S-LoRA support (#222)	1 жил өмнө
__init__.py	9f77f35ff5 bump version to 0.4.6 (#204)	1 жил өмнө
py.typed	1c988a48b2 fix logging and add py.typed	1 жил өмнө