david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 39beed0b87cbbd93bad2b11b939a15941cf67f6f

AlpinDale 39beed0b87 Revert "Refactor AWQ support."		1 år sedan
..
common	39beed0b87 Revert "Refactor AWQ support."	1 år sedan
endpoints	6b9561ef07 adapt TGI incremental detokenization	1 år sedan
engine	39beed0b87 Revert "Refactor AWQ support."	1 år sedan
modeling	39beed0b87 Revert "Refactor AWQ support."	1 år sedan
processing	45f6d9f923 initial refactor commit	1 år sedan
task_handler	45f6d9f923 initial refactor commit	1 år sedan
transformers_utils	663dd09399 Revert "fix: detokenization with special tokens"	1 år sedan
__init__.py	2399cbd3e6 feat: bump up the version to 0.2.1	1 år sedan