david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ 39beed0b87cbbd93bad2b11b939a15941cf67f6f

AlpinDale 39beed0b87 Revert "Refactor AWQ support."		před 1 rokem
..
common	39beed0b87 Revert "Refactor AWQ support."	před 1 rokem
endpoints	6b9561ef07 adapt TGI incremental detokenization	před 1 rokem
engine	39beed0b87 Revert "Refactor AWQ support."	před 1 rokem
modeling	39beed0b87 Revert "Refactor AWQ support."	před 1 rokem
processing	45f6d9f923 initial refactor commit	před 1 rokem
task_handler	45f6d9f923 initial refactor commit	před 1 rokem
transformers_utils	663dd09399 Revert "fix: detokenization with special tokens"	před 1 rokem
__init__.py	2399cbd3e6 feat: bump up the version to 0.2.1	před 1 rokem