david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/gumbell-softmax-experiment

AlpinDale 9183c13b5b add gumbel softmax		vor 11 Monaten
..
common	15a0454172 feat: FP8 KV Cache (#185)	vor 1 Jahr
endpoints	e1f3fd1e02 fix: test units (#201)	vor 1 Jahr
engine	15a0454172 feat: FP8 KV Cache (#185)	vor 1 Jahr
modeling	9183c13b5b add gumbel softmax	vor 11 Monaten
processing	b9b295d74e chore: backlogs 1 (#191)	vor 1 Jahr
task_handler	d54791aaa8 feat: reduce sampler overhead by making it less blocking (#198)	vor 1 Jahr
transformers_utils	e59e7f0a99 feat: yi support (#104)	vor 1 Jahr
__init__.py	9f77f35ff5 bump version to 0.4.6 (#204)	vor 1 Jahr
py.typed	1c988a48b2 fix logging and add py.typed	vor 1 Jahr