david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/gumbell-softmax-experiment

AlpinDale 15a0454172 feat: FP8 KV Cache (#185)		1 жил өмнө
..
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 жил өмнө
block.py	74604eb252 fix: pylint complaints (#91)	1 жил өмнө
config.py	15a0454172 feat: FP8 KV Cache (#185)	1 жил өмнө
logger.py	8834ecf9de chore: clean up refactor endpoints (#98)	1 жил өмнө
logits_processor.py	f013d714c0 chore: merge dev branch into main (#177)	1 жил өмнө
outputs.py	efc6f7fbec chore: reformats (#90)	1 жил өмнө
sampling_params.py	f013d714c0 chore: merge dev branch into main (#177)	1 жил өмнө
sequence.py	f013d714c0 chore: merge dev branch into main (#177)	1 жил өмнө
utils.py	f013d714c0 chore: merge dev branch into main (#177)	1 жил өмнө