david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/gumbell-softmax-experiment

AlpinDale 15a0454172 feat: FP8 KV Cache (#185)		1 tahun lalu
..
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 tahun lalu
block.py	74604eb252 fix: pylint complaints (#91)	1 tahun lalu
config.py	15a0454172 feat: FP8 KV Cache (#185)	1 tahun lalu
logger.py	8834ecf9de chore: clean up refactor endpoints (#98)	1 tahun lalu
logits_processor.py	f013d714c0 chore: merge dev branch into main (#177)	1 tahun lalu
outputs.py	efc6f7fbec chore: reformats (#90)	1 tahun lalu
sampling_params.py	f013d714c0 chore: merge dev branch into main (#177)	1 tahun lalu
sequence.py	f013d714c0 chore: merge dev branch into main (#177)	1 tahun lalu
utils.py	f013d714c0 chore: merge dev branch into main (#177)	1 tahun lalu