david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ feat/gumbell-softmax-experiment

AlpinDale 15a0454172 feat: FP8 KV Cache (#185)		1 gadu atpakaļ
..
__init__.py	07aa2a492f upstream: add option to specify tokenizer	1 gadu atpakaļ
block.py	74604eb252 fix: pylint complaints (#91)	1 gadu atpakaļ
config.py	15a0454172 feat: FP8 KV Cache (#185)	1 gadu atpakaļ
logger.py	8834ecf9de chore: clean up refactor endpoints (#98)	1 gadu atpakaļ
logits_processor.py	f013d714c0 chore: merge dev branch into main (#177)	1 gadu atpakaļ
outputs.py	efc6f7fbec chore: reformats (#90)	1 gadu atpakaļ
sampling_params.py	f013d714c0 chore: merge dev branch into main (#177)	1 gadu atpakaļ
sequence.py	f013d714c0 chore: merge dev branch into main (#177)	1 gadu atpakaļ
utils.py	f013d714c0 chore: merge dev branch into main (#177)	1 gadu atpakaļ