david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention).

AlpinDale 7b6501bd05 tests: refactor model tests (#1078)		1 day ago
..
configs	411ac4f405 vlm: add support for Qwen2-VL model (#1015)	1 week ago
tokenizer_group	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago
tokenizers	7b6501bd05 tests: refactor model tests (#1078)	1 day ago
__init__.py	267c73c5d3 chore: minor tokenizer tweaks	1 year ago
config.py	411ac4f405 vlm: add support for Qwen2-VL model (#1015)	1 week ago
detokenizer.py	4648f16c84 chore: fix return statement in Detokenizer class (#727)	3 months ago
image_processor.py	be59e30139 vlm: add support for video modality + llava next video (#1014)	1 week ago
processor.py	411ac4f405 vlm: add support for Qwen2-VL model (#1015)	1 week ago
tokenizer.py	638c08d9dc fix: clean shutdown issues (#1047)	1 week ago
utils.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	4 months ago