david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ c1fa7e856723fc178663fd34d22b28fa2f95fc03

AlpinDale b20083a1f3 feat: finish kernel testing		1 year ago
..
conftest.py	b20083a1f3 feat: finish kernel testing	1 year ago
test_activation.py	46db0b58fb feat: add activation and attention kernel tests	1 year ago
test_attention.py	46db0b58fb feat: add activation and attention kernel tests	1 year ago
test_cache.py	a22310d8fc feat: add cache kernel tests	1 year ago
test_layernorm.py	7906b3566c add layernorm test	1 year ago
test_pos_encoding.py	b20083a1f3 feat: finish kernel testing	1 year ago