david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ astarte

PygmalionAI's large-scale inference engine
pygmalion.chat

It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention).

219 Commits

99 Branches

34 Publicaties

AlpinDale 7676105d90 start working on the mapper		1 jaar geleden
include	7676105d90 start working on the mapper	1 jaar geleden
third_party	18df0131e2 Add submodules	1 jaar geleden
.gitignore	168d2ed239 update gitignore	1 jaar geleden
.gitmodules	18df0131e2 Add submodules	1 jaar geleden
README.md	27fcf6e902 feat: initial commit	1 jaar geleden

		
				README.md
			
				The Codex Astarte