Página Principal Explorar Ajuda
Registe-se Iniciar Sessão
david
/
aphrodite-engine
mirror de https://github.com/PygmalionAI/aphrodite-engine
1
0
Fork 0
Ficheiros Problemas 0 Wiki

PygmalionAI's large-scale inference engine
pygmalion.chat

It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention).

Árvore: a409431c40
Ramos Etiquetas
aphrodite-engin...
ZIP TAR.GZ
AlpinDale a409431c40 feat: draft for cuda kernels há 1 ano atrás
aphrodite a409431c40 feat: draft for cuda kernels há 1 ano atrás
assets fefbf029c9 revert previous commit há 1 ano atrás
kernels a409431c40 feat: draft for cuda kernels há 1 ano atrás
.gitignore b6804de3c7 chore: add pycache to gitignore há 1 ano atrás
LICENSE fefbf029c9 revert previous commit há 1 ano atrás
README.md fefbf029c9 revert previous commit há 1 ano atrás
requirements.txt fefbf029c9 revert previous commit há 1 ano atrás

README.md

Aphrodite - The Pygmalion Backend

Work in Progress

aphrodite

Aphrodite is the backend service for PygmalionAI, built on top of FastChat, vLLM, SkyPilot, and more.

Currently a work in progress, not remotely functional.