david/aphrodite-engine: PygmalionAI's large-scale inference engine pygmalion.chat It is designed to serve as the inference endpoint for the PygmalionAI website, and to allow serving the Pygmalion models to a large number of users with blazing fast speeds (thanks to vLLM's Paged Attention). @ a0e446a17dcdd28029276173bf5f5256c7d80177

AlpinDale a0e446a17d feat: initial encoder-decoder support with BART model (#633)		6 月之前
..
__init__.py	04b53d2db5 chore: add initializer files	1 年之前
cache_engine.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
cpu_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
cpu_worker.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
embedding_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
enc_dec_model_runner.py	a0e446a17d feat: initial encoder-decoder support with BART model (#633)	6 月之前
model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
model_runner_base.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
neuron_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
neuron_worker.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
openvino_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
openvino_worker.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
tpu_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
tpu_worker.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
utils.py	a0e446a17d feat: initial encoder-decoder support with BART model (#633)	6 月之前
worker.py	a0e446a17d feat: initial encoder-decoder support with BART model (#633)	6 月之前
worker_base.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
xpu_model_runner.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前
xpu_worker.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	6 月之前