Inicio Explorar Ayuda
Registro Iniciar sesión
david
/
aphrodite-engine
espejo de https://github.com/PygmalionAI/aphrodite-engine
1
0
Fork 0
Archivos Incidencias 0 Wiki
Rama: nf_quant
Ramas Etiquetas
aphrodite-engin...
/
tests
/
benchmarks
AlpinDale 73177656ed feat: quant_llm support (#755) hace 3 meses
..
cutlass_benchmarks f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
engine 73177656ed feat: quant_llm support (#755) hace 3 meses
kernels f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
overheads f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
README.md f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
attention.py f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
backend_request_func.py f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses
launch_tgi.sh 4d04ade9ef feat: fine-grained seeds (#279) hace 10 meses
sonnet.txt f1d0b77c92 [0.6.0] Release Candidate (#481) hace 4 meses

README.md

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json