Página inicial Explorar Ajuda
Registrar Entrar
david
/
aphrodite-engine
mirror de https://github.com/PygmalionAI/aphrodite-engine
1
0
Fork 0
Arquivos Issues 0 Wiki
Branch: sampling-kernels
Branches Tags
aphrodite-engin...
/
tests
/
benchmarks
AlpinDale 709628a74d fix 4 meses atrás
..
cutlass_benchmarks 5dbfc200f2 update all benchmarks (#597) 4 meses atrás
engine 709628a74d fix 4 meses atrás
kernels 5dbfc200f2 update all benchmarks (#597) 4 meses atrás
overheads 5dbfc200f2 update all benchmarks (#597) 4 meses atrás
README.md 5dbfc200f2 update all benchmarks (#597) 4 meses atrás
attention.py 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 5 meses atrás
backend_request_func.py 5dbfc200f2 update all benchmarks (#597) 4 meses atrás
launch_tgi.sh 4d04ade9ef feat: fine-grained seeds (#279) 10 meses atrás
sonnet.txt 89ee54dcff update dockerfile and enhance serving benchmark 5 meses atrás

README.md

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json