AlpinDale 4d4e767838 ci: take one of fixing lint issues		vor 5 Monaten
..
cutlass_benchmarks	5dbfc200f2 update all benchmarks (#597)	vor 5 Monaten
engine	6b1fdd07bd chore: add isort and refactor formatting script and utils	vor 5 Monaten
kernels	4d4e767838 ci: take one of fixing lint issues	vor 5 Monaten
overheads	5dbfc200f2 update all benchmarks (#597)	vor 5 Monaten
README.md	5dbfc200f2 update all benchmarks (#597)	vor 5 Monaten
attention.py	156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569)	vor 6 Monaten
backend_request_func.py	5dbfc200f2 update all benchmarks (#597)	vor 5 Monaten
launch_tgi.sh	4d04ade9ef feat: fine-grained seeds (#279)	vor 11 Monaten
sonnet.txt	89ee54dcff update dockerfile and enhance serving benchmark	vor 6 Monaten

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json