AlpinDale 4d4e767838 ci: take one of fixing lint issues 5 miesięcy temu
..
cutlass_benchmarks 5dbfc200f2 update all benchmarks (#597) 5 miesięcy temu
engine 6b1fdd07bd chore: add isort and refactor formatting script and utils 5 miesięcy temu
kernels 4d4e767838 ci: take one of fixing lint issues 5 miesięcy temu
overheads 5dbfc200f2 update all benchmarks (#597) 5 miesięcy temu
README.md 5dbfc200f2 update all benchmarks (#597) 5 miesięcy temu
attention.py 156f577f79 feat: switch from `PYBIND11_MODULE` to `TORCH_LIBRARY` (#569) 6 miesięcy temu
backend_request_func.py 5dbfc200f2 update all benchmarks (#597) 5 miesięcy temu
launch_tgi.sh 4d04ade9ef feat: fine-grained seeds (#279) 11 miesięcy temu
sonnet.txt 89ee54dcff update dockerfile and enhance serving benchmark 6 miesięcy temu

README.md

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json