AlpinDale 73177656ed feat: quant_llm support (#755)		преди 3 месеца
..
cutlass_benchmarks	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
engine	73177656ed feat: quant_llm support (#755)	преди 3 месеца
kernels	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
overheads	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
README.md	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
attention.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
backend_request_func.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца
launch_tgi.sh	4d04ade9ef feat: fine-grained seeds (#279)	преди 10 месеца
sonnet.txt	f1d0b77c92 [0.6.0] Release Candidate (#481)	преди 4 месеца

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json