AlpinDale 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080)		il y a 13 heures
..
cutlass_benchmarks	f1d0b77c92 [0.6.0] Release Candidate (#481)	il y a 4 mois
engine	86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080)	il y a 13 heures
kernels	93bc863591 feat: Machete Kernels for Hopper GPUs (#842)	il y a 1 mois
overheads	f1d0b77c92 [0.6.0] Release Candidate (#481)	il y a 4 mois
README.md	f1d0b77c92 [0.6.0] Release Candidate (#481)	il y a 4 mois
attention.py	f1d0b77c92 [0.6.0] Release Candidate (#481)	il y a 4 mois
backend_request_func.py	563e8f7ac8 fix: latency and serving benchmarks (#841)	il y a 1 mois
launch_tgi.sh	4d04ade9ef feat: fine-grained seeds (#279)	il y a 10 mois
sonnet.txt	f1d0b77c92 [0.6.0] Release Candidate (#481)	il y a 4 mois

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json