AlpinDale 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) пре 13 часа
..
cutlass_benchmarks f1d0b77c92 [0.6.0] Release Candidate (#481) пре 4 месеци
engine 86bf2cc4f3 core: rename `PromptInputs,inputs` -> `PromptType,prompt` (#1080) пре 13 часа
kernels 93bc863591 feat: Machete Kernels for Hopper GPUs (#842) пре 1 месец
overheads f1d0b77c92 [0.6.0] Release Candidate (#481) пре 4 месеци
README.md f1d0b77c92 [0.6.0] Release Candidate (#481) пре 4 месеци
attention.py f1d0b77c92 [0.6.0] Release Candidate (#481) пре 4 месеци
backend_request_func.py 563e8f7ac8 fix: latency and serving benchmarks (#841) пре 1 месец
launch_tgi.sh 4d04ade9ef feat: fine-grained seeds (#279) пре 10 месеци
sonnet.txt f1d0b77c92 [0.6.0] Release Candidate (#481) пре 4 месеци

README.md

Benchmarking Aphrodite

Downloading the ShareGPT dataset

You can download the dataset by running:

wget https://huggingface.co/datasets/anon8231489123/ShareGPT_Vicuna_unfiltered/resolve/main/ShareGPT_V3_unfiltered_cleaned_split.json