AlpinDale 5b5e6dc359 chore: add batch size 1536 and 3072 to moe benchmark 7 meses atrás
..
attention.py e1f3fd1e02 fix: test units (#201) 1 ano atrás
backend_request_func.py 89ee54dcff update dockerfile and enhance serving benchmark 7 meses atrás
benchmark_moe.py 5b5e6dc359 chore: add batch size 1536 and 3072 to moe benchmark 7 meses atrás
hashing.py c6a501f682 add multiprocessing executor; make ray optional 7 meses atrás
latency.py e1f3fd1e02 fix: test units (#201) 1 ano atrás
launch_tgi.sh 4d04ade9ef feat: fine-grained seeds (#279) 1 ano atrás
serving.py 89ee54dcff update dockerfile and enhance serving benchmark 7 meses atrás
sonnet.txt 89ee54dcff update dockerfile and enhance serving benchmark 7 meses atrás
throughput.py 033797fd55 refactor throughput benchmark script 7 meses atrás