Author | SHA1 Message | Date |
---|---|---|
|
22422d962b feat: add cuda sampling kernels for top_k and top_p | 2 months ago |
|
ee5964465d chore: max_num_seqs in throughput benchmark (#770) | 4 months ago |
|
73177656ed feat: quant_llm support (#755) | 4 months ago |
|
f1d0b77c92 [0.6.0] Release Candidate (#481) | 5 months ago |