Autor | SHA1 Mensaxe | Data |
---|---|---|
|
2c653a2268 fix: make speculative decoding work with per-request seed | hai 5 meses |
|
7253e9052d feat: integrate typical acceptance sampling for spec decoding | hai 6 meses |
|
313e6e1ec7 feat: add typical acceptance sampling | hai 6 meses |