Commit History

Autor SHA1 Mensaxe Data
  AlpinDale d638dc592d fix: some minor typing issues in spec decode hai 5 meses
  AlpinDale 16dff9babc chore: enable bonus token in spec decoding for KV cache based models hai 5 meses
  AlpinDale abbb730607 feat: support draft model on different tensor parallel size hai 6 meses
  AlpinDale ec5b99d075 fix: use named args hai 6 meses
  AlpinDale e0886ee929 feat: add `ProposerWorkerBase` abstract class hai 6 meses