Commit History

Autor SHA1 Mensaxe Data
  AlpinDale d8c4193704 feat: Speculative Decoding using a draft model (#432) hai 9 meses
  AlpinDale 083ba7b452 roll back chunked prefill changes to SDPA, isolate cpu worker hai 10 meses
  AlpinDale 8c67b37131 fix docstrings hai 10 meses
  AlpinDale 50c2434267 move megatron to a top-level directory hai 10 meses
  AlpinDale 4d33ce60da feat: Triton flash attention backend for ROCm (#407) hai 10 meses
  AlpinDale 9e9057a614 separate init_distributed_environment from worker hai 10 meses
  AlpinDale a304f76d89 feat: Intel CPU support (#403) hai 10 meses