Commit History

Autor SHA1 Mensaxe Data
  AlpinDale 48a8693aed feat: multi-step scheduling (#831) hai 1 mes
  AlpinDale dcb794a340 fix: revert incorrect commit hai 2 meses
  AlpinDale 76367b5ae7 wip hai 2 meses
  AlpinDale 9d9722b1c1 fix: metrics endpoint with RPC server (#747) hai 3 meses
  AlpinDale 7debd35ca2 fix: shut down ray dag workers cleanly (#692) hai 4 meses
  AlpinDale 19ad952dd4 chore: better stream termination in async engine (#672) hai 4 meses
  AlpinDale 62111fab17 feat: allow serving encoder-decoder models in the API server (#664) hai 4 meses
  AlpinDale ed9a6f97c1 fix: kill api server when pinging dead engine (#660) hai 4 meses
  AlpinDale 77c4fbd5c9 fix: better async request cancellation (#641) hai 4 meses
  AlpinDale f1d0b77c92 [0.6.0] Release Candidate (#481) hai 4 meses
  AlpinDale 9d81716bfd [v0.5.3] Release Candidate (#388) hai 8 meses
  AlpinDale 0f6d56b07f feat: model executor refactor (#367) hai 9 meses
  AlpinDale b361096463 fix: tokenizer when using ray (#366) hai 9 meses
  AlpinDale f8dfac6372 chore: attention refactor and upstream sync apr01 (#365) hai 9 meses
  AlpinDale c2d77b1822 chore: logging refactor (#302) hai 10 meses
  AlpinDale 2d3d44b3e9 chore: add health check for ray workers (#290) hai 10 meses
  AlpinDale ac82b67f75 feat: naive context shift and various QoL changes (#289) hai 10 meses
  AlpinDale 657aec0cbd refactor: OpenAI endpoint (#261) hai 10 meses
  AlpinDale 6a63ab4ec3 fix: remote encode request if using ray (#270) hai 10 meses
  AlpinDale c0146ed00e chore: slight refactor for async engine finish (#225) hai 11 meses
  AlpinDale c0aac15421 feat: S-LoRA support (#222) hai 11 meses
  AlpinDale 8fa608aeb7 feat: replace Ray with NCCL for control plane comms (#221) hai 11 meses
  AlpinDale b9b295d74e chore: backlogs 1 (#191) hai 1 ano
  AlpinDale 980673ffb7 fix: fractional gpus (#157) hai 1 ano
  AlpinDale e7b6a2d5a0 chore: tensor parallel refactors part 2 (#116) hai 1 ano
  AlpinDale 035878898f bug: minor ray issue hai 1 ano
  AlpinDale 74604eb252 fix: pylint complaints (#91) hai 1 ano
  AlpinDale efc6f7fbec chore: reformats (#90) hai 1 ano
  AlpinDale 75c27d3e65 massive overhaul hai 1 ano
  AlpinDale c8c0b2f369 fix exception error for async hai 1 ano