 AlpinDale
|
48a8693aed
feat: multi-step scheduling (#831)
|
vor 1 Monat |
 AlpinDale
|
dcb794a340
fix: revert incorrect commit
|
vor 2 Monaten |
|
AlpinDale
|
76367b5ae7
wip
|
vor 2 Monaten |
|
AlpinDale
|
9d9722b1c1
fix: metrics endpoint with RPC server (#747)
|
vor 3 Monaten |
|
AlpinDale
|
7debd35ca2
fix: shut down ray dag workers cleanly (#692)
|
vor 4 Monaten |
|
AlpinDale
|
19ad952dd4
chore: better stream termination in async engine (#672)
|
vor 4 Monaten |
|
AlpinDale
|
62111fab17
feat: allow serving encoder-decoder models in the API server (#664)
|
vor 4 Monaten |
|
AlpinDale
|
ed9a6f97c1
fix: kill api server when pinging dead engine (#660)
|
vor 4 Monaten |
|
AlpinDale
|
77c4fbd5c9
fix: better async request cancellation (#641)
|
vor 4 Monaten |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 4 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
|
AlpinDale
|
0f6d56b07f
feat: model executor refactor (#367)
|
vor 9 Monaten |
|
AlpinDale
|
b361096463
fix: tokenizer when using ray (#366)
|
vor 9 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 9 Monaten |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
vor 10 Monaten |
|
AlpinDale
|
2d3d44b3e9
chore: add health check for ray workers (#290)
|
vor 10 Monaten |
|
AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
vor 10 Monaten |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
vor 10 Monaten |
|
AlpinDale
|
6a63ab4ec3
fix: remote encode request if using ray (#270)
|
vor 10 Monaten |
|
AlpinDale
|
c0146ed00e
chore: slight refactor for async engine finish (#225)
|
vor 11 Monaten |
|
AlpinDale
|
c0aac15421
feat: S-LoRA support (#222)
|
vor 11 Monaten |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 11 Monaten |
|
AlpinDale
|
b9b295d74e
chore: backlogs 1 (#191)
|
vor 1 Jahr |
|
AlpinDale
|
980673ffb7
fix: fractional gpus (#157)
|
vor 1 Jahr |
|
AlpinDale
|
e7b6a2d5a0
chore: tensor parallel refactors part 2 (#116)
|
vor 1 Jahr |
|
AlpinDale
|
035878898f
bug: minor ray issue
|
vor 1 Jahr |
|
AlpinDale
|
74604eb252
fix: pylint complaints (#91)
|
vor 1 Jahr |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
vor 1 Jahr |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
vor 1 Jahr |
|
AlpinDale
|
c8c0b2f369
fix exception error for async
|
vor 1 Jahr |
