 AlpinDale
|
6f00203041
refactor scheduler for chunked prefill, remove reorder policy for now
|
9 months ago |
|
AlpinDale
|
b738554558
add reorder scheduler policy
|
9 months ago |
 AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
10 months ago |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 year ago |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
1 year ago |
|
AlpinDale
|
fefbf029c9
revert previous commit
|
1 year ago |
|
AlpinDale
|
964ac344b2
Deploying to main from @ PygmalionAI/aphrodite-engine@9ae65dd2fe38acf8186d4a8d9ea3e54fc8e523e9 🚀
|
1 year ago |
|
AlpinDale
|
b02c4f6060
chore: re-arranging
|
1 year ago |
|
AlpinDale
|
ef4a42b05e
add policy manager
|
1 year ago |
