 AlpinDale
|
45a004874c
chore: allow specifying custom Executor
|
5 months ago |
|
AlpinDale
|
b7a2d52e47
fix: allow using mp executor for pipeline parallel
|
5 months ago |
 AlpinDale
|
99680b2d23
feat: soft prompts (#589)
|
5 months ago |
|
AlpinDale
|
4c3bb0b436
fix: pipeline parallel on python 3.8 and 3.9
|
5 months ago |
|
AlpinDale
|
4f7d212b70
feat: remove vision language config
|
5 months ago |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
5 months ago |
|
AlpinDale
|
405bb74612
Control plane comms refactor (#573)
|
5 months ago |
|
AlpinDale
|
25feb1d592
chore: add support for pinning lora adapters in the lru cache
|
5 months ago |
|
AlpinDale
|
de62ceb18c
refactor: eliminate parallel worker per-step task scheduling overhead
|
6 months ago |
|
AlpinDale
|
ef733aee43
implement ExecuteModelData to reduce executor complexity
|
6 months ago |
|
AlpinDale
|
957ed7d244
type hints
|
6 months ago |
|
AlpinDale
|
41338053e7
feat: add shutdown method to engine
|
7 months ago |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
7 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
|
AlpinDale
|
0f6d56b07f
feat: model executor refactor (#367)
|
10 months ago |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
10 months ago |
