 AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
преди 7 месеца |
|
AlpinDale
|
405bb74612
Control plane comms refactor (#573)
|
преди 7 месеца |
 AlpinDale
|
25feb1d592
chore: add support for pinning lora adapters in the lru cache
|
преди 7 месеца |
|
AlpinDale
|
236be273e5
feat: tensor parallel speculative decoding (#554)
|
преди 7 месеца |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
преди 7 месеца |
|
AlpinDale
|
197a6d2c16
auto disable speculative decoding by the running queue size
|
преди 7 месеца |
|
AlpinDale
|
438f5bdce9
fix ngrams
|
преди 7 месеца |
|
AlpinDale
|
ef733aee43
implement ExecuteModelData to reduce executor complexity
|
преди 7 месеца |
|
AlpinDale
|
723c6acb84
re-add ngram speculative decoding
|
преди 7 месеца |
|
AlpinDale
|
7bcf4c3fc9
centralize gpu worker construction
|
преди 7 месеца |
|
AlpinDale
|
957ed7d244
type hints
|
преди 7 месеца |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
преди 8 месеца |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
преди 10 месеца |
|
AlpinDale
|
0f6d56b07f
feat: model executor refactor (#367)
|
преди 11 месеца |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
преди 11 месеца |
