 AlpinDale
|
5240c0da23
fix: avoid unnecessary ray import warnings
|
hai 6 meses |
 AlpinDale
|
5be90c3859
Mamba infrastrucuture support (#586)
|
hai 6 meses |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
hai 7 meses |
|
AlpinDale
|
0886c361f4
feat: OpenVINO CPU backend (#576)
|
hai 7 meses |
|
AlpinDale
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
hai 7 meses |
|
AlpinDale
|
4ed1bb9958
chore: add fault tolerance for RayTokenizerGroupPool
|
hai 7 meses |
|
AlpinDale
|
3c7444c89b
fix: asyncio.run hangs in python < 3.12
|
hai 7 meses |
|
AlpinDale
|
6a57861fca
feat: initial XPU support via intel_extension_for_pytorch (#571)
|
hai 7 meses |
|
AlpinDale
|
c482c09a3a
fix: remove duplicated input processing in async engine
|
hai 7 meses |
|
AlpinDale
|
fe21123a1c
feat: TPU support (#570)
|
hai 7 meses |
|
AlpinDale
|
d7ebffe2f0
chore: re-add the graceful engine shutdown
|
hai 7 meses |
|
AlpinDale
|
90ceab32ff
refactor: consolidate prompt args to LLM engines
|
hai 7 meses |
|
AlpinDale
|
de62ceb18c
refactor: eliminate parallel worker per-step task scheduling overhead
|
hai 7 meses |
|
AlpinDale
|
c6a501f682
add multiprocessing executor; make ray optional
|
hai 7 meses |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
hai 7 meses |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 7 meses |
|
AlpinDale
|
3705050cd0
fix python 3.8 syntax
|
hai 7 meses |
|
AlpinDale
|
ef733aee43
implement ExecuteModelData to reduce executor complexity
|
hai 7 meses |
|
AlpinDale
|
29c1b58255
minor logging fixes
|
hai 7 meses |
|
AlpinDale
|
c5fc4a4996
failsafe for later
|
hai 7 meses |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hai 7 meses |
|
AlpinDale
|
199e776722
chore: move ray utils to executor dir
|
hai 8 meses |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hai 8 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 10 meses |
|
AlpinDale
|
0f6d56b07f
feat: model executor refactor (#367)
|
hai 11 meses |
|
AlpinDale
|
b361096463
fix: tokenizer when using ray (#366)
|
hai 11 meses |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
hai 11 meses |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
hai 1 ano |
|
AlpinDale
|
2d3d44b3e9
chore: add health check for ray workers (#290)
|
hai 1 ano |
|
AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
hai 1 ano |
