 AlpinDale
|
99680b2d23
feat: soft prompts (#589)
|
vor 5 Monaten |
 AlpinDale
|
4f7d212b70
feat: remove vision language config
|
vor 5 Monaten |
|
AlpinDale
|
4599c98f99
feat: dynamic image size support for VLMs
|
vor 5 Monaten |
|
AlpinDale
|
5be90c3859
Mamba infrastrucuture support (#586)
|
vor 5 Monaten |
|
AlpinDale
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
vor 5 Monaten |
|
AlpinDale
|
cdff8e89f9
feat: introduce `DraftModelRunner`
|
vor 5 Monaten |
|
AlpinDale
|
c0c336aaa3
refactor: registry for processing model inputs; quick_gelu; clip model support
|
vor 5 Monaten |
|
AlpinDale
|
426a13ab73
fix: pass multi_modal_kwargs to CPU model runner
|
vor 5 Monaten |
|
AlpinDale
|
405bb74612
Control plane comms refactor (#573)
|
vor 5 Monaten |
|
AlpinDale
|
fdabb55a4d
fix: wrong multi_modal_input format for CPU
|
vor 5 Monaten |
|
AlpinDale
|
8d77c69cbd
feat: support image processor and add llava example
|
vor 5 Monaten |
|
AlpinDale
|
f6250c5516
move dockerfiles to root; fix cpu build
|
vor 6 Monaten |
|
AlpinDale
|
a94de94c44
refactor: combine the prefill and decode into a single API (#553)
|
vor 6 Monaten |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
vor 6 Monaten |
|
AlpinDale
|
0e062e66d3
set block size at init
|
vor 6 Monaten |
|
AlpinDale
|
35ae01d7ba
refactor: attention metadata term
|
vor 6 Monaten |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
vor 6 Monaten |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 6 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
