 AlpinDale
|
fdabb55a4d
fix: wrong multi_modal_input format for CPU
|
vor 7 Monaten |
|
AlpinDale
|
8d77c69cbd
feat: support image processor and add llava example
|
vor 7 Monaten |
|
AlpinDale
|
f6250c5516
move dockerfiles to root; fix cpu build
|
vor 8 Monaten |
 AlpinDale
|
a94de94c44
refactor: combine the prefill and decode into a single API (#553)
|
vor 8 Monaten |
|
AlpinDale
|
50b7c13db0
refactor: attention selector (#552)
|
vor 8 Monaten |
|
AlpinDale
|
0e062e66d3
set block size at init
|
vor 8 Monaten |
|
AlpinDale
|
35ae01d7ba
refactor: attention metadata term
|
vor 8 Monaten |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
vor 8 Monaten |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
vor 8 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 10 Monaten |
