 AlpinDale
|
6ac658b0d6
some small performance improvements
|
hai 5 meses |
|
AlpinDale
|
63b735bc2a
chore: optimize v2 block manager to match the performance of v1
|
hai 6 meses |
|
AlpinDale
|
237fa59aea
feat: support CPU/GPU swapping in BlockManagerV2
|
hai 6 meses |
|
AlpinDale
|
f40b809d3b
allow using v2 block manager with sliding window
|
hai 6 meses |
|
AlpinDale
|
25c2b6feca
ignore infeasible swap requests
|
hai 6 meses |
|
AlpinDale
|
46159b107a
formatting: pt1
|
hai 7 meses |
 AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hai 7 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 9 meses |
