| .. |
|
block
|
63b735bc2a
chore: optimize v2 block manager to match the performance of v1
|
hai 7 meses |
|
__init__.py
|
ac1d46a2ec
feat: begin work on the engine
|
hai 1 ano |
|
block_manager_v1.py
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
hai 7 meses |
|
block_manager_v2.py
|
ae04f57ec1
feat: Pipeline Parallel support (#581)
|
hai 7 meses |
|
embedding_model_block_manager.py
|
237fa59aea
feat: support CPU/GPU swapping in BlockManagerV2
|
hai 7 meses |
|
evictor_v1.py
|
5fecc6b025
when was this deprecated?
|
hai 7 meses |
|
evictor_v2.py
|
5fecc6b025
when was this deprecated?
|
hai 7 meses |
|
interfaces.py
|
237fa59aea
feat: support CPU/GPU swapping in BlockManagerV2
|
hai 7 meses |
|
policy.py
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hai 8 meses |
|
scheduler.py
|
99680b2d23
feat: soft prompts (#589)
|
hai 6 meses |
AlpinDale
99680b2d23
feat: soft prompts (#589)