| .. |
|
__init__.py
|
04b53d2db5
chore: add initializer files
|
пре 1 година |
|
aphrodite_engine.py
|
a1f18f17e6
modify the cache engine and model runner/worker to support mamba states
|
пре 9 месеци |
|
args_tools.py
|
bd0ddf1cfe
feat: EETQ quantization (#408)
|
пре 9 месеци |
|
async_aphrodite.py
|
9aaeb5d349
add speculative config and arg for later
|
пре 9 месеци |
|
metrics.py
|
b1caee23a6
cache the p2p access check for memory saving
|
пре 9 месеци |
|
ray_tools.py
|
8c9cabf4c8
fix: display error in ray before deadlock (#378)
|
пре 9 месеци |
AlpinDale
a1f18f17e6
modify the cache engine and model runner/worker to support mamba states