 AlpinDale
|
f7f3fed265
feat: add async postprocessor (#925)
|
2 weeks ago |
|
AlpinDale
|
abfd4465ca
feat: add support for chunked prefill + prefix caching (#871)
|
1 month ago |
|
AlpinDale
|
3d83e64f8e
feat: add metrics for prefix cache hit rate (#829)
|
1 month ago |
|
AlpinDale
|
ef40c05cd3
fix: minor adjustments to scheduler and block manager (#667)
|
4 months ago |
|
AlpinDale
|
7df7b8ca53
optimization: reduce end-to-end overhead from python obj allocation (#666)
|
4 months ago |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
