 AlpinDale
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
hace 3 semanas |
|
AlpinDale
|
901900854e
chore: consolidate environment variables within one file (#882)
|
hace 4 semanas |
|
AlpinDale
|
db6a50fd5c
async: disable multi-step scheduling for sync engine (#880)
|
hace 4 semanas |
 AlpinDale
|
2242cb25dc
fix: unbound tokenizer error
|
hace 1 mes |
|
AlpinDale
|
3d83e64f8e
feat: add metrics for prefix cache hit rate (#829)
|
hace 1 mes |
|
AlpinDale
|
9d9722b1c1
fix: metrics endpoint with RPC server (#747)
|
hace 3 meses |
|
AlpinDale
|
89a2c6dee1
chore: refactor `MultiModalConfig` initialization and profiling (#745)
|
hace 3 meses |
|
AlpinDale
|
0b8b407b6d
feat: support profiling with multiple multi-modal inputs per prompt (#712)
|
hace 4 meses |
|
AlpinDale
|
f76f2a5af0
feat: add aphrodite plugin system (#705)
|
hace 4 meses |
|
AlpinDale
|
7debd35ca2
fix: shut down ray dag workers cleanly (#692)
|
hace 4 meses |
|
AlpinDale
|
bf88c8567e
feat: mamba model support (#674)
|
hace 4 meses |
|
AlpinDale
|
62111fab17
feat: allow serving encoder-decoder models in the API server (#664)
|
hace 4 meses |
|
AlpinDale
|
a0e446a17d
feat: initial encoder-decoder support with BART model (#633)
|
hace 4 meses |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
hace 4 meses |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hace 8 meses |
|
AlpinDale
|
feb5840f2a
feat: async tokenization (#374)
|
hace 9 meses |
|
AlpinDale
|
0f6d56b07f
feat: model executor refactor (#367)
|
hace 9 meses |
|
AlpinDale
|
b361096463
fix: tokenizer when using ray (#366)
|
hace 9 meses |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
hace 9 meses |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
hace 10 meses |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
hace 10 meses |
|
AlpinDale
|
9810daa699
feat: INT8 KV Cache (#298)
|
hace 10 meses |
|
AlpinDale
|
2d3d44b3e9
chore: add health check for ray workers (#290)
|
hace 10 meses |
|
AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
hace 10 meses |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
hace 10 meses |
|
AlpinDale
|
4b80b42362
fix: memory leaks due to nccl cuda graphs (#275)
|
hace 10 meses |
|
AlpinDale
|
2c08aa5af4
chore: remove eos token from output (#272)
|
hace 10 meses |
|
AlpinDale
|
ea0f57b233
feat: allow further support for non-cuda devices (#247)
|
hace 11 meses |
|
AlpinDale
|
d2db4143fa
feat: add grafana for metrics (#240)
|
hace 11 meses |
|
AlpinDale
|
31c95011a6
feat: FP8 E5M2 KV Cache (#226)
|
hace 11 meses |
