 AlpinDale
|
0247bdcd27
inline model switching
|
hai 3 semanas |
|
AlpinDale
|
3391557b64
take yaml config in model load endpoint
|
hai 3 semanas |
|
AlpinDale
|
118bbfec5a
take more args in model load field
|
hai 3 semanas |
|
AlpinDale
|
8a4fc7f761
add a simple model load endpoint
|
hai 3 semanas |
|
AlpinDale
|
b94c8840b5
fix model unload endpoint
|
hai 3 semanas |
|
AlpinDale
|
b47a39026d
feat: introduce MQAphroditeEngine
|
hai 1 mes |
 AlpinDale
|
638c08d9dc
fix: clean shutdown issues (#1047)
|
hai 1 mes |
|
AlpinDale
|
313e198557
api: implement OpenAI-compatible tools API for Hermes/Mistral models (#993)
|
hai 1 mes |
|
AlpinDale
|
231693151b
benchmarks: add `--async-engine` arg to throughput benchmark (#988)
|
hai 1 mes |
|
AlpinDale
|
a3c03db735
fix: inline model loading conflicts with lora (#930)
|
hai 1 mes |
|
AlpinDale
|
59d1d59028
api: support aphrodite_config.yaml with inline loading (#929)
|
hai 1 mes |
|
AlpinDale
|
d46e70ac98
api: add inline model loading (#928)
|
hai 1 mes |
|
AlpinDale
|
53d0ba7c7c
api: add endpoint for loading and unloading the model (#926)
|
hai 1 mes |
|
AlpinDale
|
6fbab320e7
api: error suppression cleanup + timeout suppression on aborts (#905)
|
hai 1 mes |
|
AlpinDale
|
a00ab49e21
api: add client timeouts for the ZeroMQ server (#897)
|
hai 1 mes |
|
AlpinDale
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
hai 1 mes |
|
AlpinDale
|
901900854e
chore: consolidate environment variables within one file (#882)
|
hai 1 mes |
|
AlpinDale
|
ce6e3d63f7
api: better startup failure UX (#881)
|
hai 1 mes |
|
AlpinDale
|
b5aa11020b
api: fix crashes under very high loads (#878)
|
hai 1 mes |
|
AlpinDale
|
2fa112f86b
feat: update to serviceinfo v0.2 (#808)
|
hai 2 meses |
|
AlpinDale
|
72fbfa1b5b
feat: add serviceinfo endpoint (#807)
|
hai 2 meses |
|
AlpinDale
|
6145deab4a
frontend: enable kobold api by default (#803)
|
hai 2 meses |
|
AlpinDale
|
43965f7bd9
fix: kobold lite embedded UI on windows (#797)
|
hai 2 meses |
|
AlpinDale
|
0256ed236b
feat: windows support (#790)
|
hai 2 meses |
|
AlpinDale
|
a604ab69c4
fix: kobold api for horde (#763)
|
hai 4 meses |
|
AlpinDale
|
ad181e3fef
feat: bring back dynatemp (#754)
|
hai 4 meses |
|
AlpinDale
|
9d9722b1c1
fix: metrics endpoint with RPC server (#747)
|
hai 4 meses |
|
AlpinDale
|
2d044af0e1
chore: spawn engine process from api server process (#703)
|
hai 4 meses |
|
AlpinDale
|
1d3a1fec47
feat: add load/unload endpoints for soft-prompts (#694)
|
hai 4 meses |
|
AlpinDale
|
c34a6ac8e4
feat: add lora loading/unloading api endpoint (#693)
|
hai 4 meses |
