 AlpinDale
|
a00ab49e21
api: add client timeouts for the ZeroMQ server (#897)
|
vor 1 Monat |
|
AlpinDale
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
vor 1 Monat |
|
AlpinDale
|
901900854e
chore: consolidate environment variables within one file (#882)
|
vor 1 Monat |
|
AlpinDale
|
ce6e3d63f7
api: better startup failure UX (#881)
|
vor 1 Monat |
|
AlpinDale
|
b5aa11020b
api: fix crashes under very high loads (#878)
|
vor 1 Monat |
|
AlpinDale
|
2fa112f86b
feat: update to serviceinfo v0.2 (#808)
|
vor 3 Monaten |
|
AlpinDale
|
72fbfa1b5b
feat: add serviceinfo endpoint (#807)
|
vor 3 Monaten |
|
AlpinDale
|
6145deab4a
frontend: enable kobold api by default (#803)
|
vor 3 Monaten |
|
AlpinDale
|
43965f7bd9
fix: kobold lite embedded UI on windows (#797)
|
vor 3 Monaten |
|
AlpinDale
|
0256ed236b
feat: windows support (#790)
|
vor 3 Monaten |
|
AlpinDale
|
a604ab69c4
fix: kobold api for horde (#763)
|
vor 4 Monaten |
|
AlpinDale
|
ad181e3fef
feat: bring back dynatemp (#754)
|
vor 4 Monaten |
|
AlpinDale
|
9d9722b1c1
fix: metrics endpoint with RPC server (#747)
|
vor 4 Monaten |
|
AlpinDale
|
2d044af0e1
chore: spawn engine process from api server process (#703)
|
vor 4 Monaten |
|
AlpinDale
|
1d3a1fec47
feat: add load/unload endpoints for soft-prompts (#694)
|
vor 4 Monaten |
|
AlpinDale
|
c34a6ac8e4
feat: add lora loading/unloading api endpoint (#693)
|
vor 4 Monaten |
|
AlpinDale
|
ed9a6f97c1
fix: kill api server when pinging dead engine (#660)
|
vor 4 Monaten |
|
AlpinDale
|
83bcb9119a
fix: multiprocessing timeout (#654)
|
vor 4 Monaten |
|
AlpinDale
|
a2344d3617
fix: move zeromq rpc frontend to IPC instead of TCP (#652)
|
vor 4 Monaten |
|
AlpinDale
|
59264d32e9
fix: hardcoded float16 in embedding mode check (#645)
|
vor 5 Monaten |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 5 Monaten |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
vor 8 Monaten |
 Krovius
|
205c8e4106
fix: kobold api /tokencount (#424)
|
vor 9 Monaten |
 IggoOnCode
|
2aec297c55
feat: add embeddings endpoint to openai rest-api server. (#363)
|
vor 10 Monaten |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 10 Monaten |
 Absurd
|
070c1cef8c
fix: explicit RFC3986 for prometheus_client asgi (#344)
|
vor 10 Monaten |
|
AlpinDale
|
398a97338a
feat: enable lora loading/unloading via API (#337)
|
vor 10 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 10 Monaten |
 drummerv
|
e59dd4a90d
fix: openai gguf chat template (#312)
|
vor 10 Monaten |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
vor 11 Monaten |
