 AlpinDale
|
fe431bb840
check for next port if current is unavailable
|
6 月之前 |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
6 月之前 |
 Brian Dashore
|
5533ab845e
feat: add uvloop (#550)
|
6 月之前 |
|
AlpinDale
|
3705050cd0
fix python 3.8 syntax
|
6 月之前 |
|
AlpinDale
|
85456e32df
do not discard the task returned by asyncio.create_task
|
6 月之前 |
|
AlpinDale
|
6fc1ec6e9a
fix redirects and improve low level debugging
|
6 月之前 |
|
AlpinDale
|
46159b107a
formatting: pt1
|
7 月之前 |
 Bruno Renié
|
9c45fe9a2a
openai: fix metrics endpoint (#512)
|
7 月之前 |
|
AlpinDale
|
8f9cb7235c
chore: allow multiple served model names
|
8 月之前 |
 AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 月之前 |
 Krovius
|
205c8e4106
fix: kobold api /tokencount (#424)
|
9 月之前 |
 IggoOnCode
|
2aec297c55
feat: add embeddings endpoint to openai rest-api server. (#363)
|
10 月之前 |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
10 月之前 |
 Absurd
|
070c1cef8c
fix: explicit RFC3986 for prometheus_client asgi (#344)
|
10 月之前 |
|
AlpinDale
|
398a97338a
feat: enable lora loading/unloading via API (#337)
|
10 月之前 |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 月之前 |
 drummerv
|
e59dd4a90d
fix: openai gguf chat template (#312)
|
10 月之前 |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
10 月之前 |
 Pyroserenus
|
951077de65
chore: update klite.embd with current version (#296)
|
11 月之前 |
|
AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
11 月之前 |
|
AlpinDale
|
f35d15e632
fix: arg detection for kobold api launch (#286)
|
11 月之前 |
|
AlpinDale
|
23a7fd8cda
remove ooba endpoint, fix and add deprecation warning for kobold endpoint, fix case where kobold endpoint was always launched with openai (#284)
|
11 月之前 |
|
AlpinDale
|
9fa99215f8
feat: add cubic sampling (#280)
|
11 月之前 |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
11 月之前 |
|
AlpinDale
|
4d04ade9ef
feat: fine-grained seeds (#279)
|
11 月之前 |
 swadical
|
0527131e93
fix: grammar logits processor (#268)
|
11 月之前 |
|
AlpinDale
|
d2db4143fa
feat: add grafana for metrics (#240)
|
1 年之前 |
|
AlpinDale
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
1 年之前 |
|
AlpinDale
|
0adab894fe
feat: grammar support (#206)
|
1 年之前 |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 年之前 |
