 AlpinDale
|
696f2cd59c
add phi3_small support with blocksparse attention
|
6 months ago |
|
AlpinDale
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
6 months ago |
|
AlpinDale
|
fb7825df8f
squash logprobs
|
8 months ago |
|
AlpinDale
|
8f9cb7235c
chore: allow multiple served model names
|
8 months ago |
 AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
9 months ago |
|
AlpinDale
|
398a97338a
feat: enable lora loading/unloading via API (#337)
|
11 months ago |
|
AlpinDale
|
e2a7b50440
fix: logprobs when inf or nan (#329)
|
11 months ago |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
11 months ago |
|
AlpinDale
|
c2d77b1822
chore: logging refactor (#302)
|
11 months ago |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
11 months ago |
