 AlpinDale
|
237d2ec28d
fix: CPU OOM for large models (#128)
|
1 year ago |
|
AlpinDale
|
f49cb1ffe1
fix: duplication in engine step (#120)
|
1 year ago |
|
AlpinDale
|
8834ecf9de
chore: clean up refactor endpoints (#98)
|
1 year ago |
|
AlpinDale
|
e113f3e9bf
feat: spaces between special tokens (#94)
|
1 year ago |
 50h100a
|
fa0ae5a2c9
feat: new mirostatv2 implementation (#96)
|
1 year ago |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
1 year ago |
|
AlpinDale
|
e6be0118c9
feat: prompt logprobs and batched samplers (#77)
|
1 year ago |
|
AlpinDale
|
69a4c32b01
fix: openai server (#19)
|
1 year ago |
|
AlpinDale
|
cbeeabeb9a
feat: mistral support (#20)
|
1 year ago |
 AlpinDale
|
75c27d3e65
massive overhaul
|
1 year ago |
|
AlpinDale
|
d9c1d4f6e5
add awq support
|
1 year ago |
|
AlpinDale
|
39beed0b87
Revert "Refactor AWQ support."
|
1 year ago |
|
AlpinDale
|
d09e27f5d4
Refactor AWQ support.
|
1 year ago |
|
AlpinDale
|
6b9561ef07
adapt TGI incremental detokenization
|
1 year ago |
|
AlpinDale
|
d71a84b780
fix: ModuleNotFoundError for remote code models
|
1 year ago |
|
AlpinDale
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
AlpinDale
|
91abae0631
fix: typo
|
1 year ago |
|
AlpinDale
|
17b15d74c7
fix: scheduler
|
1 year ago |
|
AlpinDale
|
acbf49ef89
feat: refactor scheduler
|
1 year ago |
|
AlpinDale
|
76b2e4a445
Merge dev branch into main (#7)
|
1 year ago |
|
AlpinDale
|
14e73807e6
fix: typo
|
1 year ago |
|
AlpinDale
|
6620b0e2b8
chore: add args to main engine and minor refactors
|
1 year ago |
|
AlpinDale
|
862e48176e
fix: handle special tokens
|
1 year ago |
|
AlpinDale
|
56077f0f29
upstream: trust remote code
|
1 year ago |
|
AlpinDale
|
a69f1ecf51
chore: qol improvements
|
1 year ago |
|
AlpinDale
|
22f7bd8573
chore: refactoring
|
1 year ago |
