 AlpinDale
|
c18bf116da
fix stop strings not being excluded from outputs
|
vor 9 Monaten |
|
AlpinDale
|
b4fcaf7aa3
add sampling param for left-truncating prompt tokens
|
vor 9 Monaten |
|
AlpinDale
|
7528e0ce3e
make detokenization optional
|
vor 9 Monaten |
|
AlpinDale
|
0c4ead5e9f
min_tokens
|
vor 9 Monaten |
 AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
vor 10 Monaten |
|
AlpinDale
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
vor 10 Monaten |
|
AlpinDale
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
vor 10 Monaten |
|
AlpinDale
|
9fa99215f8
feat: add cubic sampling (#280)
|
vor 10 Monaten |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
vor 10 Monaten |
|
AlpinDale
|
4d04ade9ef
feat: fine-grained seeds (#279)
|
vor 11 Monaten |
 50h100a
|
53a9c60442
fix: logit processor declarations and application (#242)
|
vor 11 Monaten |
|
AlpinDale
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
vor 1 Jahr |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 1 Jahr |
 Stefan Gligorijevic
|
56446a04bb
feat: dynamic temperature (#209)
|
vor 1 Jahr |
|
AlpinDale
|
f013d714c0
chore: merge dev branch into main (#177)
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
a5255901c6
feat: min_p sampling (#106)
|
vor 1 Jahr |
|
AlpinDale
|
e113f3e9bf
feat: spaces between special tokens (#94)
|
vor 1 Jahr |
|
AlpinDale
|
ae7d8df224
fix lint issues (again)
|
vor 1 Jahr |
|
50h100a
|
fa0ae5a2c9
feat: new mirostatv2 implementation (#96)
|
vor 1 Jahr |
|
AlpinDale
|
74604eb252
fix: pylint complaints (#91)
|
vor 1 Jahr |
|
AlpinDale
|
efc6f7fbec
chore: reformats (#90)
|
vor 1 Jahr |
|
AlpinDale
|
e6be0118c9
feat: prompt logprobs and batched samplers (#77)
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
34c1c8c83a
feat: Enable banning tokens (#80)
|
vor 1 Jahr |
|
50h100a
|
d0eadd4dbd
Added `min_tokens` and reimplemented `ignore_eos` using a new logit processor (#70)
|
vor 1 Jahr |
|
AlpinDale
|
04a27c6aeb
fix: revert mirostat v2 (#79)
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
5acc27adeb
chore: fix parameter validation on ooba endpoint
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
5dbd262033
feat: Mirostat v2 (#69)
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
0feaa6eba8
Merge branch 'main' into samplers-next
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
99c056d88a
chore: document top_a and rep_pen
|
vor 1 Jahr |
|
Stefan Gligorijevic
|
048572e4dd
Add eta, epsilon, and locally typical sampling
|
vor 1 Jahr |
