 AlpinDale
|
0b5588de5c
fix: add missing logit index increment in sampling metadata prep (#1059)
|
1 settimana fa |
|
AlpinDale
|
4593a3b306
chore: remove dead code from triton sampling kernels (#1049)
|
1 settimana fa |
|
AlpinDale
|
f0cc35befe
sampler: pad dry sequence breakers tensor (#875)
|
1 mese fa |
|
AlpinDale
|
2150bb5019
sampler: add range parameter for DRY (#855)
|
1 mese fa |
|
AlpinDale
|
60f7b828d5
feat: add skew sampling (#834)
|
1 mese fa |
|
AlpinDale
|
ba9d8f631a
feat: add no_repeat_ngram sampler (#832)
|
1 mese fa |
 Selali
|
4c4a365f77
feat: Add DRY (Don't Repeat Yourself) sampling (#827)
|
1 mese fa |
 AlpinDale
|
22427602eb
feat: add top-nsigma sampling method
|
1 mese fa |
|
AlpinDale
|
2f61644f6e
SPMD optimizations (#824)
|
1 mese fa |
 50h100a
|
ed87b5dd32
remove special-case values for prompt sequences
|
3 mesi fa |
|
50h100a
|
06bb8400ce
sampling_metadata:
|
3 mesi fa |
|
AlpinDale
|
ad181e3fef
feat: bring back dynatemp (#754)
|
3 mesi fa |
|
AlpinDale
|
abd9d5799a
feat: add XTC Sampling (#740)
|
3 mesi fa |
|
AlpinDale
|
2da6a3ec2b
feat: option to apply temperature scaling last (#670)
|
4 mesi fa |
|
AlpinDale
|
7df7b8ca53
optimization: reduce end-to-end overhead from python obj allocation (#666)
|
4 mesi fa |
|
AlpinDale
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
4 mesi fa |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 mesi fa |
|
50h100a
|
0634b8a3a6
fix memory pinning conditional
|
9 mesi fa |
|
50h100a
|
d3dd170a7d
merge main
|
9 mesi fa |
 50h100a
|
dc09dc2b4d
Merge branch 'main' into pr_samplers
|
9 mesi fa |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
9 mesi fa |
|
50h100a
|
7ed57e318d
Overhauled SamplingTensors construction.
|
9 mesi fa |
|
AlpinDale
|
9fa99215f8
feat: add cubic sampling (#280)
|
10 mesi fa |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
10 mesi fa |
|
AlpinDale
|
4d04ade9ef
feat: fine-grained seeds (#279)
|
10 mesi fa |
|
AlpinDale
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
11 mesi fa |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
11 mesi fa |
|
AlpinDale
|
a39eeb7188
fix: logprobs for dynatemp (#215)
|
11 mesi fa |
 Stefan Gligorijevic
|
56446a04bb
feat: dynamic temperature (#209)
|
11 mesi fa |
|
AlpinDale
|
1394eab8ab
fix temperature being set to 1 in all cases (#210)
|
11 mesi fa |
