 AlpinDale
|
35ae01d7ba
refactor: attention metadata term
|
6 months ago |
 AlpinDale
|
9ce319b03c
fix: sampler indexing issues in distributed environments (#546)
|
6 months ago |
|
AlpinDale
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
6 months ago |
|
AlpinDale
|
fca911ee0a
vLLM Upstream Sync (#526)
|
6 months ago |
|
AlpinDale
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
8 months ago |
 50h100a
|
0634b8a3a6
fix memory pinning conditional
|
9 months ago |
|
50h100a
|
d3dd170a7d
merge main
|
9 months ago |
 50h100a
|
dc09dc2b4d
Merge branch 'main' into pr_samplers
|
9 months ago |
|
AlpinDale
|
f8dfac6372
chore: attention refactor and upstream sync apr01 (#365)
|
9 months ago |
|
50h100a
|
7ed57e318d
Overhauled SamplingTensors construction.
|
10 months ago |
|
AlpinDale
|
9fa99215f8
feat: add cubic sampling (#280)
|
10 months ago |
|
AlpinDale
|
657aec0cbd
refactor: OpenAI endpoint (#261)
|
10 months ago |
|
AlpinDale
|
4d04ade9ef
feat: fine-grained seeds (#279)
|
11 months ago |
|
AlpinDale
|
1c46fa31ad
feat: add quadratic sampling (#233)
|
11 months ago |
|
AlpinDale
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 year ago |
|
AlpinDale
|
a39eeb7188
fix: logprobs for dynatemp (#215)
|
1 year ago |
 Stefan Gligorijevic
|
56446a04bb
feat: dynamic temperature (#209)
|
1 year ago |
|
AlpinDale
|
1394eab8ab
fix temperature being set to 1 in all cases (#210)
|
1 year ago |
|
AlpinDale
|
d54791aaa8
feat: reduce sampler overhead by making it less blocking (#198)
|
1 year ago |
 g4rg
|
2aab3da9bd
chore: fix Python 3.8+ compatibility (#170)
|
1 year ago |
|
AlpinDale
|
653da510d1
chore: rewrite InputMetadata (#143)
|
1 year ago |
