 AlpinDale
|
3bf6197afb
fix: prompt processing delay introduced by #66 (#71)
|
1 year ago |
|
AlpinDale
|
380206038e
fix: change the timing of logit sorting (#66)
|
1 year ago |
|
AlpinDale
|
a6a4220fa6
feat: refactor megatron and quants (#57)
|
1 year ago |
 Stefan Gligorijevic
|
0feaa6eba8
Merge branch 'main' into samplers-next
|
1 year ago |
 50h100a
|
b1bbec5625
Merge branch 'main' of https://github.com/PygmalionAI/aphrodite-engine into new_samplers
|
1 year ago |
|
50h100a
|
633b99d266
Merge branch 'new_samplers' of https://github.com/50h100a/aphrodite-engine into new_samplers
|
1 year ago |
|
50h100a
|
490e14c038
function rename
|
1 year ago |
|
Stefan Gligorijevic
|
8a6c9f5cbd
fix eta,eps and typical for parallel requests
|
1 year ago |
|
Stefan Gligorijevic
|
99f76323ad
Misc fixes in eta, eps, and typical
|
1 year ago |
|
AlpinDale
|
022380e896
`entropy_deviation` -> `surprisal_deviation`
|
1 year ago |
|
Stefan Gligorijevic
|
048572e4dd
Add eta, epsilon, and locally typical sampling
|
1 year ago |
|
Stefan Gligorijevic
|
5649694aaa
fix tfs (#29)
|
1 year ago |
|
AlpinDale
|
803decce85
Merge branch 'main' into new_samplers
|
1 year ago |
|
Stefan Gligorijevic
|
a91d5cc708
feat: add tail-free sampling (#23)
|
1 year ago |
|
50h100a
|
4ec14685e8
Added top_a and repetition_penalty samplers.
|
1 year ago |
|
AlpinDale
|
69a4c32b01
fix: openai server (#19)
|
1 year ago |
 AlpinDale
|
2627a981dc
typo in sampler lol
|
1 year ago |
|
AlpinDale
|
70dbf7de03
imports in sampler
|
1 year ago |
|
AlpinDale
|
75c27d3e65
massive overhaul
|
1 year ago |
|
AlpinDale
|
6dfca14e1f
compute logprobs with log_softmax instead of log
|
1 year ago |
|
AlpinDale
|
7a85354b69
add logits back
|
1 year ago |
|
AlpinDale
|
45f6d9f923
initial refactor commit
|
1 year ago |
|
AlpinDale
|
23389d0108
zero out a variable instead of vector in kernels
|
1 year ago |
|
AlpinDale
|
aba8b0b17a
add rope theta support and bump transformers
|
1 year ago |
|
AlpinDale
|
62dfd1a883
fix top_k implementation
|
1 year ago |
|
AlpinDale
|
76b2e4a445
Merge dev branch into main (#7)
|
1 year ago |
|
AlpinDale
|
76162fe366
chore: optimize sampler for gpt-j
|
1 year ago |
|
AlpinDale
|
44faffe272
chore: remove comparison of floats with 0
|
1 year ago |
|
AlpinDale
|
48a75478cb
feat: add generation sampler
|
1 year ago |
