Author | SHA1 Message | Date |
---|---|---|
|
c18bf116da fix stop strings not being excluded from outputs | 10 months ago |
|
aa1db50131 simplify tokenizer.py | 10 months ago |
|
d1786645a3 fix formatting | 10 months ago |
|
eed70dff76 improve detokenization performance; improve logprobs | 10 months ago |