AlpinDale 4fbb052b34 add jamba config file 8 ماه پیش
..
configs 4fbb052b34 add jamba config file 8 ماه پیش
tokenizer_group 282d7b7f9c fix multi-gpu ray tokenizer for trust_remote_code 9 ماه پیش
tokenizers da223153c6 feat&fix: cohere support and missing GPU blocks (#333) 9 ماه پیش
__init__.py 267c73c5d3 chore: minor tokenizer tweaks 1 سال پیش
config.py 4fbb052b34 add jamba config file 8 ماه پیش
detokenizer.py c18bf116da fix stop strings not being excluded from outputs 9 ماه پیش
tokenizer.py aa1db50131 simplify tokenizer.py 9 ماه پیش