AlpinDale c18bf116da fix stop strings not being excluded from outputs il y a 9 mois
..
configs aa23ca6ba9 add dbrx support il y a 10 mois
tokenizer_group 282d7b7f9c fix multi-gpu ray tokenizer for trust_remote_code il y a 9 mois
tokenizers da223153c6 feat&fix: cohere support and missing GPU blocks (#333) il y a 10 mois
__init__.py 267c73c5d3 chore: minor tokenizer tweaks il y a 1 an
config.py aa23ca6ba9 add dbrx support il y a 10 mois
detokenizer.py c18bf116da fix stop strings not being excluded from outputs il y a 9 mois
tokenizer.py aa1db50131 simplify tokenizer.py il y a 9 mois