AlpinDale dcebb8487d video modality support 3 weeks ago
..
configs 653d1a08d4 feat: add support for audio models (#891) 3 weeks ago
tokenizer_group f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
tokenizers fb96041ae3 fix: demote skip_special_tokens assertion to logger error (#778) 2 months ago
__init__.py 267c73c5d3 chore: minor tokenizer tweaks 1 year ago
config.py dcebb8487d video modality support 3 weeks ago
detokenizer.py 4648f16c84 chore: fix return statement in Detokenizer class (#727) 3 months ago
image_processor.py dcebb8487d video modality support 3 weeks ago
processor.py dcebb8487d video modality support 3 weeks ago
tokenizer.py d5033e12fd feat: implement mistral tokenizer mode (#711) 3 months ago
utils.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago