AlpinDale 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) 2 months ago
..
configs 132aa2abe4 spec decode: add support for EAGLE (#899) 2 months ago
tokenizer_group f1d0b77c92 [0.6.0] Release Candidate (#481) 6 months ago
tokenizers fb96041ae3 fix: demote skip_special_tokens assertion to logger error (#778) 4 months ago
__init__.py 267c73c5d3 chore: minor tokenizer tweaks 1 year ago
config.py 9f3e7c86e2 feat: add fused Marlin MoE kernel (#934) 2 months ago
detokenizer.py 4648f16c84 chore: fix return statement in Detokenizer class (#727) 6 months ago
image_processor.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 months ago
tokenizer.py d5033e12fd feat: implement mistral tokenizer mode (#711) 6 months ago
utils.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 months ago