AlpinDale dcb36de9c4 quants: add support for NVIDIA's ModelOpt checkpoints (#1013) 2 月之前
..
fused_moe 201db10f02 models: add support for Phi3 MoE 2 月之前
mamba f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
ops 8a71788372 Add OLMoE (#772) 5 月之前
__init__.py 07aa2a492f upstream: add option to specify tokenizer 1 年之前
activation.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
layernorm.py bfc3da41ae feat: add torch.compile for GemmaRMSNorm (#898) 2 月之前
linear.py dcb36de9c4 quants: add support for NVIDIA's ModelOpt checkpoints (#1013) 2 月之前
logits_processor.py 0e558e9b2f fix: loading chameleon model with TP>1 (#695) 6 月之前
pooler.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
rejection_sampler.py e3a53712f2 fix: mlpspeculator with padded vocab (#669) 6 月之前
resampler.py 548e864404 models: add support for QwenVL (#995) 2 月之前
rotary_embedding.py 201db10f02 models: add support for Phi3 MoE 2 月之前
sampler.py 0dfa6b60ec core: support logprobs with multi-step scheduling (#963) 2 月之前
spec_decode_base_sampler.py 09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629) 6 月之前
typical_acceptance_sampler.py f1d0b77c92 [0.6.0] Release Candidate (#481) 6 月之前
vocab_parallel_embedding.py 83af2524f3 quants: add GPTQ and FBGEMM to AphroditeParameters (#987) 2 月之前