AlpinDale 4434c4db84 chore: refactor llama3 rope (#748) 3 months ago
..
fused_moe 81c28d2a7f fix: use nvml to get consistent device names (#739) 3 months ago
mamba f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
ops f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
__init__.py 07aa2a492f upstream: add option to specify tokenizer 1 year ago
activation.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
layernorm.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
linear.py edec2e9a9e feat: migrate awq and awq_marlin to AphroditeParameter (#702) 4 months ago
logits_processor.py 0e558e9b2f fix: loading chameleon model with TP>1 (#695) 4 months ago
pooler.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
rejection_sampler.py e3a53712f2 fix: mlpspeculator with padded vocab (#669) 4 months ago
rotary_embedding.py 4434c4db84 chore: refactor llama3 rope (#748) 3 months ago
sampler.py 198029295c fix: empty sampler output when temperature is too low (#709) 4 months ago
spec_decode_base_sampler.py 09b82f9963 feat: Add support for GPU device selection in SpecDecodeBaseSampler (#629) 4 months ago
typical_acceptance_sampler.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago
vocab_parallel_embedding.py f1d0b77c92 [0.6.0] Release Candidate (#481) 4 months ago