| .. |
|
fused_moe
|
fa84f8102e
kernels: split marlin kernels for faster compile, fix MoE, temporarily remove HQQ (#1119)
|
vor 1 Monat |
|
mamba
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
vor 2 Monaten |
|
ops
|
172dee2573
(2/N) Triton Backend: integrate Triton activation kernels (#1126)
|
vor 1 Monat |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
vor 1 Jahr |
|
activation.py
|
172dee2573
(2/N) Triton Backend: integrate Triton activation kernels (#1126)
|
vor 1 Monat |
|
layernorm.py
|
0c17153073
(1/N) Triton Backend: integrate Triton layernorm kernels (#1125)
|
vor 1 Monat |
|
linear.py
|
b3f9ab3b72
quant: add tensor parallel support for bitsandbytes (#1052)
|
vor 2 Monaten |
|
logits_processor.py
|
0e558e9b2f
fix: loading chameleon model with TP>1 (#695)
|
vor 6 Monaten |
|
pooler.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
vor 6 Monaten |
|
rejection_sampler.py
|
a0f0160b79
spec decode: remove dead code from draft bonus tokens (#1101)
|
vor 1 Monat |
|
resampler.py
|
548e864404
models: add support for QwenVL (#995)
|
vor 2 Monaten |
|
rotary_embedding.py
|
0c17153073
(1/N) Triton Backend: integrate Triton layernorm kernels (#1125)
|
vor 1 Monat |
|
sampler.py
|
f20f5c3491
samplers: improved DRY performance (#1108)
|
vor 1 Monat |
|
spec_decode_base_sampler.py
|
a0f0160b79
spec decode: remove dead code from draft bonus tokens (#1101)
|
vor 1 Monat |
|
typical_acceptance_sampler.py
|
eb1ffacf74
Spec Decoding: fix typical acceptance sampler with correct recovered tok IDs (#1106)
|
vor 1 Monat |
|
vocab_parallel_embedding.py
|
83af2524f3
quants: add GPTQ and FBGEMM to AphroditeParameters (#987)
|
vor 2 Monaten |
AlpinDale
172dee2573
(2/N) Triton Backend: integrate Triton activation kernels (#1126)