| .. |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
il y a 1 an |
|
block.py
|
7df7b8ca53
optimization: reduce end-to-end overhead from python obj allocation (#666)
|
il y a 4 mois |
|
config.py
|
92cee435e2
rocm: add more quants, fix _scaled_mm call (#1062)
|
il y a 1 semaine |
|
connections.py
|
f1d0b77c92
[0.6.0] Release Candidate (#481)
|
il y a 4 mois |
|
envs.py
|
9a7d5514c4
feat: introduce MQAphroditeEngine (#1056)
|
il y a 1 semaine |
|
grammar.py
|
8a71788372
Add OLMoE (#772)
|
il y a 2 mois |
|
logger.py
|
22a4cd4595
core: fix spec decode metrics and envs circular import (#889)
|
il y a 3 semaines |
|
logits_processor.py
|
8a71788372
Add OLMoE (#772)
|
il y a 2 mois |
|
outputs.py
|
055c8905a3
api: add sampling/engine option to return only deltas or final output (#1035)
|
il y a 1 semaine |
|
pooling_params.py
|
2f61644f6e
SPMD optimizations (#824)
|
il y a 1 mois |
|
sampling_params.py
|
814c850d89
fix: validate `n` in the sampling params (#1075)
|
il y a 2 jours |
|
sequence.py
|
1fac86c325
core: factor out common code in SequenceData (#1083)
|
il y a 7 heures |
|
test_utils.py
|
8a71788372
Add OLMoE (#772)
|
il y a 2 mois |
|
utils.py
|
9bdf8d5bfa
mamba: enable continuous batching for mamba kernels (#1055)
|
il y a 1 semaine |
AlpinDale
1fac86c325
core: factor out common code in SequenceData (#1083)