| .. |
|
fused_moe
|
36660b55c2
chore: mixtral fp8 w/ static scales (#542)
|
hace 5 meses |
|
ops
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hace 6 meses |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
hace 1 año |
|
activation.py
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hace 6 meses |
|
layernorm.py
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
hace 10 meses |
|
linear.py
|
b178ae4b4a
chore: generalize linear_method to be quant_method (#540)
|
hace 5 meses |
|
logits_processor.py
|
aed64884c6
feat: prompt logprobs with chunked prefill (#539)
|
hace 5 meses |
|
rejection.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hace 8 meses |
|
rotary_embedding.py
|
3ab36e6b2d
feat: extended RoPE for Llama 3.1 (#543)
|
hace 5 meses |
|
sampler.py
|
c2be1b9f29
formatting
|
hace 5 meses |
|
vocab_parallel_embedding.py
|
fca911ee0a
vLLM Upstream Sync (#526)
|
hace 6 meses |
AlpinDale
c2be1b9f29
formatting