| .. |
|
quantization
|
f8652c8e99
fix: optimize aqlm dequantization (#325)
|
10 mesi fa |
|
triton_kernel
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesi fa |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
1 anno fa |
|
activation.py
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
10 mesi fa |
|
attention.py
|
58e89e29d9
add custom bias to attention.py
|
9 mesi fa |
|
enc_dec_attention.py
|
3ed4cc431c
enc_dec attention code
|
9 mesi fa |
|
layernorm.py
|
e31c6f0b45
feat: refactor modeling logic and support more models (#274)
|
10 mesi fa |
|
linear.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesi fa |
|
rejection.py
|
95bdd35ec9
feat: rejection sampler (#197)
|
1 anno fa |
|
rotary_embedding.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesi fa |
|
sampler.py
|
da223153c6
feat&fix: cohere support and missing GPU blocks (#333)
|
9 mesi fa |
|
vocab_parallel_embedding.py
|
968bde81bf
fix: tensor parallel with GPTQ and AWQ quants (#307)
|
10 mesi fa |
AlpinDale
3ed4cc431c
enc_dec attention code