| .. |
|
__init__.py
|
bd0ddf1cfe
feat: EETQ quantization (#408)
|
il y a 9 mois |
|
aqlm.py
|
41beab5dc1
add exllamav2 tensor paralell, fused MoE for GPTQ/AWQ
|
il y a 10 mois |
|
awq.py
|
41beab5dc1
add exllamav2 tensor paralell, fused MoE for GPTQ/AWQ
|
il y a 10 mois |
|
base_config.py
|
aa244761ed
formatting and typing
|
il y a 10 mois |
|
bitsandbytes.py
|
fa083286e3
Speculative Decoding Part 4: Lookahead scheduling (#402)
|
il y a 9 mois |
|
eetq.py
|
8d26cf3876
simplify model_executor logic
|
il y a 9 mois |
|
exl2.py
|
ea26c91e52
proper typing
|
il y a 10 mois |
|
gguf.py
|
ea26c91e52
proper typing
|
il y a 10 mois |
|
gptq.py
|
41beab5dc1
add exllamav2 tensor paralell, fused MoE for GPTQ/AWQ
|
il y a 10 mois |
|
hadamard.safetensors
|
c3a221eb02
feat: GGUF, QuIP#, and Marlin support (#228)
|
il y a 1 an |
|
marlin.py
|
ea26c91e52
proper typing
|
il y a 10 mois |
|
quip.py
|
ea26c91e52
proper typing
|
il y a 10 mois |
|
quip_utils.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
il y a 10 mois |
|
schema.py
|
7528e0ce3e
make detokenization optional
|
il y a 9 mois |
|
squeezellm.py
|
ea26c91e52
proper typing
|
il y a 10 mois |
AlpinDale
8d26cf3876
simplify model_executor logic