AlpinDale 72659e5cad separate prompt and genned tokens for enc-dec 9 月之前
..
__init__.py 07aa2a492f upstream: add option to specify tokenizer 1 年之前
block.py ac82b67f75 feat: naive context shift and various QoL changes (#289) 10 月之前
config.py c41462cfcd feat: exllamav2 quantization (#305) 10 月之前
gguf.py e42a78381a feat: switch from pylint to ruff (#322) 10 月之前
grammar.py 0527131e93 fix: grammar logits processor (#268) 10 月之前
logger.py e42a78381a feat: switch from pylint to ruff (#322) 10 月之前
logits_processor.py 3df36ee07d fix: logit bias logitproc (#278) 10 月之前
outputs.py e42a78381a feat: switch from pylint to ruff (#322) 10 月之前
sampling_params.py e42a78381a feat: switch from pylint to ruff (#322) 10 月之前
sequence.py 72659e5cad separate prompt and genned tokens for enc-dec 9 月之前
test_utils.py 641bb0f6e9 feat: add custom allreduce kernels (#224) 11 月之前
utils.py e53842bd5d fix: cuda home detection for fp8 kv cache 9 月之前