AlpinDale 72659e5cad separate prompt and genned tokens for enc-dec il y a 9 mois
..
__init__.py 07aa2a492f upstream: add option to specify tokenizer il y a 1 an
block.py ac82b67f75 feat: naive context shift and various QoL changes (#289) il y a 10 mois
config.py c41462cfcd feat: exllamav2 quantization (#305) il y a 10 mois
gguf.py e42a78381a feat: switch from pylint to ruff (#322) il y a 10 mois
grammar.py 0527131e93 fix: grammar logits processor (#268) il y a 10 mois
logger.py e42a78381a feat: switch from pylint to ruff (#322) il y a 10 mois
logits_processor.py 3df36ee07d fix: logit bias logitproc (#278) il y a 10 mois
outputs.py e42a78381a feat: switch from pylint to ruff (#322) il y a 10 mois
sampling_params.py e42a78381a feat: switch from pylint to ruff (#322) il y a 10 mois
sequence.py 72659e5cad separate prompt and genned tokens for enc-dec il y a 9 mois
test_utils.py 641bb0f6e9 feat: add custom allreduce kernels (#224) il y a 11 mois
utils.py e53842bd5d fix: cuda home detection for fp8 kv cache il y a 9 mois