| .. |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
1 rok pred |
|
block.py
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
10 mesiacov pred |
|
config.py
|
c41462cfcd
feat: exllamav2 quantization (#305)
|
10 mesiacov pred |
|
gguf.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesiacov pred |
|
grammar.py
|
0527131e93
fix: grammar logits processor (#268)
|
10 mesiacov pred |
|
logger.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesiacov pred |
|
logits_processor.py
|
3df36ee07d
fix: logit bias logitproc (#278)
|
10 mesiacov pred |
|
outputs.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesiacov pred |
|
sampling_params.py
|
e42a78381a
feat: switch from pylint to ruff (#322)
|
10 mesiacov pred |
|
sequence.py
|
72659e5cad
separate prompt and genned tokens for enc-dec
|
9 mesiacov pred |
|
test_utils.py
|
641bb0f6e9
feat: add custom allreduce kernels (#224)
|
11 mesiacov pred |
|
utils.py
|
e53842bd5d
fix: cuda home detection for fp8 kv cache
|
9 mesiacov pred |
AlpinDale
72659e5cad
separate prompt and genned tokens for enc-dec