| .. |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
hai 1 ano |
|
block.py
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
hai 10 meses |
|
config.py
|
ac79d115b3
add guards for prefix caching, fp8, chunked, etc
|
hai 5 meses |
|
grammar.py
|
0527131e93
fix: grammar logits processor (#268)
|
hai 10 meses |
|
logger.py
|
46159b107a
formatting: pt1
|
hai 6 meses |
|
logits_processor.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 8 meses |
|
outputs.py
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 5 meses |
|
pooling_params.py
|
be8154a8a0
feat: proper embeddings API with e5-mistral-7b support
|
hai 5 meses |
|
sampling_params.py
|
e8b7f53321
allow prompt token IDs in the logits processor api
|
hai 5 meses |
|
sequence.py
|
a94de94c44
refactor: combine the prefill and decode into a single API (#553)
|
hai 5 meses |
|
test_utils.py
|
9d81716bfd
[v0.5.3] Release Candidate (#388)
|
hai 8 meses |
|
utils.py
|
656459fd84
make fp8_e4m3 work on nvidia
|
hai 5 meses |
AlpinDale
ac79d115b3
add guards for prefix caching, fp8, chunked, etc