| .. |
|
__init__.py
|
07aa2a492f
upstream: add option to specify tokenizer
|
1 年之前 |
|
api_server.py
|
2aec297c55
feat: add embeddings endpoint to openai rest-api server. (#363)
|
9 月之前 |
|
embeddings.py
|
2aec297c55
feat: add embeddings endpoint to openai rest-api server. (#363)
|
9 月之前 |
|
protocol.py
|
b4fcaf7aa3
add sampling param for left-truncating prompt tokens
|
9 月之前 |
|
samplers.json
|
ac82b67f75
feat: naive context shift and various QoL changes (#289)
|
10 月之前 |
|
serving_chat.py
|
5ab7a159d7
fix formatting for previous commit
|
9 月之前 |
|
serving_completions.py
|
531969a0b2
move merge_async_iterators to common utils
|
9 月之前 |
|
serving_engine.py
|
b1caee23a6
cache the p2p access check for memory saving
|
9 月之前 |
AlpinDale
b1caee23a6
cache the p2p access check for memory saving