AlpinDale 2fa112f86b feat: update to serviceinfo v0.2 (#808) vor 2 Monaten
..
rpc 0256ed236b feat: windows support (#790) vor 2 Monaten
__init__.py 07aa2a492f upstream: add option to specify tokenizer vor 1 Jahr
api_server.py 2fa112f86b feat: update to serviceinfo v0.2 (#808) vor 2 Monaten
args.py f1d0b77c92 [0.6.0] Release Candidate (#481) vor 4 Monaten
logits_processors.py 62111fab17 feat: allow serving encoder-decoder models in the API server (#664) vor 4 Monaten
protocol.py a604ab69c4 fix: kobold api for horde (#763) vor 3 Monaten
run_batch.py 81fa31bcaf feat: embeddings support for batched OAI endpoint (#676) vor 4 Monaten
samplers.json ac82b67f75 feat: naive context shift and various QoL changes (#289) vor 10 Monaten
serving_chat.py 61c7182491 feat: enable prompt logprobs in OpenAI API (#720) vor 4 Monaten
serving_completions.py 61c7182491 feat: enable prompt logprobs in OpenAI API (#720) vor 4 Monaten
serving_embedding.py ebf01d665b fix: disable embeddings API for chat models (#710) vor 4 Monaten
serving_engine.py 1d3a1fec47 feat: add load/unload endpoints for soft-prompts (#694) vor 4 Monaten
serving_tokenization.py 3648170750 fix: gracefully handle missing chat template (#642) vor 4 Monaten