| .. |
|
monitoring
|
9ed45fec7c
fix: incorrect prometheus url
|
vor 11 Monaten |
|
alpaca_template.jinja
|
2755a48d51
merge dev branch into main (#153)
|
vor 1 Jahr |
|
aphrodite_engine_example.py
|
f32d57ed04
add inference examples
|
vor 1 Jahr |
|
api_client.py
|
f32d57ed04
add inference examples
|
vor 1 Jahr |
|
chatml_template.jinja
|
2755a48d51
merge dev branch into main (#153)
|
vor 1 Jahr |
|
gguf_to_torch.py
|
fe7844f2ef
feat: sharding and safetensors support for gguf conversion (#256)
|
vor 11 Monaten |
|
gradio_server.py
|
551c4280cf
chore: change default port to 2242
|
vor 1 Jahr |
|
offline_inference.py
|
f32d57ed04
add inference examples
|
vor 1 Jahr |
|
prefix_cache_example.py
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
vor 11 Monaten |
|
pygchat_template.jinja
|
80e8a14949
feat: add pygchat Jinja template (#218)
|
vor 11 Monaten |
|
slora_inference.py
|
8635901c76
fix: s-lora vocab embeddings
|
vor 11 Monaten |
TearGosling
80e8a14949
feat: add pygchat Jinja template (#218)