| .. |
|
alpaca_template.jinja
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
|
aphrodite_engine_example.py
|
f32d57ed04
add inference examples
|
1 year ago |
|
api_client.py
|
f32d57ed04
add inference examples
|
1 year ago |
|
chatml_template.jinja
|
2755a48d51
merge dev branch into main (#153)
|
1 year ago |
|
gradio_server.py
|
551c4280cf
chore: change default port to 2242
|
1 year ago |
|
offline_inference.py
|
f32d57ed04
add inference examples
|
1 year ago |
|
prefix_cache_example.py
|
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)
|
1 year ago |
AlpinDale
8fa608aeb7
feat: replace Ray with NCCL for control plane comms (#221)