Home Explore Help
Register Sign In
david
/
aphrodite-engine
mirror of https://github.com/PygmalionAI/aphrodite-engine
1
0
Fork 0
Files Issues 0 Wiki
Branch: main
Branches Tags
aphrodite-engin...
/
examples
/
openai_api
/
batched_example.jsonl

batched_example.jsonl 558 B
Permalink History Raw

12 
  1. {"custom_id": "request-1", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "NousResearch/Meta-Llama-3.1-8B-Instruct", "messages": [{"role": "system", "content": "You are a helpful assistant."},{"role": "user", "content": "Hello world!"}],"max_tokens": 1000}}
    2. 

  2. {"custom_id": "request-2", "method": "POST", "url": "/v1/chat/completions", "body": {"model": "NousResearch/Meta-Llama-3.1-8B-Instruct", "messages": [{"role": "system", "content": "You are an unhelpful assistant."},{"role": "user", "content": "Hello world!"}],"max_tokens": 1000}}
    3.