markoarnauto commited on
Commit
a8f7ea6
1 Parent(s): f953275

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +4 -2
README.md CHANGED
@@ -18,8 +18,10 @@ python -m vllm.entrypoints.openai.api_server --model cortecs/Meta-Llama-3-70B-In
18
  ```
19
  Access the model:
20
  ```
21
- curl http://localhost:8000/v1/completions -H "Content-Type: application/json" -d "{"model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ", "prompt": "<|begin_of_text|><|start_header_id|>user<|end_header_id|>
22
- Tell me a joke<|eot_id|><|start_header_id|>assistant<|end_header_id|>"}"
 
 
23
  ```
24
 
25
  ## Evaluations
 
18
  ```
19
  Access the model:
20
  ```
21
+ curl http://localhost:8000/v1/completions -H "Content-Type: application/json" -d ' {
22
+ "model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ",
23
+ "prompt": "San Francisco is a"
24
+ } '
25
  ```
26
 
27
  ## Evaluations