markoarnauto
commited on
Commit
•
a8f7ea6
1
Parent(s):
f953275
Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
@@ -18,8 +18,10 @@ python -m vllm.entrypoints.openai.api_server --model cortecs/Meta-Llama-3-70B-In
|
|
18 |
```
|
19 |
Access the model:
|
20 |
```
|
21 |
-
curl http://localhost:8000/v1/completions
|
22 |
-
|
|
|
|
|
23 |
```
|
24 |
|
25 |
## Evaluations
|
|
|
18 |
```
|
19 |
Access the model:
|
20 |
```
|
21 |
+
curl http://localhost:8000/v1/completions -H "Content-Type: application/json" -d ' {
|
22 |
+
"model": "cortecs/Meta-Llama-3-70B-Instruct-GPTQ",
|
23 |
+
"prompt": "San Francisco is a"
|
24 |
+
} '
|
25 |
```
|
26 |
|
27 |
## Evaluations
|