|
--- |
|
license: apache-2.0 |
|
--- |
|
|
|
Quantization of [mzbac/llama-3-8B-Instruct-function-calling-v0.2](https://huggingface.co/mzbac/llama-3-8B-Instruct-function-calling-v0.2) info GGUF |
|
|
|
# Llama 3 function calling |
|
|
|
Tested within LM Studio. |
|
|
|
|
|
## Request |
|
```bash |
|
curl --location 'http://localhost:5000/v1/chat/completions' \ |
|
--header 'Content-Type: application/json' \ |
|
--data '{ |
|
"model": "AABAAB/llama-3-8B-Instruct-function-calling-v0.2/llama-3-8B-Instruct-function-calling-v0.2_Q8_0.gguf", |
|
"messages": [ |
|
{ |
|
"role": "system", |
|
"content": "You are a helpful assistant with access to the following functions. Use them if required - {\"name\": \"search_web\",\"description\": \"Perform a web search for a given search terms.\",\"parameter\": {\"type\": \"object\", \"properties\": {\"search_terms\": {\"type\": \"array\",\"items\": {\"type\": \"string\"},\"description\": \"The search queries for which the search is performed.\",\"required\": True,}}},}" |
|
}, |
|
{ |
|
"role": "user", |
|
"content": "What is the weather in Sydney?" |
|
} |
|
], |
|
"stream": false |
|
}' |
|
``` |
|
|
|
## Response |
|
|
|
``` |
|
<functioncall> {\"name\": \"search_web\", \"arguments\": {\"search_terms\": [\"weather in Sydney\"]}} |
|
``` |
|
|
|
 |
|
|
|
|
