Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,68 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- es
|
4 |
+
- en
|
5 |
+
tags:
|
6 |
+
- gguf
|
7 |
+
- llama.cpp
|
8 |
+
- openbuddy
|
9 |
+
---
|
10 |
+
# OpenBuddy
|
11 |
+
![Image](OpenBuddy.jpg)
|
12 |
+
|
13 |
+
## Requisitos
|
14 |
+
|
15 |
+
Para usar este modelo, necesitas tener instalado llama.cpp en tu equipo. Puedes obtener llama.cpp desde el siguiente repositorio:
|
16 |
+
|
17 |
+
- [Repositorio de llama.cpp](https://github.com/ggerganov/llama.cpp)
|
18 |
+
|
19 |
+
Para instalar llama.cpp, sigue estos pasos:
|
20 |
+
|
21 |
+
```bash
|
22 |
+
git clone https://github.com/ggerganov/llama.cpp
|
23 |
+
cd llama.cpp
|
24 |
+
make
|
25 |
+
```
|
26 |
+
|
27 |
+
## Uso del modelo
|
28 |
+
|
29 |
+
La plantilla del modelo es la siguiente:
|
30 |
+
|
31 |
+
```plaintext
|
32 |
+
User: {prompt} Assistant:
|
33 |
+
```
|
34 |
+
|
35 |
+
Puedes utilizar el modelo en llama.cpp con el siguiente comando:
|
36 |
+
|
37 |
+
```bash
|
38 |
+
./main -m ggml-model-Q8_0.gguf -p "User: ¿Cómo te llamas?\nAssistant:" --log-disable
|
39 |
+
```
|
40 |
+
|
41 |
+
LM Studio config-presets
|
42 |
+
|
43 |
+
Filename:phi-3.preset.json
|
44 |
+
```json
|
45 |
+
{
|
46 |
+
"name": "Phi-3",
|
47 |
+
"inference_params": {
|
48 |
+
"input_prefix": "User:",
|
49 |
+
"input_suffix": "\nAssistant:",
|
50 |
+
"antiprompt": [
|
51 |
+
"User:",
|
52 |
+
"\nAssistant:"
|
53 |
+
],
|
54 |
+
"pre_prompt": "You(assistant) are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human(user).\nAlways answer as helpfully and logically as possible, while being safe. Your answers should not include any harmful, political, religious, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\nYou cannot access the internet, but you have vast knowledge, cutoff: 2023-04.\nYou are trained by OpenBuddy team, (https://openbuddy.ai, https://github.com/OpenBuddy/OpenBuddy), not related to GPT or OpenAI.",
|
55 |
+
"pre_prompt_prefix": "",
|
56 |
+
"pre_prompt_suffix": ""
|
57 |
+
},
|
58 |
+
"load_params": {
|
59 |
+
"rope_freq_scale": 0,
|
60 |
+
"rope_freq_base": 0
|
61 |
+
}
|
62 |
+
}
|
63 |
+
```
|
64 |
+
|
65 |
+
## Referencias
|
66 |
+
|
67 |
+
- [Repositorio original](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct)
|
68 |
+
- [Repositorio de llama.cpp](https://github.com/ggerganov/llama.cpp)
|