HirCoir commited on
Commit
85161ef
1 Parent(s): a7f0d7f

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +68 -0
README.md ADDED
@@ -0,0 +1,68 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - es
4
+ - en
5
+ tags:
6
+ - gguf
7
+ - llama.cpp
8
+ - openbuddy
9
+ ---
10
+ # OpenBuddy
11
+ ![Image](OpenBuddy.jpg)
12
+
13
+ ## Requisitos
14
+
15
+ Para usar este modelo, necesitas tener instalado llama.cpp en tu equipo. Puedes obtener llama.cpp desde el siguiente repositorio:
16
+
17
+ - [Repositorio de llama.cpp](https://github.com/ggerganov/llama.cpp)
18
+
19
+ Para instalar llama.cpp, sigue estos pasos:
20
+
21
+ ```bash
22
+ git clone https://github.com/ggerganov/llama.cpp
23
+ cd llama.cpp
24
+ make
25
+ ```
26
+
27
+ ## Uso del modelo
28
+
29
+ La plantilla del modelo es la siguiente:
30
+
31
+ ```plaintext
32
+ User: {prompt} Assistant:
33
+ ```
34
+
35
+ Puedes utilizar el modelo en llama.cpp con el siguiente comando:
36
+
37
+ ```bash
38
+ ./main -m ggml-model-Q8_0.gguf -p "User: ¿Cómo te llamas?\nAssistant:" --log-disable
39
+ ```
40
+
41
+ LM Studio config-presets
42
+
43
+ Filename:phi-3.preset.json
44
+ ```json
45
+ {
46
+ "name": "Phi-3",
47
+ "inference_params": {
48
+ "input_prefix": "User:",
49
+ "input_suffix": "\nAssistant:",
50
+ "antiprompt": [
51
+ "User:",
52
+ "\nAssistant:"
53
+ ],
54
+ "pre_prompt": "You(assistant) are a helpful, respectful and honest INTP-T AI Assistant named Buddy. You are talking to a human(user).\nAlways answer as helpfully and logically as possible, while being safe. Your answers should not include any harmful, political, religious, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.\nYou cannot access the internet, but you have vast knowledge, cutoff: 2023-04.\nYou are trained by OpenBuddy team, (https://openbuddy.ai, https://github.com/OpenBuddy/OpenBuddy), not related to GPT or OpenAI.",
55
+ "pre_prompt_prefix": "",
56
+ "pre_prompt_suffix": ""
57
+ },
58
+ "load_params": {
59
+ "rope_freq_scale": 0,
60
+ "rope_freq_base": 0
61
+ }
62
+ }
63
+ ```
64
+
65
+ ## Referencias
66
+
67
+ - [Repositorio original](https://huggingface.co/microsoft/Phi-3-mini-128k-instruct)
68
+ - [Repositorio de llama.cpp](https://github.com/ggerganov/llama.cpp)