teddylee777
commited on
Commit
β’
e60a87b
1
Parent(s):
30d922a
Update README.md
Browse files
README.md
CHANGED
@@ -18,6 +18,27 @@ pipeline_tag: text-generation
|
|
18 |
|
19 |
## π¬ Template
|
20 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
21 |
|
22 |
## π§βπ» Helpful Contents
|
23 |
- β
[How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
|
|
|
18 |
|
19 |
## π¬ Template
|
20 |
|
21 |
+
```
|
22 |
+
FROM Qwen2.5-7B-Instruct-kowiki-qa-context-Q8_0.gguf
|
23 |
+
|
24 |
+
TEMPLATE """{{- if .System }}
|
25 |
+
<|im_start|>system
|
26 |
+
{{ .System }}
|
27 |
+
<|im_end|>
|
28 |
+
{{- end }}
|
29 |
+
<|im_start|>user
|
30 |
+
{{ .Prompt }}
|
31 |
+
<|im_end|>
|
32 |
+
<|im_start|>assistant
|
33 |
+
"""
|
34 |
+
|
35 |
+
SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. λͺ¨λ λλ΅μ νκ΅μ΄λ‘ ν΄μ£ΌμΈμ."""
|
36 |
+
|
37 |
+
PARAMETER temperature 0
|
38 |
+
PARAMETER num_ctx 128000
|
39 |
+
PARAMETER stop <|im_start|>
|
40 |
+
PARAMETER stop <|im_end|>
|
41 |
+
```
|
42 |
|
43 |
## π§βπ» Helpful Contents
|
44 |
- β
[How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
|