teddylee777 commited on
Commit
e60a87b
β€’
1 Parent(s): 30d922a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -18,6 +18,27 @@ pipeline_tag: text-generation
18
 
19
  ## πŸ’¬ Template
20
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ## πŸ§‘β€πŸ’» Helpful Contents
23
  - βœ… [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)
 
18
 
19
  ## πŸ’¬ Template
20
 
21
+ ```
22
+ FROM Qwen2.5-7B-Instruct-kowiki-qa-context-Q8_0.gguf
23
+
24
+ TEMPLATE """{{- if .System }}
25
+ <|im_start|>system
26
+ {{ .System }}
27
+ <|im_end|>
28
+ {{- end }}
29
+ <|im_start|>user
30
+ {{ .Prompt }}
31
+ <|im_end|>
32
+ <|im_start|>assistant
33
+ """
34
+
35
+ SYSTEM """You are Qwen, created by Alibaba Cloud. You are a helpful assistant. λͺ¨λ“  λŒ€λ‹΅μ€ ν•œκ΅­μ–΄λ‘œ ν•΄μ£Όμ„Έμš”."""
36
+
37
+ PARAMETER temperature 0
38
+ PARAMETER num_ctx 128000
39
+ PARAMETER stop <|im_start|>
40
+ PARAMETER stop <|im_end|>
41
+ ```
42
 
43
  ## πŸ§‘β€πŸ’» Helpful Contents
44
  - βœ… [How to load HuggingFace GGUF into LM Studio](https://youtu.be/bANQk--Maxs)