pipilok commited on
Commit
67e3118
1 Parent(s): 7ec6ec8

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ license_link: https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct/blob/main/LICENSE
4
+ language:
5
+ - en
6
+ pipeline_tag: text-generation
7
+ base_model:
8
+ - Qwen/Qwen2.5-Coder-7B
9
+ tags:
10
+ - chat
11
+ library_name: transformers
12
+ quantized_by: pipilok
13
+ ---
14
+
15
+ Original model: https://huggingface.co/Qwen/Qwen2.5-Coder-7B-Instruct
16
+
17
+ Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon
18
+
19
+ Avg answer Speed: 17 tok/s
20
+
21
+ ## LM Studio Settings:
22
+ ```
23
+ Before System: <|im_start|>system\n
24
+ After System: <|im_end|>\n
25
+ Before User: <|im_start|>user\n
26
+ After User: <|im_end|>\n
27
+ Before Assistant: <|im_start|>assistant\n
28
+ After Assistant: <|im_end|>\n
29
+ ```