finnvoorhees commited on
Commit
ab7dcb3
·
verified ·
1 Parent(s): 2d27ac3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +19 -23
README.md CHANGED
@@ -1,9 +1,5 @@
1
  ---
2
- {}
3
- ---
4
-
5
- ---
6
- language:
7
  - en
8
  library_name: CoreMLPipelines
9
  license: apache-2.0
@@ -15,26 +11,26 @@ tags:
15
  - chat
16
  - qwen
17
  - qwen-coder
18
- ---
19
 
20
- # coreml-Qwen2.5-Coder-1.5B-Instruct-4bit
21
 
22
- This model was converted from [Qwen/Qwen2.5-Coder-1.5B-Instruct](https://hf.co/Qwen/Qwen2.5-Coder-1.5B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
23
 
24
- ### Use with CoreMLPipelines
25
 
26
- ```swift
27
- let pipeline = try await TextGenerationPipeline(modelName: "finnvoorhees/coreml-Qwen2.5-Coder-1.5B-Instruct-4bit")
28
- let stream = pipeline(
29
- messages: [[
30
- "role": "user",
31
- "content": "Write a poem about Ireland"
32
- ]]
33
- )
34
- for try await text in stream {
35
- print(text, terminator: "")
36
- fflush(stdout)
37
- }
38
- print("")
39
- ```
40
 
 
1
  ---
2
+ language:
 
 
 
 
3
  - en
4
  library_name: CoreMLPipelines
5
  license: apache-2.0
 
11
  - chat
12
  - qwen
13
  - qwen-coder
14
+ ---
15
 
16
+ # coreml-Qwen2.5-Coder-1.5B-Instruct-4bit
17
 
18
+ This model was converted from [Qwen/Qwen2.5-Coder-1.5B-Instruct](https://hf.co/Qwen/Qwen2.5-Coder-1.5B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
19
 
20
+ ### Use with CoreMLPipelines
21
 
22
+ ```swift
23
+ let pipeline = try await TextGenerationPipeline(modelName: "finnvoorhees/coreml-Qwen2.5-Coder-1.5B-Instruct-4bit")
24
+ let stream = pipeline(
25
+ messages: [[
26
+ "role": "user",
27
+ "content": "Write a poem about Ireland"
28
+ ]]
29
+ )
30
+ for try await text in stream {
31
+ print(text, terminator: "")
32
+ fflush(stdout)
33
+ }
34
+ print("")
35
+ ```
36