finnvoorhees commited on
Commit
e8beadc
·
verified ·
1 Parent(s): b59a82f

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ library_name: coreml
5
+ license: apache-2.0
6
+ pipeline_tag: text-generation
7
+ tags:
8
+ - safetensors
9
+ - onnx
10
+ - transformers.js
11
+ - CoreMLPipelines
12
+ ---
13
+
14
+ # coreml-SmolLM2-1.7B-Instruct-4bit
15
+
16
+ This model was converted from [HuggingFaceTB/SmolLM2-1.7B-Instruct](https://hf.co/HuggingFaceTB/SmolLM2-1.7B-Instruct) to CoreML using [coremlpipelinestools](https://github.com/finnvoor/CoreMLPipelines/tree/main/coremlpipelinestools).
17
+
18
+ ### Use with [CoreMLPipelines](https://github.com/finnvoor/CoreMLPipelines)
19
+
20
+ ```swift
21
+ import CoreMLPipelines
22
+
23
+ let pipeline = try await TextGenerationPipeline(
24
+ modelName: "finnvoorhees/coreml-SmolLM2-1.7B-Instruct-4bit"
25
+ )
26
+ let stream = pipeline(
27
+ messages: [[
28
+ "role": "user",
29
+ "content": "Write a poem about Ireland"
30
+ ]]
31
+ )
32
+ for try await text in stream {
33
+ print(text, terminator: "")
34
+ fflush(stdout)
35
+ }
36
+ print("")
37
+ ```
38
+