SJ-Donald commited on
Commit
1155cbc
1 Parent(s): 2f57e8f

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +29 -0
README.md ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: cc-by-nc-4.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - passthrough
7
+ - llama3
8
+ ---
9
+
10
+ # llama3-passthrough-chat
11
+
12
+ llama3-passthrough-chat is a merge of the following models using [mergekit](https://github.com/arcee-ai/mergekit):
13
+
14
+ * [Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
15
+
16
+ ## 🧩 Configuration
17
+
18
+ ```yaml
19
+ slices:
20
+ - sources:
21
+ - model: meta-llama/Meta-Llama-3-8B-Instruct
22
+ layer_range: [0, 24]
23
+ - sources:
24
+ - model: meta-llama/Meta-Llama-3-8B-Instruct
25
+ layer_range: [8, 32]
26
+ merge_method: passthrough
27
+ dtype: float16
28
+
29
+ ```