Joseph717171
commited on
Commit
•
320c3b4
1
Parent(s):
d8b5471
Update README.md
Browse files
README.md
CHANGED
@@ -12,7 +12,7 @@ This is [Meta's LLaMA-3.1-8B](https://huggingface.co/meta-llama/Llama-3.1-8B) (b
|
|
12 |
|
13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
14 |
|
15 |
-
Credit for the idea of this merge goes to Charles Goddard (Creator of mergekit); his merge [chargoddard/Meta-Llama-3-8B-InitializedEmbeds](https://huggingface.co/chargoddard/Meta-Llama-3-8B-InitializedEmbeds) outlined the details and explained how it all
|
16 |
|
17 |
|
18 |
## Merge Details
|
|
|
12 |
|
13 |
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
|
14 |
|
15 |
+
Credit for the idea of this merge goes to Charles Goddard (Creator of mergekit); his merge [chargoddard/Meta-Llama-3-8B-InitializedEmbeds](https://huggingface.co/chargoddard/Meta-Llama-3-8B-InitializedEmbeds) outlined the details for this merge and explained how it all works, and why it is necessary to pre-initialize the base model with the instruct model's embedding's special tokens.
|
16 |
|
17 |
|
18 |
## Merge Details
|