Update README.md
Browse files
README.md
CHANGED
|
@@ -8,7 +8,7 @@ We have released **Llamion** as **GeM 2.0**, the second series of generative mod
|
|
| 8 |
|
| 9 |
**Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Base)
|
| 10 |
into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
|
| 11 |
-
through parameter mapping and offline
|
| 12 |
Further technical specifications and study results will be detailed in our upcoming paper, available on this page.
|
| 13 |
|
| 14 |
<!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
|
|
|
|
| 8 |
|
| 9 |
**Llamion** (Llamafied Orion) is derived from transforming the [Orion model](https://huggingface.co/OrionStarAI/Orion-14B-Base)
|
| 10 |
into [the standard LLaMA architecture](https://github.com/huggingface/transformers/blob/main/src/transformers/models/llama/modeling_llama.py)
|
| 11 |
+
through parameter mapping and offline knowledge transfer.
|
| 12 |
Further technical specifications and study results will be detailed in our upcoming paper, available on this page.
|
| 13 |
|
| 14 |
<!-- Note that this model has NOT been contaminated to artificially inflate its scores for the Open LLM Leaderboards,
|