Update README.md
Browse files
    	
        README.md
    CHANGED
    
    | @@ -26,7 +26,9 @@ Open-Llama-2-Ko represents an advanced iteration of the Llama 2 model, featuring | |
| 26 |  | 
| 27 | 
             
            The primary distinction between the Llama-2-Ko Series and Open-Llama-2-Ko lies in the dataset. Open-Llama-2-Ko exclusively utilizes publicly accessible Korean corpora, including sources such as [AI Hub](https://www.aihub.or.kr), [Modu Corpus, 모두의 말뭉치](https://corpus.korean.go.kr/), and [Korean Wikipedia](https://dumps.wikimedia.org/kowiki/).
         | 
| 28 |  | 
| 29 | 
            -
            As training was conducted solely with publicly available corpora, this model is open for unrestricted use by everyone, adhering to the MIT License | 
|  | |
|  | |
| 30 |  | 
| 31 | 
             
            ## Model Details
         | 
| 32 |  | 
| @@ -80,6 +82,10 @@ Total token count: Approximately 15 billion tokens (*using the expanded tokenize | |
| 80 | 
             
            | Llama-2 | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
         | 
| 81 | 
             
            | Llama-2-Ko | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
         | 
| 82 |  | 
|  | |
|  | |
|  | |
|  | |
| 83 | 
             
            # **Model Benchmark**
         | 
| 84 |  | 
| 85 | 
             
            ## LM Eval Harness - Korean (polyglot branch)
         | 
|  | |
| 26 |  | 
| 27 | 
             
            The primary distinction between the Llama-2-Ko Series and Open-Llama-2-Ko lies in the dataset. Open-Llama-2-Ko exclusively utilizes publicly accessible Korean corpora, including sources such as [AI Hub](https://www.aihub.or.kr), [Modu Corpus, 모두의 말뭉치](https://corpus.korean.go.kr/), and [Korean Wikipedia](https://dumps.wikimedia.org/kowiki/).
         | 
| 28 |  | 
| 29 | 
            +
            As training was conducted solely with publicly available corpora, this model is open for unrestricted use by everyone, adhering to the MIT License*.
         | 
| 30 | 
            +
             | 
| 31 | 
            +
            *MIT License under LLAMA 2 COMMUNITY LICENSE AGREEMENT
         | 
| 32 |  | 
| 33 | 
             
            ## Model Details
         | 
| 34 |  | 
|  | |
| 82 | 
             
            | Llama-2 | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
         | 
| 83 | 
             
            | Llama-2-Ko | `['▁L', 'l', 'ama', '▁', '2', ':', '▁Open', '▁Foundation', '▁and', '▁Fine', '-', 'T', 'un', 'ed', '▁Ch', 'at', '▁Mod', 'els']` |
         | 
| 84 |  | 
| 85 | 
            +
            # LICENSE
         | 
| 86 | 
            +
             | 
| 87 | 
            +
            [MIT License under LLAMA 2 COMMUNITY LICENSE AGREEMENT](./LICENSE)
         | 
| 88 | 
            +
             | 
| 89 | 
             
            # **Model Benchmark**
         | 
| 90 |  | 
| 91 | 
             
            ## LM Eval Harness - Korean (polyglot branch)
         | 
