Update README.md
Browse files
README.md
CHANGED
@@ -34,7 +34,7 @@ We release two adapted model versions:
|
|
34 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
35 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
36 |
|------|--------|---------|-------------|-----------------|----------------|
|
37 |
-
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) |
|
38 |
|
39 |
|
40 |
### Model Description
|
@@ -58,9 +58,7 @@ These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
|
58 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
59 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
60 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
61 |
-
|
62 |
-
- **W&B Logs:** ?
|
63 |
-
<!-- - **Press release:** TODO -->
|
64 |
|
65 |
### Inference
|
66 |
|
|
|
34 |
These models are both trained on top of OLMo 1.7 7b 'Nitro':
|
35 |
| Size | Training Tokens | Layers | Hidden Size | Attention Heads | Context Length |
|
36 |
|------|--------|---------|-------------|-----------------|----------------|
|
37 |
+
| [OLMo 1.7 7B](https://huggingface.co/allenai/OLMo-1.7-7B-hf) | 2.7T |32 | 4096 | 32 | 4096 |
|
38 |
|
39 |
|
40 |
### Model Description
|
|
|
58 |
- Evaluation code: https://github.com/allenai/OLMo-Eval
|
59 |
- Further fine-tuning code: https://github.com/allenai/open-instruct
|
60 |
- **Paper:** [Link](https://arxiv.org/abs/2402.00838)
|
61 |
+
|
|
|
|
|
62 |
|
63 |
### Inference
|
64 |
|