End of training
Browse files- README.md +4 -4
- adapter_model.bin +1 -1
README.md
CHANGED
@@ -105,7 +105,7 @@ xformers_attention: null
|
|
105 |
|
106 |
This model is a fine-tuned version of [tokyotech-llm/Llama-3-Swallow-8B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3-Swallow-8B-v0.1) on the None dataset.
|
107 |
It achieves the following results on the evaluation set:
|
108 |
-
- Loss: 2.
|
109 |
|
110 |
## Model description
|
111 |
|
@@ -141,9 +141,9 @@ The following hyperparameters were used during training:
|
|
141 |
| Training Loss | Epoch | Step | Validation Loss |
|
142 |
|:-------------:|:------:|:----:|:---------------:|
|
143 |
| 2.4235 | 0.0027 | 1 | 2.2008 |
|
144 |
-
| 2.
|
145 |
-
| 2.
|
146 |
-
| 2.
|
147 |
|
148 |
|
149 |
### Framework versions
|
|
|
105 |
|
106 |
This model is a fine-tuned version of [tokyotech-llm/Llama-3-Swallow-8B-v0.1](https://huggingface.co/tokyotech-llm/Llama-3-Swallow-8B-v0.1) on the None dataset.
|
107 |
It achieves the following results on the evaluation set:
|
108 |
+
- Loss: 2.1838
|
109 |
|
110 |
## Model description
|
111 |
|
|
|
141 |
| Training Loss | Epoch | Step | Validation Loss |
|
142 |
|:-------------:|:------:|:----:|:---------------:|
|
143 |
| 2.4235 | 0.0027 | 1 | 2.2008 |
|
144 |
+
| 2.6545 | 0.0081 | 3 | 2.1995 |
|
145 |
+
| 2.3491 | 0.0162 | 6 | 2.1932 |
|
146 |
+
| 2.3294 | 0.0243 | 9 | 2.1838 |
|
147 |
|
148 |
|
149 |
### Framework versions
|
adapter_model.bin
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
size 84047370
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:307e08f581ad4e466f44d672b3101edf2d76a91dbe94a4af047504ac92cb0dd2
|
3 |
size 84047370
|