End of training

README.md

@@ -0,0 +1,87 @@
+---
+license: apache-2.0
+base_model: google/mt5-base
+tags:
+- generated_from_trainer
+metrics:
+- bleu
+model-index:
+- name: mt5-base-translation-spa-pbb
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# mt5-base-translation-spa-pbb
+
+This model is a fine-tuned version of [google/mt5-base](https://huggingface.co/google/mt5-base) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 3.0646
+- Bleu: 0.5194
+- Gen Len: 5.3808
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 2e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 10
+- num_epochs: 30
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss | Bleu   | Gen Len |
+|:-------------:|:-----:|:----:|:---------------:|:------:|:-------:|
+| 9.0597        | 1.0   | 304  | 7.8135          | 0.0148 | 4.6469  |
+| 6.2294        | 2.0   | 608  | 4.9617          | 0.0    | 3.9209  |
+| 4.8326        | 3.0   | 912  | 4.0494          | 0.0    | 4.3808  |
+| 4.582         | 4.0   | 1216 | 3.7069          | 0.0    | 5.3979  |
+| 5.4762        | 5.0   | 1520 | 3.5463          | 0.0    | 5.6759  |
+| 4.3875        | 6.0   | 1824 | 3.4731          | 0.0    | 5.6258  |
+| 4.2873        | 7.0   | 2128 | 3.3832          | 0.0    | 5.5455  |
+| 4.1326        | 8.0   | 2432 | 3.3424          | 0.0    | 5.4756  |
+| 3.5728        | 9.0   | 2736 | 3.2956          | 0.0    | 5.1792  |
+| 3.1873        | 10.0  | 3040 | 3.2690          | 0.0    | 5.5903  |
+| 2.9436        | 11.0  | 3344 | 3.2465          | 0.1237 | 5.7655  |
+| 4.2955        | 12.0  | 3648 | 3.2054          | 0.1741 | 5.4466  |
+| 3.8722        | 13.0  | 3952 | 3.1764          | 0.1887 | 5.2161  |
+| 3.5391        | 14.0  | 4256 | 3.1688          | 0.0951 | 5.7312  |
+| 3.8012        | 15.0  | 4560 | 3.1480          | 0.1948 | 5.2964  |
+| 3.1148        | 16.0  | 4864 | 3.1401          | 0.2397 | 5.7589  |
+| 3.2699        | 17.0  | 5168 | 3.1186          | 0.33   | 5.386   |
+| 4.3355        | 18.0  | 5472 | 3.1092          | 0.4637 | 5.1383  |
+| 3.5792        | 19.0  | 5776 | 3.0966          | 0.3286 | 5.4374  |
+| 3.1429        | 20.0  | 6080 | 3.0923          | 0.418  | 5.2964  |
+| 3.4155        | 21.0  | 6384 | 3.0900          | 0.3938 | 5.4848  |
+| 3.4515        | 22.0  | 6688 | 3.0755          | 0.4062 | 5.4124  |
+| 2.8244        | 23.0  | 6992 | 3.0717          | 0.4218 | 5.3663  |
+| 2.9253        | 24.0  | 7296 | 3.0663          | 0.3633 | 5.5692  |
+| 2.1757        | 25.0  | 7600 | 3.0640          | 0.4768 | 5.4282  |
+| 2.9356        | 26.0  | 7904 | 3.0646          | 0.5194 | 5.3808  |
+
+
+### Framework versions
+
+- Transformers 4.35.2
+- Pytorch 1.13.1+cu117
+- Datasets 2.15.0
+- Tokenizers 0.15.0

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "decoder_start_token_id": 0,
+  "eos_token_id": 1,
+  "pad_token_id": 0,
+  "transformers_version": "4.35.2"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6800d490539c322ba3a3f2e961fa883840a29975d49a9da92ca38a1d5dbc7814
+oid sha256:3e5a917cbb8992033208c39b296b785efcc5a80a718f8e779b6bce7eb52ec6f0
 size 2329638768