Model save

README.md

@@ -2,6 +2,8 @@
 base_model: vinai/bartpho-syllable
 tags:
 - generated_from_trainer
+metrics:
+- sacrebleu
 model-index:
 - name: vietnamese-correction-v2
   results: []
@@ -13,6 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
 # vietnamese-correction-v2
 
 This model is a fine-tuned version of [vinai/bartpho-syllable](https://huggingface.co/vinai/bartpho-syllable) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.1848
+- Sacrebleu: 26.6603
 
 ## Model description
 
@@ -32,16 +37,20 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 1e-05
-- train_batch_size: 8
-- eval_batch_size: 8
+- train_batch_size: 4
+- eval_batch_size: 4
 - seed: 42
-- gradient_accumulation_steps: 4
+- gradient_accumulation_steps: 8
 - total_train_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - num_epochs: 0.5
 - mixed_precision_training: Native AMP
 
+### Training results
+
+
+
 ### Framework versions
 
 - Transformers 4.41.1

generation_config.json

@@ -1,5 +1,4 @@
 {
-  "_from_model_config": true,
   "bos_token_id": 0,
   "decoder_start_token_id": 2,
   "eos_token_id": 2,

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:0db9456ef507fd1ce32703510d3de7dbddb4b65c5a3f2798a033568145cb01e8
+oid sha256:6f5ca1ca4da42923fefb7cc5700f4db9f63676945ecdd8da81a87651247aeb9e
 size 1583480280

runs/May31_13-13-16_abdcd297bf2c/events.out.tfevents.1717161201.abdcd297bf2c.365.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e042923f23b0d16d5a1131788dcf3d8fd4684b554e50db9558e0bec37037e6da
-size 5304
+oid sha256:5da15883dddf118f5513d6cde5fd5634995587bd651031b13bc345ce12de5006
+size 5658

runs/May31_13-13-16_abdcd297bf2c/events.out.tfevents.1717171598.abdcd297bf2c.365.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:6814ff10dd81e03f4a993d1953f4b0a740a7e0d068e227afc1158b36f5c20dd9
+size 412

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:dd5829f82de3c06587bebf6e6e8c433956c2b819ea781d2d9cc0cda48cdeeb56
+oid sha256:ed397d2f7746b43cd92024e89abde82b2ebd668531436b88212374909efa89a5
 size 5240