End of training

README.md

@@ -22,19 +22,18 @@ model-index:
     metrics:
     - name: Wer
       type: wer
-      value: 0.39171506989212995
+      value: 0.23381058715355313
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 should probably proofread and complete it, then remove this comment. -->
 
-[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/khackho01125-CMC-University/Wav2Vec2/runs/dhvwjkwm)
 # wav2vec2-vivos-asr
 
 This model is a fine-tuned version of [facebook/wav2vec2-base](https://huggingface.co/facebook/wav2vec2-base) on the vivos dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.7105
-- Wer: 0.3917
+- Loss: 0.3492
+- Wer: 0.2338
 
 ## Model description
 
@@ -57,33 +56,32 @@ The following hyperparameters were used during training:
 - train_batch_size: 32
 - eval_batch_size: 8
 - seed: 42
-- gradient_accumulation_steps: 2
-- total_train_batch_size: 64
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 128
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
-- lr_scheduler_type: cosine
-- lr_scheduler_warmup_steps: 400
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 500
 - num_epochs: 20
 - mixed_precision_training: Native AMP
 
 ### Training results
 
-| Training Loss | Epoch | Step | Validation Loss | Wer    |
-|:-------------:|:-----:|:----:|:---------------:|:------:|
-| 5.7574        | 2.0   | 292  | 3.6165          | 1.0    |
-| 3.4366        | 4.0   | 584  | 3.5022          | 1.0    |
-| 2.7297        | 6.0   | 876  | 1.4138          | 0.7707 |
-| 1.0147        | 8.0   | 1168 | 0.8998          | 0.5443 |
-| 0.6909        | 10.0  | 1460 | 0.7924          | 0.4759 |
-| 0.5341        | 12.0  | 1752 | 0.7368          | 0.4337 |
-| 0.4472        | 14.0  | 2044 | 0.7149          | 0.4063 |
-| 0.4269        | 16.0  | 2336 | 0.7197          | 0.4002 |
-| 0.3627        | 18.0  | 2628 | 0.7151          | 0.3961 |
-| 0.3487        | 20.0  | 2920 | 0.7105          | 0.3917 |
+| Training Loss | Epoch   | Step | Validation Loss | Wer    |
+|:-------------:|:-------:|:----:|:---------------:|:------:|
+| 8.4226        | 2.0548  | 150  | 4.9423          | 1.0    |
+| 3.59          | 4.1096  | 300  | 3.6898          | 1.0    |
+| 3.4271        | 6.1644  | 450  | 3.5183          | 1.0    |
+| 2.6948        | 8.2192  | 600  | 1.2770          | 0.8026 |
+| 0.7372        | 10.2740 | 750  | 0.5197          | 0.3625 |
+| 0.4012        | 12.3288 | 900  | 0.4108          | 0.2911 |
+| 0.2974        | 14.3836 | 1050 | 0.3732          | 0.2604 |
+| 0.2737        | 16.4384 | 1200 | 0.3550          | 0.2393 |
+| 0.2108        | 18.4932 | 1350 | 0.3565          | 0.2434 |
 
 
 ### Framework versions
 
-- Transformers 4.42.3
-- Pytorch 2.1.2
-- Datasets 2.20.0
+- Transformers 4.44.0
+- Pytorch 2.4.0
+- Datasets 2.21.0
 - Tokenizers 0.19.1

config.json

@@ -111,7 +111,7 @@
     1
   ],
   "torch_dtype": "float32",
-  "transformers_version": "4.42.3",
+  "transformers_version": "4.44.0",
   "use_weighted_layer_sum": false,
   "vocab_size": 94,
   "xvector_output_dim": 512

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:6ee8818cd5ca8e876c2d6311f02803112356e8810083459f7f64dd30dbc31498
+oid sha256:70de72d4b83035f18523eada5d5d721982e838cce3273cbc6ab197fa6aa2167e
 size 377798672

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:665cecd20fb6bba3b9b81cb9efc576d2cfbaa222772a5550a6b57294500cb0a0
-size 5112
+oid sha256:dc4076db834e36228b0187c6e9e401088e34753327142086248937dc4ef9dd37
+size 5176