End of training

README.md

@@ -1,10 +1,10 @@
 ---
-base_model: jmaczan/wav2vec2-large-xls-r-300m-dysarthria
 license: apache-2.0
-metrics:
-- wer
+base_model: jmaczan/wav2vec2-large-xls-r-300m-dysarthria-big-dataset
 tags:
 - generated_from_trainer
+metrics:
+- wer
 model-index:
 - name: wav2vec2-large-xls-r-300m-dysarthria-big-dataset
   results: []
@@ -15,10 +15,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # wav2vec2-large-xls-r-300m-dysarthria-big-dataset
 
-This model is a fine-tuned version of [jmaczan/wav2vec2-large-xls-r-300m-dysarthria](https://huggingface.co/jmaczan/wav2vec2-large-xls-r-300m-dysarthria) on the None dataset.
+This model is a fine-tuned version of [jmaczan/wav2vec2-large-xls-r-300m-dysarthria-big-dataset](https://huggingface.co/jmaczan/wav2vec2-large-xls-r-300m-dysarthria-big-dataset) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0313
-- Wer: 0.28
+- Loss: 0.0864
+- Wer: 0.182
 
 ## Model description
 
@@ -38,11 +38,11 @@ More information needed
 
 The following hyperparameters were used during training:
 - learning_rate: 0.0003
-- train_batch_size: 8
+- train_batch_size: 16
 - eval_batch_size: 8
 - seed: 42
 - gradient_accumulation_steps: 2
-- total_train_batch_size: 16
+- total_train_batch_size: 32
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
 - lr_scheduler_warmup_steps: 500
@@ -53,24 +53,15 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Wer   |
 |:-------------:|:-----:|:----:|:---------------:|:-----:|
-| 3.1965        | 1.6   | 200  | 1.7709          | 0.88  |
-| 1.6135        | 3.2   | 400  | 1.1347          | 0.764 |
-| 1.1769        | 4.8   | 600  | 0.9348          | 0.722 |
-| 0.8155        | 6.4   | 800  | 0.5330          | 0.576 |
-| 0.5961        | 8.0   | 1000 | 0.3927          | 0.504 |
-| 0.4436        | 9.6   | 1200 | 0.3171          | 0.488 |
-| 0.3581        | 11.2  | 1400 | 0.2877          | 0.512 |
-| 0.2931        | 12.8  | 1600 | 0.1590          | 0.354 |
-| 0.219         | 14.4  | 1800 | 0.1370          | 0.326 |
-| 0.1912        | 16.0  | 2000 | 0.1362          | 0.262 |
-| 0.1543        | 17.6  | 2200 | 0.0823          | 0.238 |
-| 0.1323        | 19.2  | 2400 | 0.0764          | 0.272 |
-| 0.1095        | 20.8  | 2600 | 0.0649          | 0.272 |
-| 0.0909        | 22.4  | 2800 | 0.0537          | 0.274 |
-| 0.0807        | 24.0  | 3000 | 0.0499          | 0.248 |
-| 0.0618        | 25.6  | 3200 | 0.0499          | 0.318 |
-| 0.0573        | 27.2  | 3400 | 0.0414          | 0.252 |
-| 0.0456        | 28.8  | 3600 | 0.0313          | 0.28  |
+| 1.419         | 3.2   | 200  | 0.7599          | 0.668 |
+| 0.7759        | 6.4   | 400  | 0.4966          | 0.618 |
+| 0.5808        | 9.6   | 600  | 0.3352          | 0.508 |
+| 0.3652        | 12.8  | 800  | 0.2214          | 0.386 |
+| 0.2347        | 16.0  | 1000 | 0.1566          | 0.246 |
+| 0.1738        | 19.2  | 1200 | 0.1340          | 0.23  |
+| 0.1076        | 22.4  | 1400 | 0.1244          | 0.242 |
+| 0.077         | 25.6  | 1600 | 0.0948          | 0.184 |
+| 0.0566        | 28.8  | 1800 | 0.0864          | 0.182 |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:586a328b291f3457a38eeb0aa1141c68e9812c9a6d0e11313d4dd7044cdffcb3
+oid sha256:b42f38c61c6fccae6f03e3a047c02b64975b643ff501d1f92f391d98fa205332
 size 1261934580