End of training

README.md

@@ -7,13 +7,9 @@ tags:
 - generated_from_trainer
 datasets:
 - mozilla-foundation/common_voice_16_1
-- mozilla-foundation/common_voice_15_0
 model-index:
 - name: Whisper Small Taiwanese
   results: []
-metrics:
-- cer
-pipeline_tag: automatic-speech-recognition
 ---
 
 <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -21,10 +17,10 @@ should probably proofread and complete it, then remove this comment. -->
 
 # Whisper Small Taiwanese
 
-This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Common Voice 16.1 and the Common Voice 15.0 datasets.
+This model is a fine-tuned version of [openai/whisper-small](https://huggingface.co/openai/whisper-small) on the Common Voice 16.1 dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.3658
-- Cer: 29.0572
+- Loss: 0.3744
+- Cer: 29.0803
 
 ## Model description
 
@@ -49,30 +45,22 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 100
+- lr_scheduler_warmup_ratio: 0.1
 - num_epochs: 3
 
 ### Training results
 
-| Training Loss | Epoch | Step | Cer     | Validation Loss |
-|:-------------:|:-----:|:----:|:-------:|:---------------:|
-| 0.2295        | 1.13  | 3500 | 32.4577 | 0.4268          |
-| 0.179         | 1.29  | 4000 | 32.1109 | 0.4088          |
-| 0.161         | 1.45  | 4500 | 30.9241 | 0.3923          |
-| 0.1607        | 1.61  | 5000 | 30.1640 | 0.3840          |
-| 0.1336        | 1.77  | 5500 | 29.7573 | 0.3783          |
-| 0.1258        | 1.93  | 6000 | 29.5906 | 0.3736          |
-| 0.0725        | 2.09  | 6500 | 30.3507 | 0.3842          |
-| 0.0692        | 2.25  | 7000 | 30.0973 | 0.3776          | 
-| 0.0635        | 2.41  | 7500 | 29.5106 | 0.3740          | 
-| 0.053         | 2.57  | 8000 | 29.0772 | 0.3706          | 
-| 0.0441        | 2.73  | 8500 | 28.5238 | 0.3656          | 
-| 0.0427        | 2.89  | 9000 | 29.0572 | 0.3658          | 
+| Training Loss | Epoch  | Step | Validation Loss | Cer     |
+|:-------------:|:------:|:----:|:---------------:|:-------:|
+| 0.6757        | 0.6452 | 1000 | 0.6165          | 43.3161 |
+| 0.3539        | 1.2903 | 2000 | 0.4712          | 34.8316 |
+| 0.2883        | 1.9355 | 3000 | 0.4036          | 31.2306 |
+| 0.1566        | 2.5806 | 4000 | 0.3744          | 29.0803 |
 
 
 ### Framework versions
 
-- Transformers 4.38.2
+- Transformers 4.40.0
 - Pytorch 2.1.2
 - Datasets 2.18.0
-- Tokenizers 0.15.2
+- Tokenizers 0.19.1

generation_config.json

@@ -262,5 +262,5 @@
     "transcribe": 50359,
     "translate": 50358
   },
-  "transformers_version": "4.38.2"
+  "transformers_version": "4.40.0"
 }

runs/Apr19_07-01-28_5f6b3d0f1f11/events.out.tfevents.1713510088.5f6b3d0f1f11.26.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:01772732edafaa3272ca7ab70b288e01b8eea649bc009ea89f4d826b4ce109e9
-size 40533
+oid sha256:453703b6d8bf558684509b8608a1e6387a51d6ba4dae08c461b6bfcd20eca08c
+size 46373