|
--- |
|
library_name: transformers |
|
language: |
|
- nl |
|
license: apache-2.0 |
|
base_model: openai/whisper-large-v2 |
|
tags: |
|
- generated_from_trainer |
|
metrics: |
|
- wer |
|
model-index: |
|
- name: Whisper Large V2 |
|
results: [] |
|
--- |
|
|
|
<!-- This model card has been generated automatically according to the information the Trainer had access to. You |
|
should probably proofread and complete it, then remove this comment. --> |
|
|
|
# Whisper Large V2 |
|
|
|
This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on the None dataset. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.4599 |
|
- Wer: 24.2092 |
|
|
|
## Model description |
|
|
|
More information needed |
|
|
|
## Intended uses & limitations |
|
|
|
More information needed |
|
|
|
## Training and evaluation data |
|
|
|
More information needed |
|
|
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
|
|
The following hyperparameters were used during training: |
|
- learning_rate: 3e-05 |
|
- train_batch_size: 12 |
|
- eval_batch_size: 8 |
|
- seed: 42 |
|
- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 |
|
- lr_scheduler_type: linear |
|
- lr_scheduler_warmup_steps: 20 |
|
- num_epochs: 5 |
|
|
|
### Training results |
|
|
|
| Training Loss | Epoch | Step | Validation Loss | Wer | |
|
|:-------------:|:------:|:----:|:---------------:|:-------:| |
|
| 0.8662 | 0.0833 | 15 | 0.5819 | 33.0573 | |
|
| 0.5255 | 0.1667 | 30 | 0.4760 | 37.3151 | |
|
| 0.4103 | 0.25 | 45 | 0.4493 | 28.9104 | |
|
| 0.4344 | 0.3333 | 60 | 0.4362 | 25.2990 | |
|
| 0.3882 | 0.4167 | 75 | 0.4279 | 37.7798 | |
|
| 0.402 | 0.5 | 90 | 0.4190 | 40.5043 | |
|
| 0.4105 | 0.5833 | 105 | 0.4136 | 42.3254 | |
|
| 0.4126 | 0.6667 | 120 | 0.3959 | 24.2446 | |
|
| 0.3672 | 0.75 | 135 | 0.3956 | 36.5367 | |
|
| 0.4401 | 0.8333 | 150 | 0.3805 | 24.8744 | |
|
| 0.3698 | 0.9167 | 165 | 0.3834 | 44.2526 | |
|
| 0.3728 | 1.0 | 180 | 0.3742 | 42.0447 | |
|
| 0.1642 | 1.0833 | 195 | 0.3942 | 27.6555 | |
|
| 0.1904 | 1.1667 | 210 | 0.3793 | 25.7967 | |
|
| 0.1801 | 1.25 | 225 | 0.3859 | 23.6879 | |
|
| 0.1693 | 1.3333 | 240 | 0.3934 | 25.1928 | |
|
| 0.1839 | 1.4167 | 255 | 0.3853 | 29.6629 | |
|
| 0.19 | 1.5 | 270 | 0.3763 | 27.3489 | |
|
| 0.1977 | 1.5833 | 285 | 0.3764 | 21.0436 | |
|
| 0.1922 | 1.6667 | 300 | 0.3719 | 30.1040 | |
|
| 0.185 | 1.75 | 315 | 0.3716 | 25.9736 | |
|
| 0.1873 | 1.8333 | 330 | 0.3671 | 22.8127 | |
|
| 0.1802 | 1.9167 | 345 | 0.3621 | 21.2582 | |
|
| 0.1931 | 2.0 | 360 | 0.3662 | 24.4262 | |
|
| 0.0848 | 2.0833 | 375 | 0.3989 | 34.8949 | |
|
| 0.0823 | 2.1667 | 390 | 0.3888 | 23.3718 | |
|
| 0.0817 | 2.25 | 405 | 0.3914 | 22.8057 | |
|
| 0.0952 | 2.3333 | 420 | 0.3784 | 23.8530 | |
|
| 0.0961 | 2.4167 | 435 | 0.3917 | 33.5315 | |
|
| 0.0954 | 2.5 | 450 | 0.3822 | 20.7959 | |
|
| 0.0909 | 2.5833 | 465 | 0.3877 | 22.4282 | |
|
| 0.084 | 2.6667 | 480 | 0.3878 | 26.7025 | |
|
| 0.0769 | 2.75 | 495 | 0.3890 | 21.8597 | |
|
| 0.0879 | 2.8333 | 510 | 0.3899 | 24.0724 | |
|
| 0.0835 | 2.9167 | 525 | 0.3788 | 20.9327 | |
|
| 0.0845 | 3.0 | 540 | 0.3807 | 26.7379 | |
|
| 0.0383 | 3.0833 | 555 | 0.4227 | 24.4333 | |
|
| 0.0408 | 3.1667 | 570 | 0.4173 | 31.6868 | |
|
| 0.0393 | 3.25 | 585 | 0.4202 | 21.5413 | |
|
| 0.035 | 3.3333 | 600 | 0.4141 | 23.4355 | |
|
| 0.034 | 3.4167 | 615 | 0.4193 | 24.1927 | |
|
| 0.0383 | 3.5 | 630 | 0.4160 | 27.6319 | |
|
| 0.0295 | 3.5833 | 645 | 0.4243 | 26.9644 | |
|
| 0.0323 | 3.6667 | 660 | 0.4201 | 25.1221 | |
|
| 0.0337 | 3.75 | 675 | 0.4195 | 26.5445 | |
|
| 0.0328 | 3.8333 | 690 | 0.4229 | 23.7775 | |
|
| 0.0344 | 3.9167 | 705 | 0.4213 | 23.9025 | |
|
| 0.0257 | 4.0 | 720 | 0.4209 | 23.6643 | |
|
| 0.0134 | 4.0833 | 735 | 0.4392 | 22.7372 | |
|
| 0.0113 | 4.1667 | 750 | 0.4556 | 21.2511 | |
|
| 0.0122 | 4.25 | 765 | 0.4596 | 21.6899 | |
|
| 0.0117 | 4.3333 | 780 | 0.4652 | 21.7890 | |
|
| 0.0111 | 4.4167 | 795 | 0.4637 | 21.6946 | |
|
| 0.0115 | 4.5 | 810 | 0.4627 | 23.1571 | |
|
| 0.0127 | 4.5833 | 825 | 0.4567 | 24.0040 | |
|
| 0.0108 | 4.6667 | 840 | 0.4592 | 23.0415 | |
|
| 0.0107 | 4.75 | 855 | 0.4610 | 23.4661 | |
|
| 0.0094 | 4.8333 | 870 | 0.4602 | 25.0112 | |
|
| 0.0104 | 4.9167 | 885 | 0.4599 | 24.6621 | |
|
| 0.0125 | 5.0 | 900 | 0.4599 | 24.2092 | |
|
|
|
|
|
### Framework versions |
|
|
|
- Transformers 4.45.0.dev0 |
|
- Pytorch 2.1.0+cu121 |
|
- Datasets 2.20.0 |
|
- Tokenizers 0.19.1 |
|
|
