whisper_4_with_init_sun_syl_wd_0_lr_7en5_0015

This model is a fine-tuned version of openai/whisper-tiny on an unknown dataset. It achieves the following results on the evaluation set:

• Train Loss: 0.4550
• Train Accuracy: 0.0313
• Train Wermet: 0.0971
• Train Wermet Syl: 0.1409
• Validation Loss: 0.9789
• Validation Accuracy: 0.0211
• Validation Wermet: 0.2876
• Validation Wermet Syl: 0.2732
• Epoch: 14

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 7e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0}
• training_precision: float32

Training results

Train Loss	Train Accuracy	Train Wermet	Train Wermet Syl	Validation Loss	Validation Accuracy	Validation Wermet	Validation Wermet Syl	Epoch
4.9248	0.0113	1.1777	1.1068	3.9252	0.0115	0.9215	0.8812	0
4.6658	0.0117	0.8497	0.8066	3.9186	0.0113	0.9766	0.9699	1
4.6144	0.0118	0.8224	0.7735	3.8791	0.0115	0.9336	0.9042	2
4.5388	0.0120	0.7917	0.7466	3.6581	0.0120	0.8508	0.8073	3
4.0826	0.0133	0.7361	0.6973	2.7406	0.0139	0.7479	0.7097	4
3.0292	0.0166	0.6273	0.6290	1.8185	0.0170	0.5529	0.5186	5
2.1435	0.0203	0.4839	0.5224	1.6075	0.0176	0.4395	0.4097	6
1.6289	0.0228	0.3883	0.4416	1.1774	0.0197	0.3770	0.3490	7
1.2619	0.0250	0.3256	0.3991	1.1074	0.0201	0.3404	0.3137	8
1.0044	0.0268	0.2703	0.3518	1.0470	0.0205	0.3204	0.2976	9
0.8528	0.0279	0.2202	0.2912	0.9859	0.0209	0.3069	0.2809	10
0.7298	0.0289	0.1801	0.2406	0.9461	0.0212	0.2943	0.2720	11
0.6258	0.0297	0.1448	0.1973	0.9400	0.0214	0.2853	0.2618	12
0.5089	0.0308	0.1191	0.1700	0.9320	0.0214	0.2849	0.2608	13
0.4550	0.0313	0.0971	0.1409	0.9789	0.0211	0.2876	0.2732	14

Framework versions

• Transformers 4.34.0.dev0
• TensorFlow 2.13.0
• Tokenizers 0.13.3