Martha-987 commited on
Commit
d94966f
·
1 Parent(s): 5f0d0d0

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -0
README.md ADDED
@@ -0,0 +1,38 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ Whisper Small Ar- Martha
2
+ This model is a fine-tuned version of openai/whisper-small on the Common Voice 11.0 dataset. It achieves the following results on the evaluation set:
3
+
4
+ Loss: 0.5854
5
+ Wer: 70.2071
6
+ Model description
7
+ More information needed
8
+
9
+ Intended uses & limitations
10
+ More information needed
11
+
12
+ Training and evaluation data
13
+ More information needed
14
+
15
+ Training procedure
16
+ Training hyperparameters
17
+ The following hyperparameters were used during training:
18
+
19
+ learning_rate: 1e-05
20
+ train_batch_size: 16
21
+ eval_batch_size: 8
22
+ seed: 42
23
+ optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
24
+ lr_scheduler_type: linear
25
+ lr_scheduler_warmup_steps: 500
26
+ training_steps: 500
27
+ mixed_precision_training: Native AMP
28
+ Training results
29
+ Training Loss Epoch Step Validation Loss Wer
30
+ 0.9692 0.14 125 1.3372 173.0952
31
+ 0.5716 0.29 250 0.9058 148.6795
32
+ 0.3297 0.43 375 0.5825 63.6709
33
+ 0.3083 0.57 500 0.5854 70.2071
34
+ Framework versions
35
+ Transformers 4.26.0.dev0
36
+ Pytorch 1.13.0+cu116
37
+ Datasets 2.7.1
38
+ Tokenizers 0.13.2