Update README.md
Browse files
README.md
CHANGED
@@ -4,9 +4,37 @@ tags:
|
|
4 |
- generated_from_trainer
|
5 |
datasets:
|
6 |
- common_voice_8_0
|
|
|
|
|
7 |
model-index:
|
8 |
- name: wav2vec2-large-xls-r-1b-frisian-cv-8
|
9 |
-
results:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
10 |
---
|
11 |
|
12 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
@@ -14,7 +42,13 @@ should probably proofread and complete it, then remove this comment. -->
|
|
14 |
|
15 |
# wav2vec2-large-xls-r-1b-frisian-cv-8
|
16 |
|
17 |
-
This model is a fine-tuned version of [
|
|
|
|
|
|
|
|
|
|
|
|
|
18 |
|
19 |
## Model description
|
20 |
|
@@ -40,11 +74,43 @@ The following hyperparameters were used during training:
|
|
40 |
- optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-08
|
41 |
- lr_scheduler_type: linear
|
42 |
- lr_scheduler_warmup_ratio: 0.1
|
43 |
-
- num_epochs:
|
44 |
- mixed_precision_training: Native AMP
|
45 |
|
46 |
### Training results
|
47 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
48 |
|
49 |
|
50 |
### Framework versions
|
|
|
4 |
- generated_from_trainer
|
5 |
datasets:
|
6 |
- common_voice_8_0
|
7 |
+
metrics:
|
8 |
+
- wer
|
9 |
model-index:
|
10 |
- name: wav2vec2-large-xls-r-1b-frisian-cv-8
|
11 |
+
results:
|
12 |
+
- task:
|
13 |
+
name: Automatic Speech Recognition
|
14 |
+
type: automatic-speech-recognition
|
15 |
+
dataset:
|
16 |
+
name: common_voice_8_0
|
17 |
+
type: common_voice_8_0
|
18 |
+
config: fy-NL
|
19 |
+
split: validation
|
20 |
+
args: fy-NL
|
21 |
+
metrics:
|
22 |
+
- name: Wer
|
23 |
+
type: wer
|
24 |
+
value: 0.14290815597771747
|
25 |
+
- task:
|
26 |
+
name: Automatic Speech Recognition
|
27 |
+
type: automatic-speech-recognition
|
28 |
+
dataset:
|
29 |
+
name: common_voice_8_0
|
30 |
+
type: common_voice_8_0
|
31 |
+
config: fy-NL
|
32 |
+
split: test
|
33 |
+
args: fy-NL
|
34 |
+
metrics:
|
35 |
+
- name: Wer
|
36 |
+
type: wer
|
37 |
+
value: 0.1413499060557884
|
38 |
---
|
39 |
|
40 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
|
|
42 |
|
43 |
# wav2vec2-large-xls-r-1b-frisian-cv-8
|
44 |
|
45 |
+
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on the common_voice_8_0 dataset.
|
46 |
+
It achieves the following results on the evaluation set:
|
47 |
+
- Loss: 0.2131
|
48 |
+
- Wer: 0.1429
|
49 |
+
|
50 |
+
And on the test set:
|
51 |
+
- Wer: 0.1413
|
52 |
|
53 |
## Model description
|
54 |
|
|
|
74 |
- optimizer: Adam with betas=(0.9,0.98) and epsilon=1e-08
|
75 |
- lr_scheduler_type: linear
|
76 |
- lr_scheduler_warmup_ratio: 0.1
|
77 |
+
- num_epochs: 50
|
78 |
- mixed_precision_training: Native AMP
|
79 |
|
80 |
### Training results
|
81 |
|
82 |
+
| Training Loss | Epoch | Step | Validation Loss | Wer |
|
83 |
+
|:-------------:|:-----:|:----:|:---------------:|:------:|
|
84 |
+
| 6.0565 | 1.72 | 200 | 3.1053 | 1.0 |
|
85 |
+
| 2.7675 | 3.45 | 400 | 1.1551 | 0.8611 |
|
86 |
+
| 1.3474 | 5.17 | 600 | 0.4770 | 0.4397 |
|
87 |
+
| 0.9617 | 6.9 | 800 | 0.3218 | 0.3343 |
|
88 |
+
| 0.9058 | 8.62 | 1000 | 0.2741 | 0.2768 |
|
89 |
+
| 0.9712 | 10.34 | 1200 | 0.2619 | 0.2505 |
|
90 |
+
| 0.6908 | 12.07 | 1400 | 0.2288 | 0.2243 |
|
91 |
+
| 0.745 | 13.79 | 1600 | 0.2288 | 0.2095 |
|
92 |
+
| 0.7742 | 15.52 | 1800 | 0.2289 | 0.1979 |
|
93 |
+
| 0.7231 | 17.24 | 2000 | 0.2198 | 0.1940 |
|
94 |
+
| 0.6475 | 18.97 | 2200 | 0.2180 | 0.1992 |
|
95 |
+
| 0.6421 | 20.69 | 2400 | 0.2133 | 0.1741 |
|
96 |
+
| 0.5925 | 22.41 | 2600 | 0.1998 | 0.1747 |
|
97 |
+
| 0.5608 | 24.14 | 2800 | 0.2212 | 0.1950 |
|
98 |
+
| 0.5315 | 25.86 | 3000 | 0.2187 | 0.1624 |
|
99 |
+
| 0.5362 | 27.59 | 3200 | 0.2057 | 0.1718 |
|
100 |
+
| 0.563 | 29.31 | 3400 | 0.2090 | 0.1613 |
|
101 |
+
| 0.4218 | 31.03 | 3600 | 0.2126 | 0.1531 |
|
102 |
+
| 0.3826 | 32.76 | 3800 | 0.2084 | 0.1538 |
|
103 |
+
| 0.356 | 34.48 | 4000 | 0.2115 | 0.1612 |
|
104 |
+
| 0.2966 | 36.21 | 4200 | 0.2093 | 0.1536 |
|
105 |
+
| 0.3377 | 37.93 | 4400 | 0.2061 | 0.1527 |
|
106 |
+
| 0.321 | 39.66 | 4600 | 0.2121 | 0.1463 |
|
107 |
+
| 0.2942 | 41.38 | 4800 | 0.2158 | 0.1441 |
|
108 |
+
| 0.2931 | 43.1 | 5000 | 0.2173 | 0.1446 |
|
109 |
+
| 0.2346 | 44.83 | 5200 | 0.2152 | 0.1436 |
|
110 |
+
| 0.2543 | 46.55 | 5400 | 0.2066 | 0.1445 |
|
111 |
+
| 0.2385 | 48.28 | 5600 | 0.2108 | 0.1432 |
|
112 |
+
| 0.2726 | 50.0 | 5800 | 0.2131 | 0.1429 |
|
113 |
+
|
114 |
|
115 |
|
116 |
### Framework versions
|