jonatasgrosman
commited on
Commit
•
1f76e35
1
Parent(s):
309c461
update evaluation
Browse files- README.md +9 -5
- log_mozilla-foundation_common_voice_8_0_pt_test_predictions.txt +0 -0
- log_mozilla-foundation_common_voice_8_0_pt_test_predictions_greedy.txt +0 -0
- mozilla-foundation_common_voice_8_0_pt_test_eval_results.txt +2 -2
- mozilla-foundation_common_voice_8_0_pt_test_eval_results_greedy.txt +2 -2
README.md
CHANGED
@@ -22,16 +22,16 @@ model-index:
|
|
22 |
metrics:
|
23 |
- name: Test WER
|
24 |
type: wer
|
25 |
-
value:
|
26 |
- name: Test CER
|
27 |
type: cer
|
28 |
-
value:
|
29 |
- name: Test WER (+LM)
|
30 |
type: wer
|
31 |
-
value:
|
32 |
- name: Test CER (+LM)
|
33 |
type: cer
|
34 |
-
value:
|
35 |
- task:
|
36 |
name: Automatic Speech Recognition
|
37 |
type: automatic-speech-recognition
|
@@ -56,8 +56,12 @@ model-index:
|
|
56 |
|
57 |
# XLS-R-1B-PORTUGUESE
|
58 |
|
59 |
-
|
|
|
60 |
|
|
|
|
|
|
|
61 |
|
62 |
## Evaluation Commands
|
63 |
|
|
|
22 |
metrics:
|
23 |
- name: Test WER
|
24 |
type: wer
|
25 |
+
value: 8.70
|
26 |
- name: Test CER
|
27 |
type: cer
|
28 |
+
value: 2.55
|
29 |
- name: Test WER (+LM)
|
30 |
type: wer
|
31 |
+
value: 6.04
|
32 |
- name: Test CER (+LM)
|
33 |
type: cer
|
34 |
+
value: 1.98
|
35 |
- task:
|
36 |
name: Automatic Speech Recognition
|
37 |
type: automatic-speech-recognition
|
|
|
56 |
|
57 |
# XLS-R-1B-PORTUGUESE
|
58 |
|
59 |
+
Fine-tuned [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on Portuguese using the [Common Voice 8](https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0).
|
60 |
+
When using this model, make sure that your speech input is sampled at 16kHz.
|
61 |
|
62 |
+
This model has been fine-tuned thanks to the GPU credits generously given by the [OVHcloud](https://www.ovhcloud.com/en/public-cloud/ai-training/) :)
|
63 |
+
|
64 |
+
The script used for training can be found here: https://github.com/jonatasgrosman/wav2vec2-sprint
|
65 |
|
66 |
## Evaluation Commands
|
67 |
|
log_mozilla-foundation_common_voice_8_0_pt_test_predictions.txt
CHANGED
The diff for this file is too large to render.
See raw diff
|
|
log_mozilla-foundation_common_voice_8_0_pt_test_predictions_greedy.txt
CHANGED
The diff for this file is too large to render.
See raw diff
|
|
mozilla-foundation_common_voice_8_0_pt_test_eval_results.txt
CHANGED
@@ -1,2 +1,2 @@
|
|
1 |
-
WER: 0.
|
2 |
-
CER: 0.
|
|
|
1 |
+
WER: 0.06040734186877624
|
2 |
+
CER: 0.019840625488279754
|
mozilla-foundation_common_voice_8_0_pt_test_eval_results_greedy.txt
CHANGED
@@ -1,2 +1,2 @@
|
|
1 |
-
WER: 0.
|
2 |
-
CER: 0.
|
|
|
1 |
+
WER: 0.08703722979771694
|
2 |
+
CER: 0.02556364717019862
|