Hugging Face's logo

cantillation
/
test

Automatic Speech Recognition
Transformers
TensorBoard
Safetensors
Hebrew
whisper
hf-asr-leaderboard
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
cantillation commited on
Commit
3bb6f65
•
1 Parent(s): f772c2f

Model save

Browse files
Files changed (4) hide show
  1. README.md +23 -26
  2. logs/events.out.tfevents.1720616926.8ba778dc7a53.58693.0 +3 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
README.md CHANGED
@@ -1,45 +1,42 @@
1
  ---
2
- language:
3
- - he
4
  license: apache-2.0
5
  base_model: openai/whisper-tiny
6
  tags:
7
- - hf-asr-leaderboard
8
  - generated_from_trainer
9
  metrics:
10
  - wer
11
  model-index:
12
- - name: he-cantillation
13
  results: []
14
  ---
15
 
16
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
17
  should probably proofread and complete it, then remove this comment. -->
18
 
19
- # he-cantillation
20
 
21
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on an unknown dataset.
22
  It achieves the following results on the evaluation set:
23
- - Loss: 8.6412
24
- - Wer: 161.3707
25
- - Avg Precision Exact: 0.0022
26
- - Avg Recall Exact: 0.0010
27
- - Avg F1 Exact: 0.0013
28
- - Avg Precision Letter Shift: 0.0160
29
- - Avg Recall Letter Shift: 0.0017
30
- - Avg F1 Letter Shift: 0.0030
31
- - Avg Precision Word Level: 0.0171
32
- - Avg Recall Word Level: 0.0191
33
- - Avg F1 Word Level: 0.0124
34
- - Avg Precision Word Shift: 0.0892
35
- - Avg Recall Word Shift: 0.0453
36
- - Avg F1 Word Shift: 0.0484
37
  - Precision Median Exact: 0.0
38
  - Recall Median Exact: 0.0
39
  - F1 Median Exact: 0.0
40
- - Precision Max Exact: 0.0667
41
- - Recall Max Exact: 0.0303
42
- - F1 Max Exact: 0.0417
43
  - Precision Min Exact: 0.0
44
  - Recall Min Exact: 0.0
45
  - F1 Min Exact: 0.0
@@ -82,10 +79,10 @@ The following hyperparameters were used during training:
82
 
83
  ### Training results
84
 
85
- | Training Loss | Epoch | Step | Validation Loss | Wer | Avg Precision Exact | Avg Recall Exact | Avg F1 Exact | Avg Precision Letter Shift | Avg Recall Letter Shift | Avg F1 Letter Shift | Avg Precision Word Level | Avg Recall Word Level | Avg F1 Word Level | Avg Precision Word Shift | Avg Recall Word Shift | Avg F1 Word Shift | Precision Median Exact | Recall Median Exact | F1 Median Exact | Precision Max Exact | Recall Max Exact | F1 Max Exact | Precision Min Exact | Recall Min Exact | F1 Min Exact | Precision Min Letter Shift | Recall Min Letter Shift | F1 Min Letter Shift | Precision Min Word Level | Recall Min Word Level | F1 Min Word Level | Precision Min Word Shift | Recall Min Word Shift | F1 Min Word Shift |
86
- |:-------------:|:------:|:----:|:---------------:|:--------:|:-------------------:|:----------------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:------------------------:|:---------------------:|:-----------------:|:------------------------:|:---------------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:------------:|:-------------------:|:----------------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:------------------------:|:---------------------:|:-----------------:|:------------------------:|:---------------------:|:-----------------:|
87
- | No log | 0.0040 | 1 | 8.6412 | 161.3707 | 0.0022 | 0.0010 | 0.0013 | 0.0160 | 0.0017 | 0.0030 | 0.0171 | 0.0191 | 0.0124 | 0.0892 | 0.0453 | 0.0484 | 0.0 | 0.0 | 0.0 | 0.0667 | 0.0303 | 0.0417 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
88
- | No log | 0.0202 | 5 | 8.6412 | 161.3707 | 0.0022 | 0.0010 | 0.0013 | 0.0160 | 0.0017 | 0.0030 | 0.0171 | 0.0191 | 0.0124 | 0.0892 | 0.0453 | 0.0484 | 0.0 | 0.0 | 0.0 | 0.0667 | 0.0303 | 0.0417 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
89
 
90
 
91
  ### Framework versions
 
1
  ---
 
 
2
  license: apache-2.0
3
  base_model: openai/whisper-tiny
4
  tags:
 
5
  - generated_from_trainer
6
  metrics:
7
  - wer
8
  model-index:
9
+ - name: test
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
+ # test
17
 
18
  This model is a fine-tuned version of [openai/whisper-tiny](https://huggingface.co/openai/whisper-tiny) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
+ - Loss: 8.5391
21
+ - Wer: 100.0
22
+ - Avg Precision Exact: 0.0025
23
+ - Avg Recall Exact: 0.0108
24
+ - Avg F1 Exact: 0.0040
25
+ - Avg Precision Letter Shift: 0.0838
26
+ - Avg Recall Letter Shift: 0.0277
27
+ - Avg F1 Letter Shift: 0.0417
28
+ - Avg Precision Word Level: 0.0118
29
+ - Avg Recall Word Level: 0.0511
30
+ - Avg F1 Word Level: 0.0190
31
+ - Avg Precision Word Shift: 0.1441
32
+ - Avg Recall Word Shift: 0.0917
33
+ - Avg F1 Word Shift: 0.1042
34
  - Precision Median Exact: 0.0
35
  - Recall Median Exact: 0.0
36
  - F1 Median Exact: 0.0
37
+ - Precision Max Exact: 0.0769
38
+ - Recall Max Exact: 0.3333
39
+ - F1 Max Exact: 0.125
40
  - Precision Min Exact: 0.0
41
  - Recall Min Exact: 0.0
42
  - F1 Min Exact: 0.0
 
79
 
80
  ### Training results
81
 
82
+ | Training Loss | Epoch | Step | Validation Loss | Wer | Avg Precision Exact | Avg Recall Exact | Avg F1 Exact | Avg Precision Letter Shift | Avg Recall Letter Shift | Avg F1 Letter Shift | Avg Precision Word Level | Avg Recall Word Level | Avg F1 Word Level | Avg Precision Word Shift | Avg Recall Word Shift | Avg F1 Word Shift | Precision Median Exact | Recall Median Exact | F1 Median Exact | Precision Max Exact | Recall Max Exact | F1 Max Exact | Precision Min Exact | Recall Min Exact | F1 Min Exact | Precision Min Letter Shift | Recall Min Letter Shift | F1 Min Letter Shift | Precision Min Word Level | Recall Min Word Level | F1 Min Word Level | Precision Min Word Shift | Recall Min Word Shift | F1 Min Word Shift |
83
+ |:-------------:|:------:|:----:|:---------------:|:-----:|:-------------------:|:----------------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:------------------------:|:---------------------:|:-----------------:|:------------------------:|:---------------------:|:-----------------:|:----------------------:|:-------------------:|:---------------:|:-------------------:|:----------------:|:------------:|:-------------------:|:----------------:|:------------:|:--------------------------:|:-----------------------:|:-------------------:|:------------------------:|:---------------------:|:-----------------:|:------------------------:|:---------------------:|:-----------------:|
84
+ | No log | 0.0040 | 1 | 8.5391 | 100.0 | 0.0025 | 0.0108 | 0.0040 | 0.0838 | 0.0277 | 0.0417 | 0.0118 | 0.0511 | 0.0190 | 0.1441 | 0.0917 | 0.1042 | 0.0 | 0.0 | 0.0 | 0.0769 | 0.3333 | 0.125 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
85
+ | No log | 0.0202 | 5 | 8.5391 | 100.0 | 0.0025 | 0.0108 | 0.0040 | 0.0838 | 0.0277 | 0.0417 | 0.0118 | 0.0511 | 0.0190 | 0.1441 | 0.0917 | 0.1042 | 0.0 | 0.0 | 0.0 | 0.0769 | 0.3333 | 0.125 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 | 0.0 |
86
 
87
 
88
  ### Framework versions
logs/events.out.tfevents.1720616926.8ba778dc7a53.58693.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d28e050d875b05d02d26dca173756cf62adc223f1fb93a8e6bd8d9162b3195ea
3
+ size 10373
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4dcc940ee6ceacb215635c54c91d2163fc7bff40dd2b61939b601e07ca78edee
3
  size 151109288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2e5ea1c5b491975db1137ad144c49c28b74d1224f0b1ba81aef798a83da31b7
3
  size 151109288
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:6b4a71d5782b69d52484d7b28c3d46d9a266c9265c4bc84a8a01b1c68fc01b19
3
  size 5240
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ca3fb93fe2ed654f226451107690437001f23942a9bbe18e4566bfce9289ad6
3
  size 5240