MarOsz commited on
Commit
45153b9
·
verified ·
1 Parent(s): 6bbb64b

End of training

Browse files
README.md CHANGED
@@ -1,72 +1,72 @@
1
- ---
2
- language:
3
- - pl
4
- library_name: peft
5
- tags:
6
- - generated_from_trainer
7
- base_model: openai/whisper-base
8
- datasets:
9
- - mozilla-foundation/common_voice_17_0
10
- model-index:
11
- - name: Whisper Base Polish PEFT - s22678 prod
12
- results:
13
- - task:
14
- type: automatic-speech-recognition
15
- name: Automatic Speech Recognition
16
- dataset:
17
- name: Common Voice 17.0
18
- type: mozilla-foundation/common_voice_17_0
19
- split: test
20
- metrics:
21
- - type: wer
22
- value: 69.3315858453473
23
- name: WER
24
- ---
25
-
26
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
27
- should probably proofread and complete it, then remove this comment. -->
28
-
29
- # Whisper Base Polish PEFT - s22678 prod
30
-
31
- This model is a fine-tuned version of [openai/openai/whisper-base](https://huggingface.co/openai/openai/whisper-base) on the Common Voice 17.0 dataset.
32
- It achieves the following results on the evaluation set:
33
- - Loss: 1.8904
34
-
35
- ## Model description
36
-
37
- More information needed
38
-
39
- ## Intended uses & limitations
40
-
41
- More information needed
42
-
43
- ## Training and evaluation data
44
-
45
- More information needed
46
-
47
- ## Training procedure
48
-
49
- ### Training hyperparameters
50
-
51
- The following hyperparameters were used during training:
52
- - learning_rate: 0.001
53
- - train_batch_size: 52
54
- - eval_batch_size: 64
55
- - seed: 42
56
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
57
- - lr_scheduler_type: linear
58
- - lr_scheduler_warmup_steps: 50
59
- - training_steps: 10
60
- - mixed_precision_training: Native AMP
61
-
62
- ### Training results
63
-
64
-
65
-
66
- ### Framework versions
67
-
68
- - PEFT 0.11.2.dev0
69
- - Transformers 4.36.0
70
- - Pytorch 2.1.0
71
- - Datasets 2.15.0
72
  - Tokenizers 0.15.1
 
1
+ ---
2
+ language:
3
+ - pl
4
+ library_name: peft
5
+ tags:
6
+ - generated_from_trainer
7
+ datasets:
8
+ - mozilla-foundation/common_voice_17_0
9
+ base_model: openai/whisper-base
10
+ model-index:
11
+ - name: Whisper Base Polish PEFT - s22678 prod
12
+ results: []
13
+ ---
14
+
15
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
+ should probably proofread and complete it, then remove this comment. -->
17
+
18
+ # Whisper Base Polish PEFT - s22678 prod
19
+
20
+ This model is a fine-tuned version of [openai/openai/whisper-base](https://huggingface.co/openai/openai/whisper-base) on the Common Voice 17.0 dataset.
21
+ It achieves the following results on the evaluation set:
22
+ - Loss: 0.5546
23
+
24
+ ## Model description
25
+
26
+ More information needed
27
+
28
+ ## Intended uses & limitations
29
+
30
+ More information needed
31
+
32
+ ## Training and evaluation data
33
+
34
+ More information needed
35
+
36
+ ## Training procedure
37
+
38
+ ### Training hyperparameters
39
+
40
+ The following hyperparameters were used during training:
41
+ - learning_rate: 0.001
42
+ - train_batch_size: 52
43
+ - eval_batch_size: 64
44
+ - seed: 42
45
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
46
+ - lr_scheduler_type: linear
47
+ - lr_scheduler_warmup_steps: 50
48
+ - num_epochs: 10
49
+ - mixed_precision_training: Native AMP
50
+
51
+ ### Training results
52
+
53
+ | Training Loss | Epoch | Step | Validation Loss |
54
+ |:-------------:|:-----:|:----:|:---------------:|
55
+ | 0.3265 | 1.0 | 400 | 0.4049 |
56
+ | 0.2506 | 2.01 | 800 | 0.3920 |
57
+ | 0.185 | 3.01 | 1200 | 0.3868 |
58
+ | 0.1506 | 4.01 | 1600 | 0.3859 |
59
+ | 0.1217 | 5.01 | 2000 | 0.3856 |
60
+ | 0.0931 | 6.02 | 2400 | 0.3922 |
61
+ | 0.0698 | 7.02 | 2800 | 0.3999 |
62
+ | 0.0549 | 8.02 | 3200 | 0.4077 |
63
+ | 0.0477 | 9.02 | 3600 | 0.4121 |
64
+
65
+
66
+ ### Framework versions
67
+
68
+ - PEFT 0.11.2.dev0
69
+ - Transformers 4.36.0
70
+ - Pytorch 2.1.0
71
+ - Datasets 2.15.0
72
  - Tokenizers 0.15.1
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:0b4c960a120b6a2392343c67a7a9119e63faae3218c9ae98ec17e98173988e42
3
  size 4728680
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0ee2e554ebb090b1d314466ed86ab7b00f52206f9f7f042f98a7df9cdf85824b
3
  size 4728680
runs/Jun10_22-25-50_algo-1/events.out.tfevents.1718058351.algo-1.83.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aa0697ff8f09538f3e9b7d5a1bfab2e7656378991a4d051c46796849bf442a85
3
+ size 61319
runs/Jun11_14-15-00_algo-1/events.out.tfevents.1718115300.algo-1.83.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bfae931e06b9990ad3e238a093fc22b1642724ad55c758d120243a35cb2a98a1
3
+ size 23030
runs/Jun11_19-59-00_algo-1/events.out.tfevents.1718135940.algo-1.83.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:08e996668315ba0436203455e44bf6fbfb00eb70d2a22d5620824d29f22d7ba7
3
+ size 14909
runs/Jun12_03-50-05_algo-1/events.out.tfevents.1718164206.algo-1.83.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:545611cacabae08b52a801669577a9b54d0bda9a64d332b5c458b93b1674ac00
3
+ size 6748
runs/Jun12_04-08-30_algo-1/events.out.tfevents.1718165310.algo-1.84.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ada727c8ebfa0e9d5fbeeb77c31c35d28ac4ffa9aaf00c3cc0d5e59f4fa1806d
3
+ size 14909
runs/Jun12_04-08-30_algo-1/events.out.tfevents.1718165310.algo-1.84.0.sagemaker-uploaded ADDED
File without changes
runs/Jun12_04-08-30_algo-1/events.out.tfevents.1718174053.algo-1.84.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3dd4a2b1811df3a2f9931563dff0e7dc190e8a651159323b771f273423d242da
3
+ size 359
runs/Jun12_04-08-30_algo-1/events.out.tfevents.1718174053.algo-1.84.1.sagemaker-uploaded ADDED
File without changes
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:24999204bf71d421ba1c114f4b81d89ed3d2e4bffa90140e6664e1148b0f31b4
3
  size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8e22713407fe77d477244f81bea315cc7360ab17656192a041024f38f416a13
3
  size 4920