Hugging Face's logo

botika
/
checkpoint-124500-finetuned-squad

Question Answering
Transformers
PyTorch
TensorBoard
distilbert
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
botika commited on
Commit
5dab949
路
1 Parent(s): 6dc0536

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +154 -0
README.md ADDED
@@ -0,0 +1,154 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ model-index:
5
+ - name: checkpoint-124500-finetuned-squad
6
+ results: []
7
+ ---
8
+
9
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
10
+ should probably proofread and complete it, then remove this comment. -->
11
+
12
+ # checkpoint-124500-finetuned-squad
13
+
14
+ This model was trained from scratch on an unknown dataset.
15
+ It achieves the following results on the evaluation set:
16
+ - Loss: 14.9594
17
+
18
+ ## Model description
19
+
20
+ More information needed
21
+
22
+ ## Intended uses & limitations
23
+
24
+ More information needed
25
+
26
+ ## Training and evaluation data
27
+
28
+ More information needed
29
+
30
+ ## Training procedure
31
+
32
+ ### Training hyperparameters
33
+
34
+ The following hyperparameters were used during training:
35
+ - learning_rate: 2e-05
36
+ - train_batch_size: 32
37
+ - eval_batch_size: 32
38
+ - seed: 42
39
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
40
+ - lr_scheduler_type: linear
41
+ - num_epochs: 100
42
+
43
+ ### Training results
44
+
45
+ | Training Loss | Epoch | Step | Validation Loss |
46
+ |:-------------:|:-----:|:------:|:---------------:|
47
+ | 3.9975 | 1.0 | 3289 | 3.8405 |
48
+ | 3.7311 | 2.0 | 6578 | 3.7114 |
49
+ | 3.5681 | 3.0 | 9867 | 3.6829 |
50
+ | 3.4101 | 4.0 | 13156 | 3.6368 |
51
+ | 3.2487 | 5.0 | 16445 | 3.6526 |
52
+ | 3.1143 | 6.0 | 19734 | 3.7567 |
53
+ | 2.9783 | 7.0 | 23023 | 3.8469 |
54
+ | 2.8295 | 8.0 | 26312 | 4.0040 |
55
+ | 2.6912 | 9.0 | 29601 | 4.1996 |
56
+ | 2.5424 | 10.0 | 32890 | 4.3387 |
57
+ | 2.4161 | 11.0 | 36179 | 4.4988 |
58
+ | 2.2713 | 12.0 | 39468 | 4.7861 |
59
+ | 2.1413 | 13.0 | 42757 | 4.9276 |
60
+ | 2.0125 | 14.0 | 46046 | 5.0598 |
61
+ | 1.8798 | 15.0 | 49335 | 5.3347 |
62
+ | 1.726 | 16.0 | 52624 | 5.5869 |
63
+ | 1.5994 | 17.0 | 55913 | 5.7161 |
64
+ | 1.4643 | 18.0 | 59202 | 6.0174 |
65
+ | 1.3237 | 19.0 | 62491 | 6.4926 |
66
+ | 1.2155 | 20.0 | 65780 | 6.4882 |
67
+ | 1.1029 | 21.0 | 69069 | 6.9922 |
68
+ | 0.9948 | 22.0 | 72358 | 7.1357 |
69
+ | 0.9038 | 23.0 | 75647 | 7.3676 |
70
+ | 0.8099 | 24.0 | 78936 | 7.4180 |
71
+ | 0.7254 | 25.0 | 82225 | 7.7753 |
72
+ | 0.6598 | 26.0 | 85514 | 7.8643 |
73
+ | 0.5723 | 27.0 | 88803 | 8.1798 |
74
+ | 0.5337 | 28.0 | 92092 | 8.3053 |
75
+ | 0.4643 | 29.0 | 95381 | 8.8597 |
76
+ | 0.4241 | 30.0 | 98670 | 8.9849 |
77
+ | 0.3763 | 31.0 | 101959 | 8.8406 |
78
+ | 0.3479 | 32.0 | 105248 | 9.1517 |
79
+ | 0.3271 | 33.0 | 108537 | 9.3659 |
80
+ | 0.2911 | 34.0 | 111826 | 9.4813 |
81
+ | 0.2836 | 35.0 | 115115 | 9.5746 |
82
+ | 0.2528 | 36.0 | 118404 | 9.7027 |
83
+ | 0.2345 | 37.0 | 121693 | 9.7515 |
84
+ | 0.2184 | 38.0 | 124982 | 9.9729 |
85
+ | 0.2067 | 39.0 | 128271 | 10.0828 |
86
+ | 0.2077 | 40.0 | 131560 | 10.0878 |
87
+ | 0.1876 | 41.0 | 134849 | 10.2974 |
88
+ | 0.1719 | 42.0 | 138138 | 10.2712 |
89
+ | 0.1637 | 43.0 | 141427 | 10.5788 |
90
+ | 0.1482 | 44.0 | 144716 | 10.7465 |
91
+ | 0.1509 | 45.0 | 148005 | 10.4603 |
92
+ | 0.1358 | 46.0 | 151294 | 10.7665 |
93
+ | 0.1316 | 47.0 | 154583 | 10.7724 |
94
+ | 0.1223 | 48.0 | 157872 | 11.1766 |
95
+ | 0.1205 | 49.0 | 161161 | 11.1870 |
96
+ | 0.1203 | 50.0 | 164450 | 11.1053 |
97
+ | 0.1081 | 51.0 | 167739 | 10.9696 |
98
+ | 0.103 | 52.0 | 171028 | 11.2010 |
99
+ | 0.0938 | 53.0 | 174317 | 11.6728 |
100
+ | 0.0924 | 54.0 | 177606 | 11.1423 |
101
+ | 0.0922 | 55.0 | 180895 | 11.7409 |
102
+ | 0.0827 | 56.0 | 184184 | 11.7850 |
103
+ | 0.0829 | 57.0 | 187473 | 11.8956 |
104
+ | 0.073 | 58.0 | 190762 | 11.8915 |
105
+ | 0.0788 | 59.0 | 194051 | 12.1617 |
106
+ | 0.0734 | 60.0 | 197340 | 12.2007 |
107
+ | 0.0729 | 61.0 | 200629 | 12.2388 |
108
+ | 0.0663 | 62.0 | 203918 | 12.2471 |
109
+ | 0.0662 | 63.0 | 207207 | 12.5830 |
110
+ | 0.064 | 64.0 | 210496 | 12.6105 |
111
+ | 0.0599 | 65.0 | 213785 | 12.3712 |
112
+ | 0.0604 | 66.0 | 217074 | 12.9249 |
113
+ | 0.0574 | 67.0 | 220363 | 12.7309 |
114
+ | 0.0538 | 68.0 | 223652 | 12.8068 |
115
+ | 0.0526 | 69.0 | 226941 | 13.4368 |
116
+ | 0.0471 | 70.0 | 230230 | 13.5148 |
117
+ | 0.0436 | 71.0 | 233519 | 13.3391 |
118
+ | 0.0448 | 72.0 | 236808 | 13.4100 |
119
+ | 0.0428 | 73.0 | 240097 | 13.5617 |
120
+ | 0.0401 | 74.0 | 243386 | 13.8674 |
121
+ | 0.035 | 75.0 | 246675 | 13.5746 |
122
+ | 0.0342 | 76.0 | 249964 | 13.5042 |
123
+ | 0.0344 | 77.0 | 253253 | 14.2085 |
124
+ | 0.0365 | 78.0 | 256542 | 13.6393 |
125
+ | 0.0306 | 79.0 | 259831 | 13.9807 |
126
+ | 0.0311 | 80.0 | 263120 | 13.9768 |
127
+ | 0.0353 | 81.0 | 266409 | 14.5245 |
128
+ | 0.0299 | 82.0 | 269698 | 13.9471 |
129
+ | 0.0263 | 83.0 | 272987 | 13.7899 |
130
+ | 0.0254 | 84.0 | 276276 | 14.3786 |
131
+ | 0.0267 | 85.0 | 279565 | 14.5611 |
132
+ | 0.022 | 86.0 | 282854 | 14.2658 |
133
+ | 0.0198 | 87.0 | 286143 | 14.9215 |
134
+ | 0.0193 | 88.0 | 289432 | 14.5650 |
135
+ | 0.0228 | 89.0 | 292721 | 14.7014 |
136
+ | 0.0184 | 90.0 | 296010 | 14.6946 |
137
+ | 0.0182 | 91.0 | 299299 | 14.6614 |
138
+ | 0.0188 | 92.0 | 302588 | 14.6915 |
139
+ | 0.0196 | 93.0 | 305877 | 14.7262 |
140
+ | 0.0138 | 94.0 | 309166 | 14.7625 |
141
+ | 0.0201 | 95.0 | 312455 | 15.0442 |
142
+ | 0.0189 | 96.0 | 315744 | 14.8832 |
143
+ | 0.0148 | 97.0 | 319033 | 14.8995 |
144
+ | 0.0129 | 98.0 | 322322 | 14.8974 |
145
+ | 0.0132 | 99.0 | 325611 | 14.9813 |
146
+ | 0.0139 | 100.0 | 328900 | 14.9594 |
147
+
148
+
149
+ ### Framework versions
150
+
151
+ - Transformers 4.19.2
152
+ - Pytorch 1.11.0+cu102
153
+ - Datasets 2.2.2
154
+ - Tokenizers 0.12.1