Hugging Face's logo

zelcakok
/
bert-base-squad2-uncased

Question Answering
Transformers
PyTorch
Safetensors
English
bert
Bert
SQuAD2.0
SQuAD
Inference Endpoints
Model card Files Community
1
bert-base-squad2-uncased
File size: 2,322 Bytes 
ab2dc4e
 
 
 
 
 
 
 
 
 
7532066
ab2dc4e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7f6962a
9160c66
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
d2cee2e
9160c66
7f6962a
b8e6e06
76d5729
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7532066
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
76d5729
7f6962a
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
 
---
license: mit
datasets:
- squad_v2
language:
- en
tags:
- Bert
- SQuAD2.0
- SQuAD
pipeline_tag: question-answering
---
# Extract QA Model (SQuAD2.0)

## Model Information

Pretrained model: google/bert_uncased_L-12_H-768_A-12

## Training Hyperparameters

```Python
epochs = 2
batch_size = 24
learning_rate = 3e-5

max_seq_length = 384
doc_stride = 128
max_query_length = 256
```

## Latest Result
```json
// 11 Apr 2023, 11:08 (Staging Epoch 1, total epoch 4, Correct Tokenizer)
{
    "exact": 74.43780005053483,
    "f1": 77.49749091378419,
    "total": 11873,
    "HasAns_exact": 73.73481781376518,
    "HasAns_f1": 79.86297395738177,
    "HasAns_total": 5928,
    "NoAns_exact": 75.13877207737595,
    "NoAns_f1": 75.13877207737595,
    "NoAns_total": 5945,
    "best_exact": 74.43780005053483,
    "best_exact_thresh": 0.0,
    "best_f1": 77.49749091378418,
    "best_f1_thresh": 0.0
}
```

```json
// 11 Apr 2023, 09:38 (Staging Epoch 3, total epoch 4, Correct Tokenizer)
{
    "exact": 73.99983155057694,
    "f1": 77.23749498407376,
    "total": 11873,
    "HasAns_exact": 72.85762483130904,
    "HasAns_f1": 79.3422364955984,
    "HasAns_total": 5928,
    "NoAns_exact": 75.13877207737595,
    "NoAns_f1": 75.13877207737595,
    "NoAns_total": 5945,
    "best_exact": 73.99983155057694,
    "best_exact_thresh": 0.0,
    "best_f1": 77.23749498407373,
    "best_f1_thresh": 0.0
}
```


```json
// 24 Mar 2023, 19:57 (Invalid Tokenizer)
{
    "exact": 74.12616861787248,
    "f1": 77.34212395572948,
    "total": 11873,
    "HasAns_exact": 72.72267206477733,
    "HasAns_f1": 79.16380528447645,
    "HasAns_total": 5928,
    "NoAns_exact": 75.52565180824222,
    "NoAns_f1": 75.52565180824222,
    "NoAns_total": 5945,
    "best_exact": 74.12616861787248,
    "best_exact_thresh": 0.0,
    "best_f1": 77.34212395572948,
    "best_f1_thresh": 0.0
}
```

```json
// 23 Mar 2023,  (Invalid Tokenizer)
{
    "exact": 73.77242482944496,
    "f1": 76.83752039897598,
    "total": 11873,
    "HasAns_exact": 71.72739541160594,
    "HasAns_f1": 77.86637646711235,
    "HasAns_total": 5928,
    "NoAns_exact": 75.81160639192599,
    "NoAns_f1": 75.81160639192599,
    "NoAns_total": 5945,
    "best_exact": 73.77242482944496,
    "best_exact_thresh": 0.0,
    "best_f1": 76.83752039897604,
    "best_f1_thresh": 0.0
}
```