datarpit commited on
Commit
57b4d4a
1 Parent(s): ed3a81f

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +19 -17
README.md CHANGED
@@ -2,6 +2,8 @@
2
  license: apache-2.0
3
  tags:
4
  - generated_from_trainer
 
 
5
  model-index:
6
  - name: distilbert-base-uncased-finetuned-natural-questions
7
  results: []
@@ -12,9 +14,9 @@ should probably proofread and complete it, then remove this comment. -->
12
 
13
  # distilbert-base-uncased-finetuned-natural-questions
14
 
15
- This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
16
  It achieves the following results on the evaluation set:
17
- - Loss: 0.3516
18
 
19
  ## Model description
20
 
@@ -34,8 +36,8 @@ More information needed
34
 
35
  The following hyperparameters were used during training:
36
  - learning_rate: 2e-05
37
- - train_batch_size: 16
38
- - eval_batch_size: 16
39
  - seed: 42
40
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
41
  - lr_scheduler_type: linear
@@ -43,23 +45,23 @@ The following hyperparameters were used during training:
43
 
44
  ### Training results
45
 
46
- | Training Loss | Epoch | Step | Validation Loss |
47
- |:-------------:|:-----:|:------:|:---------------:|
48
- | No log | 1.0 | 20415 | 0.2347 |
49
- | No log | 2.0 | 40830 | 0.2269 |
50
- | 1.885 | 3.0 | 61245 | 0.2441 |
51
- | 1.885 | 4.0 | 81660 | 0.2316 |
52
- | 1.5134 | 5.0 | 102075 | 0.2618 |
53
- | 1.5134 | 6.0 | 122490 | 0.2609 |
54
- | 1.5134 | 7.0 | 142905 | 0.2865 |
55
- | 1.1608 | 8.0 | 163320 | 0.3046 |
56
- | 1.1608 | 9.0 | 183735 | 0.3372 |
57
- | 0.9118 | 10.0 | 204150 | 0.3516 |
58
 
59
 
60
  ### Framework versions
61
 
62
  - Transformers 4.17.0
63
  - Pytorch 1.10.0
64
- - Datasets 1.18.3
65
  - Tokenizers 0.11.6
 
2
  license: apache-2.0
3
  tags:
4
  - generated_from_trainer
5
+ datasets:
6
+ - natural_questions
7
  model-index:
8
  - name: distilbert-base-uncased-finetuned-natural-questions
9
  results: []
 
14
 
15
  # distilbert-base-uncased-finetuned-natural-questions
16
 
17
+ This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the natural_questions dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.3083
20
 
21
  ## Model description
22
 
 
36
 
37
  The following hyperparameters were used during training:
38
  - learning_rate: 2e-05
39
+ - train_batch_size: 64
40
+ - eval_batch_size: 64
41
  - seed: 42
42
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
43
  - lr_scheduler_type: linear
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:-----:|:---------------:|
50
+ | 2.0532 | 1.0 | 5104 | 0.2393 |
51
+ | 1.8912 | 2.0 | 10208 | 0.2284 |
52
+ | 1.7854 | 3.0 | 15312 | 0.2357 |
53
+ | 1.6856 | 4.0 | 20416 | 0.2487 |
54
+ | 1.5918 | 5.0 | 25520 | 0.2743 |
55
+ | 1.5067 | 6.0 | 30624 | 0.2586 |
56
+ | 1.4323 | 7.0 | 35728 | 0.2763 |
57
+ | 1.365 | 8.0 | 40832 | 0.2753 |
58
+ | 1.3162 | 9.0 | 45936 | 0.3200 |
59
+ | 1.281 | 10.0 | 51040 | 0.3083 |
60
 
61
 
62
  ### Framework versions
63
 
64
  - Transformers 4.17.0
65
  - Pytorch 1.10.0
66
+ - Datasets 1.18.4
67
  - Tokenizers 0.11.6