JinbiaoZhu commited on
Commit
574f815
1 Parent(s): bee3eee

End of training

Browse files
Files changed (1) hide show
  1. README.md +16 -1
README.md CHANGED
@@ -3,6 +3,8 @@ license: mit
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
  - name: finetuned-DebertaV3-eli5-askscience-TextGeneration
8
  results: []
@@ -13,7 +15,9 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  # finetuned-DebertaV3-eli5-askscience-TextGeneration
15
 
16
- This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
@@ -40,6 +44,17 @@ The following hyperparameters were used during training:
40
  - lr_scheduler_type: linear
41
  - num_epochs: 5
42
 
 
 
 
 
 
 
 
 
 
 
 
43
  ### Framework versions
44
 
45
  - Transformers 4.38.2
 
3
  base_model: microsoft/deberta-v3-base
4
  tags:
5
  - generated_from_trainer
6
+ datasets:
7
+ - eli5_category
8
  model-index:
9
  - name: finetuned-DebertaV3-eli5-askscience-TextGeneration
10
  results: []
 
15
 
16
  # finetuned-DebertaV3-eli5-askscience-TextGeneration
17
 
18
+ This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the eli5_category dataset.
19
+ It achieves the following results on the evaluation set:
20
+ - Loss: 3.4874
21
 
22
  ## Model description
23
 
 
44
  - lr_scheduler_type: linear
45
  - num_epochs: 5
46
 
47
+ ### Training results
48
+
49
+ | Training Loss | Epoch | Step | Validation Loss |
50
+ |:-------------:|:-----:|:----:|:---------------:|
51
+ | 4.9941 | 1.0 | 1034 | 4.4596 |
52
+ | 4.4026 | 2.0 | 2068 | 3.8975 |
53
+ | 4.3024 | 3.0 | 3102 | 3.6848 |
54
+ | 3.67 | 4.0 | 4136 | 3.5170 |
55
+ | 3.6813 | 5.0 | 5170 | 3.5066 |
56
+
57
+
58
  ### Framework versions
59
 
60
  - Transformers 4.38.2