santis2 commited on
Commit
57f47e6
·
1 Parent(s): d6ba0dc

End of training

Browse files
Files changed (3) hide show
  1. README.md +13 -0
  2. adapter_model.bin +1 -1
  3. training_args.bin +1 -1
README.md CHANGED
@@ -14,6 +14,8 @@ should probably proofread and complete it, then remove this comment. -->
14
  # gpt2-alpaca-instruction-fine-tuning-lora
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
 
 
17
 
18
  ## Model description
19
 
@@ -43,6 +45,17 @@ The following hyperparameters were used during training:
43
 
44
  ### Training results
45
 
 
 
 
 
 
 
 
 
 
 
 
46
 
47
 
48
  ### Framework versions
 
14
  # gpt2-alpaca-instruction-fine-tuning-lora
15
 
16
  This model is a fine-tuned version of [gpt2](https://huggingface.co/gpt2) on an unknown dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: 1.6566
19
 
20
  ## Model description
21
 
 
45
 
46
  ### Training results
47
 
48
+ | Training Loss | Epoch | Step | Validation Loss |
49
+ |:-------------:|:-----:|:----:|:---------------:|
50
+ | 2.1138 | 0.11 | 1000 | 1.7761 |
51
+ | 1.8565 | 0.22 | 2000 | 1.7291 |
52
+ | 1.8133 | 0.33 | 3000 | 1.7039 |
53
+ | 1.8198 | 0.44 | 4000 | 1.6900 |
54
+ | 1.8024 | 0.55 | 5000 | 1.6771 |
55
+ | 1.7781 | 0.66 | 6000 | 1.6691 |
56
+ | 1.7742 | 0.77 | 7000 | 1.6626 |
57
+ | 1.7517 | 0.88 | 8000 | 1.6577 |
58
+ | 1.7566 | 0.99 | 9000 | 1.6566 |
59
 
60
 
61
  ### Framework versions
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d27ad698c01038468cf47b72a960348bf4f6be72df7102e434de79bb46408848
3
  size 6513289
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9f352df4e69658cd91e6c60af2576a5dc8b84064ffc61851b0704d78f84f2d8
3
  size 6513289
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ef03d0e5a01b90d1497b0a982136bc9c47dfd134c5fe7a312f1d28baa74682ad
3
  size 4091
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:60a43c9a70949f8b830037486d91e5e77ccaa62aaedc01ce811aff505e38a6d9
3
  size 4091