apfurman commited on
Commit
4e1f279
·
verified ·
1 Parent(s): 79943a0

Model save

Browse files
Files changed (2) hide show
  1. README.md +1 -25
  2. adapter_model.safetensors +1 -1
README.md CHANGED
@@ -6,8 +6,6 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  base_model: google/gemma-2b
9
- datasets:
10
- - generator
11
  model-index:
12
  - name: gemma-2b-dolly-qa
13
  results: []
@@ -18,9 +16,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  # gemma-2b-dolly-qa
20
 
21
- This model is a fine-tuned version of [google/gemma-2b](https://huggingface.co/google/gemma-2b) on the generator dataset.
22
- It achieves the following results on the evaluation set:
23
- - Loss: 2.0198
24
 
25
  ## Model description
26
 
@@ -50,26 +46,6 @@ The following hyperparameters were used during training:
50
  - lr_scheduler_warmup_ratio: 0.05
51
  - training_steps: 1480
52
 
53
- ### Training results
54
-
55
- | Training Loss | Epoch | Step | Validation Loss |
56
- |:-------------:|:-------:|:----:|:---------------:|
57
- | 2.918 | 1.6393 | 100 | 2.5702 |
58
- | 2.4342 | 3.2787 | 200 | 2.2747 |
59
- | 2.2482 | 4.9180 | 300 | 2.1601 |
60
- | 2.1554 | 6.5574 | 400 | 2.0971 |
61
- | 2.1022 | 8.1967 | 500 | 2.0698 |
62
- | 2.0806 | 9.8361 | 600 | 2.0544 |
63
- | 2.0651 | 11.4754 | 700 | 2.0437 |
64
- | 2.0439 | 13.1148 | 800 | 2.0359 |
65
- | 2.0369 | 14.7541 | 900 | 2.0302 |
66
- | 2.034 | 16.3934 | 1000 | 2.0263 |
67
- | 2.0249 | 18.0328 | 1100 | 2.0236 |
68
- | 2.0174 | 19.6721 | 1200 | 2.0218 |
69
- | 2.0154 | 21.3115 | 1300 | 2.0203 |
70
- | 2.0145 | 22.9508 | 1400 | 2.0198 |
71
-
72
-
73
  ### Framework versions
74
 
75
  - PEFT 0.10.0
 
6
  - sft
7
  - generated_from_trainer
8
  base_model: google/gemma-2b
 
 
9
  model-index:
10
  - name: gemma-2b-dolly-qa
11
  results: []
 
16
 
17
  # gemma-2b-dolly-qa
18
 
19
+ This model is a fine-tuned version of [google/gemma-2b](https://huggingface.co/google/gemma-2b) on an unknown dataset.
 
 
20
 
21
  ## Model description
22
 
 
46
  - lr_scheduler_warmup_ratio: 0.05
47
  - training_steps: 1480
48
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ### Framework versions
50
 
51
  - PEFT 0.10.0
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:19c7678ed7c393058c4a6cc50a627b3e8be13e836eaefc1fd5c38b94b4a8e717
3
  size 156926880
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4aab9486e68c58fdbdb93455ee42186b43e0d482e332a83f0962f6d6019976b8
3
  size 156926880