Hugging Face's logo

ospanbatyr
/
llama-2-7b-hf-ft-compact

TensorBoard
Safetensors
Generated from Trainer
Model card Files Metrics Community
ospanbatyr commited on
Commit
08765ed
•
1 Parent(s): d18f621

End of training

Browse files
Files changed (3) hide show
  1. README.md +9 -10
  2. adapter_model.safetensors +1 -1
  3. runs/Nov17_13-29-46_ai12.kuacc.ku.edu.tr/events.out.tfevents.1700216987.ai12.kuacc.ku.edu.tr.129163.1 +2 -2
README.md CHANGED
@@ -13,7 +13,7 @@ should probably proofread and complete it, then remove this comment. -->
13
 
14
  This model was trained from scratch on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
- - Loss: 4.4389
17
 
18
  ## Model description
19
 
@@ -42,20 +42,19 @@ The following hyperparameters were used during training:
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_ratio: 0.1
44
  - num_epochs: 3
45
- - mixed_precision_training: Native AMP
46
 
47
  ### Training results
48
 
49
  | Training Loss | Epoch | Step | Validation Loss |
50
  |:-------------:|:-----:|:----:|:---------------:|
51
- | 4.3974 | 0.36 | 25 | 4.4386 |
52
- | 4.4015 | 0.73 | 50 | 4.4383 |
53
- | 4.3944 | 1.09 | 75 | 4.4386 |
54
- | 4.4058 | 1.45 | 100 | 4.4386 |
55
- | 4.4428 | 1.82 | 125 | 4.4383 |
56
- | 4.4266 | 2.18 | 150 | 4.4385 |
57
- | 4.4104 | 2.55 | 175 | 4.4386 |
58
- | 4.4026 | 2.91 | 200 | 4.4389 |
59
 
60
 
61
  ### Framework versions
 
13
 
14
  This model was trained from scratch on an unknown dataset.
15
  It achieves the following results on the evaluation set:
16
+ - Loss: 0.8405
17
 
18
  ## Model description
19
 
 
42
  - lr_scheduler_type: linear
43
  - lr_scheduler_warmup_ratio: 0.1
44
  - num_epochs: 3
 
45
 
46
  ### Training results
47
 
48
  | Training Loss | Epoch | Step | Validation Loss |
49
  |:-------------:|:-----:|:----:|:---------------:|
50
+ | 3.9697 | 0.36 | 25 | 3.0220 |
51
+ | 1.1283 | 0.73 | 50 | 0.9941 |
52
+ | 0.9218 | 1.09 | 75 | 0.8991 |
53
+ | 0.8849 | 1.45 | 100 | 0.8700 |
54
+ | 0.8644 | 1.82 | 125 | 0.8561 |
55
+ | 0.8388 | 2.18 | 150 | 0.8465 |
56
+ | 0.8208 | 2.55 | 175 | 0.8417 |
57
+ | 0.8038 | 2.91 | 200 | 0.8405 |
58
 
59
 
60
  ### Framework versions
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:1742f33e7513fcc92795c255ec6453ccd0fceea44d96ac3697293e7b5183337e
3
  size 16794200
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d929eb8f0f1c0c5e71f163586f8ca1c8a5a6a7ff42663a7723679aa7c7d795ba
3
  size 16794200
runs/Nov17_13-29-46_ai12.kuacc.ku.edu.tr/events.out.tfevents.1700216987.ai12.kuacc.ku.edu.tr.129163.1 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d16de5593d96a0fb7f6d92a81ebdf3e57ca9e8d3b86e02320a04d22d26119502
3
- size 8764
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e82417710796b089b14eaf5af25fba20c11a16bf3b1563c1271ba9fb1f4bf77
3
+ size 9860