stojchet commited on
Commit
7ae3c96
1 Parent(s): 45b1aa7

End of training

Browse files
Files changed (1) hide show
  1. README.md +10 -0
README.md CHANGED
@@ -15,9 +15,12 @@ model-index:
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
 
18
  # sft8
19
 
20
  This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on the generator dataset.
 
 
21
 
22
  ## Model description
23
 
@@ -47,6 +50,13 @@ The following hyperparameters were used during training:
47
  - lr_scheduler_warmup_steps: 200
48
  - num_epochs: 3
49
 
 
 
 
 
 
 
 
50
  ### Framework versions
51
 
52
  - Transformers 4.43.0.dev0
 
15
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
16
  should probably proofread and complete it, then remove this comment. -->
17
 
18
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/stojchets/huggingface/runs/sft8)
19
  # sft8
20
 
21
  This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on the generator dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 1.2180
24
 
25
  ## Model description
26
 
 
50
  - lr_scheduler_warmup_steps: 200
51
  - num_epochs: 3
52
 
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss |
56
+ |:-------------:|:-----:|:----:|:---------------:|
57
+ | 1.0923 | 2.56 | 100 | 1.2180 |
58
+
59
+
60
  ### Framework versions
61
 
62
  - Transformers 4.43.0.dev0