End of training
Browse files
README.md
CHANGED
@@ -15,9 +15,12 @@ model-index:
|
|
15 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
16 |
should probably proofread and complete it, then remove this comment. -->
|
17 |
|
|
|
18 |
# sft8
|
19 |
|
20 |
This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on the generator dataset.
|
|
|
|
|
21 |
|
22 |
## Model description
|
23 |
|
@@ -47,6 +50,13 @@ The following hyperparameters were used during training:
|
|
47 |
- lr_scheduler_warmup_steps: 200
|
48 |
- num_epochs: 3
|
49 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
50 |
### Framework versions
|
51 |
|
52 |
- Transformers 4.43.0.dev0
|
|
|
15 |
<!-- This model card has been generated automatically according to the information the Trainer had access to. You
|
16 |
should probably proofread and complete it, then remove this comment. -->
|
17 |
|
18 |
+
[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/stojchets/huggingface/runs/sft8)
|
19 |
# sft8
|
20 |
|
21 |
This model is a fine-tuned version of [deepseek-ai/deepseek-coder-1.3b-base](https://huggingface.co/deepseek-ai/deepseek-coder-1.3b-base) on the generator dataset.
|
22 |
+
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: 1.2180
|
24 |
|
25 |
## Model description
|
26 |
|
|
|
50 |
- lr_scheduler_warmup_steps: 200
|
51 |
- num_epochs: 3
|
52 |
|
53 |
+
### Training results
|
54 |
+
|
55 |
+
| Training Loss | Epoch | Step | Validation Loss |
|
56 |
+
|:-------------:|:-----:|:----:|:---------------:|
|
57 |
+
| 1.0923 | 2.56 | 100 | 1.2180 |
|
58 |
+
|
59 |
+
|
60 |
### Framework versions
|
61 |
|
62 |
- Transformers 4.43.0.dev0
|