End of training

README.md

@@ -1,14 +1,60 @@
 ---
 license: mit
+base_model: Aravindan/gpt2out
 tags:
 - generated_from_trainer
-base_model: Aravindan/gpt2out
 model-index:
 - name: gpt2coder-8epochs
   results: []
 ---
 
-## GPT-OUT 
-It's a coding foundation model trained on various python datasets to bring the model only for python.Pre-training is still on-going process, estimated to complete this process before end of the june month. 
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# gpt2coder-8epochs
+
+This model is a fine-tuned version of [Aravindan/gpt2out](https://huggingface.co/Aravindan/gpt2out) on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 1.9618
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 16
+- total_train_batch_size: 128
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 1
+
+### Training results
+
+| Training Loss | Epoch  | Step | Validation Loss |
+|:-------------:|:------:|:----:|:---------------:|
+| 2.4708        | 0.9998 | 703  | 1.9618          |
+
+
+### Framework versions
 
-## Contribution are welcome 😊
+- Transformers 4.41.1
+- Pytorch 2.1.2
+- Datasets 2.19.1
+- Tokenizers 0.19.1

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:efeb99fbaf67a15c9a11dfb2fc55a0f2f5b74e9433d0f47526c76f8f4887c22e
+oid sha256:4b4b66cff3d61b723ec35227e767f931b5bd89adf23a4545f6be5fd1045a29ca
 size 497774208

runs/Jun06_12-45-53_5ef05bb74077/events.out.tfevents.1717677954.5ef05bb74077.25.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1945d152bd5387bbcbcd5b5768ef4006a83436a7986ccc9487be678359910e29
+size 5930

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:9363ca53d937dbdb4298149be39434a15fbc3ad7f0392de9539f3eb2c063d52f
+oid sha256:fc50f3c61378626725d66792d95a77023eebbdc98ae2f037171fdf70df3d97c5
 size 5112