EdBerg/outputs4

README.md

@@ -1,60 +1,57 @@
 ---
-library_name: peft
-license: llama3
 base_model: meta-llama/Meta-Llama-3-8B-Instruct
+library_name: transformers
+model_name: outputs4
 tags:
+- generated_from_trainer
 - trl
 - sft
-- generated_from_trainer
-model-index:
-- name: outputs4
-  results: []
+licence: license
 ---
 
-<!-- This model card has been generated automatically according to the information the Trainer had access to. You
-should probably proofread and complete it, then remove this comment. -->
-
-# outputs4
-
-This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct) on an unknown dataset.
-
-## Model description
+# Model Card for outputs4
 
-More information needed
+This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct).
+It has been trained using [TRL](https://github.com/huggingface/trl).
 
-## Intended uses & limitations
+## Quick start
 
-More information needed
+```python
+from transformers import pipeline
 
-## Training and evaluation data
-
-More information needed
+question = "If you had a time machine, but could only go to the past or the future once and never return, which would you choose and why?"
+generator = pipeline("text-generation", model="EdBerg/outputs4", device="cuda")
+output = generator([{"role": "user", "content": question}], max_new_tokens=128, return_full_text=False)[0]
+print(output["generated_text"])
+```
 
 ## Training procedure
 
-### Training hyperparameters
+[<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/harpermia882/huggingface/runs/lwtdy8ey)
+
+This model was trained with SFT.
 
-The following hyperparameters were used during training:
-- learning_rate: 0.0002
-- train_batch_size: 1
-- eval_batch_size: 8
-- seed: 42
-- gradient_accumulation_steps: 4
-- total_train_batch_size: 4
-- optimizer: Use paged_adamw_8bit with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
-- lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 2
-- training_steps: 2000
-- mixed_precision_training: Native AMP
+### Framework versions
 
-### Training results
+- TRL: 0.12.0
+- Transformers: 4.46.1
+- Pytorch: 2.5.0+cu121
+- Datasets: 3.1.0
+- Tokenizers: 0.20.1
 
+## Citations
 
 
-### Framework versions
 
-- PEFT 0.13.3.dev0
-- Transformers 4.46.1
-- Pytorch 2.5.0+cu121
-- Datasets 3.0.2
-- Tokenizers 0.20.1
+Cite TRL as:
+    
+```bibtex
+@misc{vonwerra2022trl,
+	title        = {{TRL: Transformer Reinforcement Learning}},
+	author       = {Leandro von Werra and Younes Belkada and Lewis Tunstall and Edward Beeching and Tristan Thrush and Nathan Lambert and Shengyi Huang and Kashif Rasul and Quentin Gallouédec},
+	year         = 2020,
+	journal      = {GitHub repository},
+	publisher    = {GitHub},
+	howpublished = {\url{https://github.com/huggingface/trl}}
+}
+```

adapter_config.json

@@ -21,13 +21,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
-    "v_proj",
-    "up_proj",
     "k_proj",
     "o_proj",
+    "q_proj",
+    "down_proj",
+    "up_proj",
     "gate_proj",
-    "down_proj"
+    "v_proj"
   ],
   "task_type": "CAUSAL_LM",
   "use_dora": false,

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:d575391d318a8faae70ca2c8643382d3ef778bf97e7b5d6e06c1f4e534228c17
+oid sha256:6d3d224ace6e068a0cc01676ade4ecdff25487716c46c39ed68a6c3985e77506
 size 83945296

runs/Nov03_12-45-23_83b6b7a2b296/events.out.tfevents.1730637925.83b6b7a2b296.276.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:124be3d5a30a93f1f06d1bc1c51515c1ac71f20eb49495183adb5d67173224d4
+size 216734

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:14c26ffde9a9345d6ba285a5bce2d54f2312c4e8efb714bd93fab217940e9f15
+oid sha256:3d20b0521e765cab269f15515ab5d118472e9a12548b083709486dd7e02fa6ab
 size 5496