Update README.md

README.md

@@ -22,12 +22,30 @@ Intended for use on a student group project for Portland State University's Wint
 
 ## Training and evaluation data
 
-More information needed
+Instruction Tuned on the creative writing dataset here: https://huggingface.co/datasets/adambjorn/UnrelatedForgettingOverhead/viewer/creative
 
 ## Training procedure
 
 Trained on a single RTX 3090 card.
 
+Given a set of prompts:
+
+```python
+prompts = [
+    "Write a creative short story based on the following title:",
+    "Here is a title for a story. Craft a short narrative around it:",
+    "Using the title given, develop a short story:",
+    "Imagine a short story that starts with this title:",
+    "Create a brief story with the following title:"
+]
+```
+
+Concatenate the prompt, the title and the story like so:
+
+```python
+concatenated_texts = [random.choice(prompts) + " " + title + "</s>" + "Story: " + selftext for title, selftext in zip(titles, selftexts)]
+```
+
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -43,10 +61,10 @@ The following hyperparameters were used during training:
 - mixed_precision_training: Native AMP
 
 ### Training results
-After final epoch:
+Final results:
 {'loss': 0.0472, 'learning_rate': 1.4893617021276598e-06, 'epoch': 4.95}
 
-After full completion
+Average results:
 {'train_runtime': 563.2707,
 'train_samples_per_second': 1.687,
 'train_steps_per_second': 0.417,