Update README.md

README.md

@@ -12,7 +12,25 @@ tags:
 base_model: unsloth/llama-3-8b-bnb-4bit
 ---
 
-# Early Checkpoint of a Work in Progress, please wait
+# This is not an official SOLAR Model from Upstage, it's just my attempt at a recreation of these powerful models using the new Llama-3
+
+Where the SOLAR Model used a mix of these datasets:
+
+- c-s-ale/alpaca-gpt4-data (SFT)
+- Open-Orca/OpenOrca (SFT)
+- in-house generated data utilizing Metamath [2] (SFT, DPO)
+- Intel/orca_dpo_pairs (DPO)
+- allenai/ultrafeedback_binarized_cleaned (DPO)
+
+I Used:
+
+- llm-wizard/alpaca-gpt4-data
+
+- Crystalcareai/slimorca-dedup-alpaca-100k
+
+- meta-math/MetaMathQA
+
+- (DPO Models Coming  Soon)
 
 - **Developed by:** cookinai
 - **License:** apache-2.0