a07eaacd0b1d1c9f76f41f92fd5a1e195b3d1393bab6b71d520712d56a266845

README.md

@@ -15,10 +15,21 @@ tags:
 - llama-3-instruct
 - llama-3-instruct-8b
 - 8b
+- science
+- physics
+- biology
+- chemistry
+- compsci
+- computer-science
+- engineering
+- technical
 - conversational
 - chat
 - instruct
 base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
+datasets:
+- sequelbox/Celestia
+- sequelbox/Supernova
 model_type: llama
 license: llama3.1
 ---
@@ -29,14 +40,16 @@ license: llama3.1
 
 Shining Valiant 2 is a chat model built on Llama 3.1 8b, finetuned on our data for friendship, insight, knowledge and enthusiasm.
   - Finetuned on [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct) for best available general performance
-  - Trained on our data, focused on science, engineering, technical knowledge, and structured reasoning
+  - Trained on a variety of high quality data; focused on science, engineering, technical knowledge, and structured reasoning
 
 
 ## Version
 
-This is the **2024-08-06** release of Shining Valiant 2 for Llama 3.1 8b.
+This is the **2024-09-16** release of Shining Valiant 2 for Llama 3.1 8b.
 
-Our newest dataset improves specialist knowledge and response consistency.
+We've improved and open-sourced our new baseline [science-instruct dataset](https://huggingface.co/datasets/sequelbox/Celestia). This release features improvements in physics, chemistry, biology, and computer science.
+
+Future upgrades will continue to expand Shining Valiant's technical knowledge base.
 
 Help us and recommend Shining Valiant 2 to your friends!
 
@@ -73,9 +86,9 @@ print(outputs[0]["generated_text"][-1])
 ## The Model
 Shining Valiant 2 is built on top of Llama 3.1 8b Instruct.
 
-The current version of Shining Valiant 2 is trained mostly on our private Shining Valiant data, supplemented by [LDJnr/Pure-Dove](https://huggingface.co/datasets/LDJnr/Pure-Dove) for response flexibility.
+The current version of Shining Valiant 2 is trained on technical knowledge using [sequelbox/Celestia](https://huggingface.co/datasets/sequelbox/Celestia) and general chat capability using [sequelbox/Supernova.](https://huggingface.co/datasets/sequelbox/Supernova)
 
-Our private data adds specialist knowledge and Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical.
+Our private data adds specialist knowledge and Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical. (As a general note: we're hoping to replace and open-source this part of Shining Valiant's dataset with synthetic data soon!)
 
 
 ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)

config.json

@@ -33,7 +33,7 @@
   "rope_theta": 500000.0,
   "tie_word_embeddings": false,
   "torch_dtype": "float32",
-  "transformers_version": "4.43.4",
+  "transformers_version": "4.44.2",
   "use_cache": true,
   "vocab_size": 128256
 }

generation_config.json

@@ -8,5 +8,5 @@
   ],
   "temperature": 0.6,
   "top_p": 0.9,
-  "transformers_version": "4.43.4"
+  "transformers_version": "4.44.2"
 }

tokenizer.json

@@ -1,11 +1,6 @@
 {
   "version": "1.0",
-  "truncation": {
-    "direction": "Right",
-    "max_length": 6900,
-    "strategy": "LongestFirst",
-    "stride": 0
-  },
+  "truncation": null,
   "padding": null,
   "added_tokens": [
     {