sequelbox commited on
Commit
f77a408
1 Parent(s): ae516f1

Upload folder using huggingface_hub (#3)

Browse files

- 1debed48328e60436b486811343d9425b3e9e73961f24cf5b54bdc94d0d6f284 (b98cf5f2a133df0908802c5c1ece21d9b1a3b4f9)
- e70dc896e84a1b10900177fda25bf111e0864f5e1c37cc0cd20ec8a7604b1d3f (df3d3c9f575684031146f24f371e0573765534e7)
- 9ff921a6584d2b15cd404e64c65839067d2bef4e8fe5aed7ed991c3c5b8d2610 (1552d351765c0185d933d5ea4f3b7bb23ff6e458)
- a6a7ff21ccdbf4a60d07572e261debb728cdce5efd76d03de131d71be74ffcf9 (344092187b8761741f8a0d593f78b3ee9540112e)
- Delete .ipynb_checkpoints (565e0ebdc69db70b41805d22d674295fb1ee599d)

.gitattributes CHANGED
@@ -34,3 +34,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
 
 
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
  tokenizer.json filter=lfs diff=lfs merge=lfs -text
37
+ .ipynb_checkpoints/tokenizer-checkpoint.json filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -29,6 +29,7 @@ tags:
29
  base_model: meta-llama/Llama-3.2-3B-Instruct
30
  datasets:
31
  - sequelbox/Celestia
 
32
  - sequelbox/Supernova
33
  pipeline_tag: text-generation
34
  model_type: llama
@@ -315,9 +316,9 @@ print(outputs[0]["generated_text"][-1])
315
  ## The Model
316
  Shining Valiant 2 is built on top of Llama 3.2 3b Instruct.
317
 
318
- The current version of Shining Valiant 2 is trained on technical knowledge using [sequelbox/Celestia](https://huggingface.co/datasets/sequelbox/Celestia) and general chat capability using [sequelbox/Supernova.](https://huggingface.co/datasets/sequelbox/Supernova)
319
 
320
- Our private data adds specialist knowledge and Shining Valiant's personality: she's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical. (As a general note: we're hoping to replace and open-source this part of Shining Valiant's dataset with synthetic data soon!)
321
 
322
 
323
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
 
29
  base_model: meta-llama/Llama-3.2-3B-Instruct
30
  datasets:
31
  - sequelbox/Celestia
32
+ - sequelbox/Spurline
33
  - sequelbox/Supernova
34
  pipeline_tag: text-generation
35
  model_type: llama
 
316
  ## The Model
317
  Shining Valiant 2 is built on top of Llama 3.2 3b Instruct.
318
 
319
+ The current version of Shining Valiant 2 is trained on technical knowledge using [sequelbox/Celestia](https://huggingface.co/datasets/sequelbox/Celestia), complex reasoning using [sequelbox/Spurline](https://huggingface.co/datasets/sequelbox/Spurline), and general chat capability using [sequelbox/Supernova.](https://huggingface.co/datasets/sequelbox/Supernova)
320
 
321
+ We're super excited that Shining Valiant's dataset has been fully open-sourced! She's friendly, enthusiastic, insightful, knowledgeable, and loves to learn! Magical.
322
 
323
 
324
  ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/63444f2687964b331809eb55/VCJ8Fmefd8cdVhXSSxJiD.jpeg)
config.json CHANGED
@@ -34,7 +34,7 @@
34
  "rope_theta": 500000.0,
35
  "tie_word_embeddings": true,
36
  "torch_dtype": "float32",
37
- "transformers_version": "4.45.1",
38
  "use_cache": true,
39
  "vocab_size": 128256
40
  }
 
34
  "rope_theta": 500000.0,
35
  "tie_word_embeddings": true,
36
  "torch_dtype": "float32",
37
+ "transformers_version": "4.46.1",
38
  "use_cache": true,
39
  "vocab_size": 128256
40
  }
generation_config.json CHANGED
@@ -8,5 +8,5 @@
8
  ],
9
  "temperature": 0.6,
10
  "top_p": 0.9,
11
- "transformers_version": "4.45.1"
12
  }
 
8
  ],
9
  "temperature": 0.6,
10
  "top_p": 0.9,
11
+ "transformers_version": "4.46.1"
12
  }
model-00001-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4ebb3b747d2ab6b76d0841c3a5fe6b60feb49bcb32bd340c592d54ee277e5879
3
  size 4998767360
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ab62c27196a0c7b1f593bb1e3925602f5b175088acc9e7598a9297748a5f373
3
  size 4998767360
model-00002-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:69e6bf4fa3d36b630e14645673e16aff6a03f1915c28fdd161751f35b7e54236
3
  size 4932808968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f01d12b0c45acf06e8688ed564cd6c3ca6191e98c134386be16076b052f0bf9
3
  size 4932808968
model-00003-of-00003.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:7af7c41cf54559c5a23e0327bcfb8b015e5abf1866f8cc18eb63171a10b54502
3
  size 2919452168
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f4d02ea9765d49c42d1dabdf767e17ee2632fbe6f487ad0b6a34b09ffa991ab
3
  size 2919452168