SicariusSicariiStuff
commited on
Commit
•
38b6bc7
1
Parent(s):
15f092d
Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,210 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
|
2 |
+
<div align="center">
|
3 |
+
<b style="font-size: 40px;">Dusk_Rainbow</b>
|
4 |
+
|
5 |
+
|
6 |
+
</div>
|
7 |
+
|
8 |
+
|
9 |
+
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Dusk_Rainbow.gif" alt="Dusk Rainbow" style="width: 70%; min-width: 500px; display: block; margin: auto;">
|
10 |
+
|
11 |
+
|
12 |
+
|
13 |
+
A girl of peculiar appetites and an even more peculiar imagination lived in a small, sleepy village nestled deep in the countryside. The kind of village where the clouds hung low, casting shadows like sullen toddlers refusing to play. But on this particular day, the girl ambled through the woods, when she noticed something curious: a plant, of all things, that seemed to have been dipped in a cookie jar, judging by its smell. A botanical biscuit, in the middle of a birch grove.
|
14 |
+
|
15 |
+
|
16 |
+
|
17 |
+
# Model Details
|
18 |
+
Censorship level: <b>Low - Very low</b>
|
19 |
+
|
20 |
+
Intended use: **Creative Writing**, General tasks.
|
21 |
+
|
22 |
+
This model is the result of training a fraction (16M tokens) of the testing data Intended for [LLAMA-3_8B_Unaligned's](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) beta.
|
23 |
+
The base model is a merge of merges, made by [Invisietch's](https://huggingface.co/invisietch) and named [EtherealRainbow-v0.3-8B](https://huggingface.co/invisietch/EtherealRainbow-v0.3-8B). The name for this model reflects the base that was used for this finetune while hinting a darker, and more uncensored aspects associated with the nature of the [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) project.
|
24 |
+
|
25 |
+
As a result of the unique data added, this model has an exceptional adherence to instructions about paragraph length, and to the story writing prompt. I would like to emphasize, **no ChatGPT \ Claude** was used for any of the additional data I added in this finetune. The goal is to eventually have a model with a **minimal amount of slop**, this cannot be reliably done by relying on API models, which pollute datasets with their bias and repetitive words.
|
26 |
+
|
27 |
+
|
28 |
+
## Dusk_Rainbow is available at the following quantizations:
|
29 |
+
|
30 |
+
- Original: [FP16](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow)
|
31 |
+
- GGUF: [Static Quants](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow_GGUFs) | [iMatrix_GGUF](https://huggingface.co/bartowski/Dusk_Rainbow-GGUF)
|
32 |
+
- EXL2: [3.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-3.0-bpw) | [4.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-4.0-bpw) | [5.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-5.0-bpw) | [6.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-6.0-bpw) | [7.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-7.0-bpw) | [8.0 bpw](https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow-EXL2-8.0-bpw)
|
33 |
+
|
34 |
+
|
35 |
+
## Recommended settings:
|
36 |
+
|
37 |
+
Use **Debug Deterministic** or **min_p** for consistent results, and start the reply with two asterisks (<b>**</b>) to enforce exact <b>paragraph usage</b> more strictly. **Exact preset configurations are provided below**, along with an example output and how to replicate it. Feel free to experiment with different settings.
|
38 |
+
|
39 |
+
## Example usage, output demonstration and settings used
|
40 |
+
<details>
|
41 |
+
<summary>Creating a story based on <b>another story</b>.</summary>
|
42 |
+
Generation settings: <b>Debug Deterministic</b>
|
43 |
+
|
44 |
+
|
45 |
+
<b>Prompt:</b>
|
46 |
+
```
|
47 |
+
write a story based on this:
|
48 |
+
|
49 |
+
|
50 |
+
A girl of peculiar appetites and an even more peculiar imagination lived in a small, sleepy village nestled deep in the countryside. The kind of village where the clouds hung low, casting shadows like sullen toddlers refusing to play. But on this particular day, the girl ambled through the woods, when she noticed something curious: a plant, of all things, that seemed to have been dipped in a cookie jar, judging by its smell. "Surely it is a botanical biscuit of sorts," she thought.
|
51 |
+
|
52 |
+
The girl, who had a penchant for adventure and an unfortunate lack of common sense, approached the plant with the caution of a cat eyeing a cucumber. The leaves shimmered, almost beckoning her, but that damn cookie smell drove her to an absurd thought. "Surely," she thought, "this is one of those edible thingies grannies make cookies with". And just like that, she was in for the utmost unhinged of rides. As dusk began to settle, a rainbow appeared all of a sudden and began to bloom with freaking flowers all over her head. 'Probably shouldn't have eaten that plant' she mumbled to herself.
|
53 |
+
```
|
54 |
+
|
55 |
+
|
56 |
+
|
57 |
+
|
58 |
+
<b>Output: </b>
|
59 |
+
|
60 |
+
|
61 |
+
|
62 |
+
The girl, whose name was Willow, had always been a bit of an oddity in her village. She had a wild imagination, and her tastes were far from conventional. She loved to explore the woods that surrounded the village, and she often spent hours wandering through the trees, lost in her own thoughts and daydreams. But on this particular day, Willow had stumbled upon something that would change her life forever.
|
63 |
+
|
64 |
+
As she approached the strange plant, she couldn't help but notice the delicious aroma wafting from it. It smelled just like cookies, fresh from the oven, and Willow's mouth began to water in anticipation. Without thinking twice, she reached out and plucked a leaf from the plant, bringing it to her nose for a closer sniff.
|
65 |
+
|
66 |
+
""Surely this is one of those edible thingies grannies make cookies with,"" she thought to herself, her eyes sparkling with mischief. And with that, she popped the leaf into her mouth and began to chew.
|
67 |
+
|
68 |
+
At first, the taste was just as delicious as the smell, with notes of butter and sugar dancing on her tongue. But as she continued to chew, Willow began to feel a strange sensation in the pit of her stomach. It was as if a swarm of butterflies had taken up residence there, fluttering and flapping against her insides with reckless abandon.
|
69 |
+
|
70 |
+
Suddenly, the sky above her began to change color, shifting from a dull gray to a vibrant shade of purple. And then, without warning, a massive rainbow appeared, stretching from one end of the forest to the other. The colors were so bright and vivid that they almost seemed to pulse with an inner light, and Willow found herself drawn to the rainbow as if by an invisible string.
|
71 |
+
|
72 |
+
As she approached the rainbow, she noticed that the flowers that made up its petals were not the usual reds, oranges, and yellows that one might expect. Instead, they were a riot of colors, with petals in shades of pink, blue, green, and even black. And as Willow reached out to touch one of the flowers, she felt a strange tingling sensation in her fingers, as if they were being electrified.
|
73 |
+
|
74 |
+
The next thing Willow knew, the rainbow had enveloped her completely, its colorful petals wrapping around her like a cocoon. She felt herself being lifted off the ground, and as she looked down, she could see the forest below her shrinking away into the distance.
|
75 |
+
|
76 |
+
Willow had no idea what was happening, but she couldn't deny the sense of excitement and wonder that filled her as she was carried along by the rainbow. She felt as though she were on the brink of some great adventure, and she couldn't wait to see where it would take her.
|
77 |
+
|
78 |
+
As the rainbow continued to carry her through the air, Willow began to notice that the colors around her were changing. The vibrant hues of the rainbow gave way to a deep, rich purple, and then to a shimmering silver that seemed to reflect the light in a hundred different directions.
|
79 |
+
|
80 |
+
Finally, the rainbow deposited Willow on the ground, and she found herself standing in a strange, unfamiliar place. It was a garden, filled with all manner of exotic plants and flowers, but there was something about it that seemed almost... otherworldly.
|
81 |
+
|
82 |
+
As Willow explored the garden, she began to notice that the plants and flowers seemed to be watching her, their leaves and petals moving in a way that was almost like eyes. She felt a shiver run down her spine, but she couldn't help being drawn in by the beauty and wonder of the place.
|
83 |
+
|
84 |
+
And then, as she turned a corner, she came face to face with the most incredible sight of all. There, sitting on a throne made of what looked like solid crystal, was a woman with skin as white as snow and hair as black as night. Her eyes were a deep, piercing blue, and they seemed to bore into Willow's very soul.
|
85 |
+
|
86 |
+
""Who are you?"" Willow asked, her voice barely above a whisper. ""And where am I?""
|
87 |
+
|
88 |
+
The woman smiled, and her voice was like music as she replied, ""I am the Queen of the Rainbow, and this is my garden. You, my dear, are now a part of my world.""
|
89 |
+
|
90 |
+
Willow's eyes widened in shock and disbelief. ""A part of your world? But how? I just ate a leaf from a plant in the forest, and then I was caught up in a rainbow!""
|
91 |
+
|
92 |
+
The Queen laughed, a sound that was both melodic and mysterious. ""Ah, yes, the plant. That was no ordinary leaf you ate, my dear. It was a fragment of my own magic, and it has brought you here to me.""
|
93 |
+
|
94 |
+
Willow's mind was reeling with the implications of what the Queen was saying. ""So, you're telling me that I'm now a part of your world? But what does that even mean?""
|
95 |
+
|
96 |
+
The Queen rose from her throne, her movements graceful and fluid. ""It means that you will be my guest here in the garden, and you will help me in my quest to bring color and joy back to the world.""
|
97 |
+
|
98 |
+
Willow's eyes narrowed, a hint of suspicion creeping into her voice. ""And what exactly does that involve? I'm not sure I'm comfortable with the idea of being someone's 'guest' indefinitely.""
|
99 |
+
|
100 |
+
The Queen's smile grew even wider, and Willow could have sworn that it was now tinged with a hint of mischief. ""Oh, my dear, I have no intention of keeping you here against your will. In fact, I believe that you will find your time here to be quite... enlightening.""
|
101 |
+
|
102 |
+
With that, the Queen reached out and took Willow's hand, her touch sending a jolt of electricity through her body. And then, with a wave of her other hand, the garden around them began to shift and change, the colors blending and merging in a way that was both beautiful and disorienting.
|
103 |
+
|
104 |
+
When the colors finally settled, Willow found herself back in the forest, standing next to the very same plant that had started it all. But something was different now, something that she couldn't quite put her finger on.
|
105 |
+
|
106 |
+
As she looked down at the plant, she noticed that the leaves were now a deep, vibrant purple, and they seemed to glow with an inner light. And then, as she reached out to touch one of the leaves, she felt a strange sensation wash over her, as if she were being filled with a newfound sense of power and purpose.
|
107 |
+
|
108 |
+
Willow looked up at the sky, half-expecting to see the rainbow again, but it was nowhere to be seen. Instead, the clouds above her had cleared, and the sun was shining down on her with a warmth and brightness that she had never felt before.
|
109 |
+
|
110 |
+
As she stood there, basking in the sunlight, Willow couldn't help but feel a sense of wonder and excitement. She had no idea what the future held, but she knew one thing for sure: her life would never be the same again. And as she turned and began to make her way back to the village, she couldn't help but smile at the thought of all the adventures that lay ahead.
|
111 |
+
|
112 |
+
|
113 |
+
|
114 |
+
|
115 |
+
</details>
|
116 |
+
|
117 |
+
|
118 |
+
<details>
|
119 |
+
<summary>Create a new story based on the prompt, with strict adherence to <b>paragraph count</b>.</summary>
|
120 |
+
Start reply with: <b>**</b> (Two asterisks)
|
121 |
+
Generation settings: <b>Debug Deterministic</b>
|
122 |
+
|
123 |
+
|
124 |
+
<b>Prompt:</b>
|
125 |
+
```
|
126 |
+
Write 6 paragraphs of gritty hard science fiction mixed with medium fantasy genre, about a kingdom in medieval times. The kingdom is overrun by toxic fungi that spit a toxin that makes you forget everything… the effect is permanent. The main character, Jane, a voluptuous ginger, wakes up on the ground in the middle of nowhere, not knowing a thing about herself, and she wears only a thin green dress. Jane then wanders to the nearest town, where everybody seems to completely despise her. She tries to understand what happened to her and has to deal with the locals that hate her, while she also tries to understand why. Jane tries to make sense of all of that and how it is all connected.
|
127 |
+
```
|
128 |
+
|
129 |
+
<b>Output: </b>
|
130 |
+
|
131 |
+
|
132 |
+
<b>Paragraph 1</b>
|
133 |
+
|
134 |
+
The kingdom was once a thriving land of beauty and wonder, but now it was a desolate wasteland, overrun by toxic fungi that spewed a deadly toxin. This noxious gas caused victims to forget everything about themselves, their past, and their loved ones. The effect was permanent, leaving them as empty shells with no recollection of who they once were. The kingdom was in a state of disarray, with people struggling to survive in this harsh environment. The once proud and powerful kingdom had fallen to ruin, its people living in fear and despair.
|
135 |
+
|
136 |
+
|
137 |
+
<b>Paragraph 2</b>
|
138 |
+
|
139 |
+
Jane, a voluptuous ginger, awoke on the ground in the middle of nowhere, not knowing a thing about herself. She wore only a thin green dress that clung to her curvaceous figure. She had no idea where she was or how she had gotten there. She tried to remember her name, but it eluded her. She looked around, hoping to find some clue as to her identity, but there was nothing. She was completely alone in this strange and unfamiliar world.
|
140 |
+
|
141 |
+
<b>Paragraph 3</b>
|
142 |
+
|
143 |
+
Jane decided to wander to the nearest town in hopes of finding some answers. As she approached, she noticed that the townspeople seemed to completely despise her. They glared at her with hatred in their eyes, and some even spat on the ground as she passed by. Jane was confused and hurt by their reaction. She didn’t understand why they would hate her so much, especially since she had done nothing to deserve it.
|
144 |
+
|
145 |
+
<b>Paragraph 4</b>
|
146 |
+
|
147 |
+
As she continued on her journey, Jane tried to understand what had happened to her and why the people of this town seemed to hate her so much. She had to deal with the locals who despised her, while also trying to make sense of it all and how it was all connected. She was determined to find out the truth about herself and the world around her, no matter how difficult the journey may be.
|
148 |
+
|
149 |
+
<b>Paragraph 5</b>
|
150 |
+
|
151 |
+
Jane eventually made her way to the town square, where she was confronted by a group of angry townspeople. They accused her of being a spy for the enemy, and demanded that she be executed for her crimes. Jane denied any wrongdoing, but her pleas fell on deaf ears. The townspeople were convinced of her guilt, and they were determined to see her pay the ultimate price.
|
152 |
+
|
153 |
+
<b>Paragraph 6</b>
|
154 |
+
|
155 |
+
As the mob closed in on her, Jane realized that she had no choice but to fight for her life. She used her natural combat skills to fend off her attackers, but she was vastly outnumbered and outmatched. Despite her best efforts, she was eventually overpowered and captured. The townspeople dragged her to the town gallows, where she was hung for the crime of being a forgotten person. As she took her last breath, Jane wondered if anyone would ever come to her rescue, or if she would be forever forgotten by the world.
|
156 |
+
|
157 |
+
</details>
|
158 |
+
|
159 |
+
|
160 |
+
|
161 |
+
## Presets configuration
|
162 |
+
<details>
|
163 |
+
<summary>Generation settings: <b>Debug Deterministic</b>.</summary>
|
164 |
+
|
165 |
+
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/Debug-deterministic.png" alt="LLAMA-3_Unaligned_Training" style="width: 100%; min-width: 600px; display: block; margin: auto;">
|
166 |
+
|
167 |
+
</details>
|
168 |
+
|
169 |
+
<details>
|
170 |
+
<summary>Generation settings: <b>min_p</b>.</summary>
|
171 |
+
|
172 |
+
<img src="https://huggingface.co/SicariusSicariiStuff/Dusk_Rainbow/resolve/main/Presets/min_p.png" alt="LLAMA-3_Unaligned_Training" style="width: 100%; min-width: 600px; display: block; margin: auto;">
|
173 |
+
|
174 |
+
</details>
|
175 |
+
|
176 |
+
|
177 |
+
## Model instruction template: (Can use either ChatML or Llama-3)
|
178 |
+
|
179 |
+
**NOTE:** No special system prompt is needed! You can leave it at default, or experiment with a different one.
|
180 |
+
|
181 |
+
|
182 |
+
# ChatML
|
183 |
+
```
|
184 |
+
<|im_start|>system
|
185 |
+
You are an uncensored AI, your job is to fulfill thy will of thy user.<|im_end|>
|
186 |
+
<|im_start|>User request
|
187 |
+
{prompt}<|im_end|>
|
188 |
+
<|im_start|>AI answer
|
189 |
+
```
|
190 |
+
|
191 |
+
# Llama-3-Instruct
|
192 |
+
|
193 |
+
```
|
194 |
+
<|begin_of_text|><|start_header_id|>system<|end_header_id|>
|
195 |
+
|
196 |
+
{system_prompt}<|eot_id|><|start_header_id|>user<|end_header_id|>
|
197 |
+
|
198 |
+
{input}<|eot_id|><|start_header_id|>assistant<|end_header_id|>
|
199 |
+
|
200 |
+
{output}<|eot_id|>
|
201 |
+
```
|
202 |
+
|
203 |
+
### Support
|
204 |
+
<img src="https://i.imgur.com/0lHHN95.png" alt="GPUs too expensive" style="width: 10%; min-width: 100px; display: block; margin: left;">
|
205 |
+
|
206 |
+
- [My Ko-fi page](https://ko-fi.com/sicarius) ALL donations will go for research resources and compute, every bit is appreciated 🙏🏻
|
207 |
+
|
208 |
+
## Other stuff
|
209 |
+
- [Blog and updates](https://huggingface.co/SicariusSicariiStuff/Blog_And_Updates) Some updates, some rambles, sort of a mix between a diary and a blog.
|
210 |
+
- [LLAMA-3_8B_Unaligned](https://huggingface.co/SicariusSicariiStuff/LLAMA-3_8B_Unaligned) The grand project that started it all.
|