license: apache-2.0
language:
- en
- fr
- de
- es
- it
- pt
- zh
- ja
- ru
- ko
tags:
- creative
- creative writing
- fiction writing
- plot generation
- sub-plot generation
- fiction writing
- story generation
- scene continue
- storytelling
- fiction story
- science fiction
- romance
- all genres
- story
- writing
- vivid prosing
- vivid writing
- fiction
- roleplaying
- bfloat16
- role play
- 128k context
- llama3.2
pipeline_tag: text-generation
(quants uploading, one example output below, with more examples to be added)
Llama-3.2-3B-Instruct-NEO-SI-FI-GGUF
It is the new "Llama-3.2-3B-Instruct", max context of 131,000 (128k) with the NEO IMATRIX Science Fiction and Story dataset.
The power in this 3B (for its size) is frankly jaw dropping... and at 90 tokens per second + on a GPU.
This model IS bullet proof and operates with all parameters, including temp settings from 0 to 5.
The NEO IMATRIX dataset V2 was applied to it to enhance creativity. (see several examples below)
Model Template:
This is a LLAMA 3.2 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 128k.
If you use "Command-R" template your output will be very different from using "Llama3" template.
Here is the standard LLAMA3 template:
{
"name": "Llama 3",
"inference_params": {
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
"pre_prompt_suffix": "<|eot_id|>",
"antiprompt": [
"<|start_header_id|>",
"<|eot_id|>"
]
}
}
Please refer to the original model card for this model from Meta-Llama for additional details on operation.
[ https://huggingface.co/meta-llama/Llama-3.2-3B-Instruct ]
Imatrix Notes:
Imatrix quants perform best at IQ3s and IQ4s, then Q4s, lower on Q5, and tappers off at Q6.
Recommend: IQ4_XS for maximum imatrix effect and best "bit count".
For stronger IMATRIX effect, IQ3s, and IQ2s.
Due to the parameter count of this model, even IQ2s quants will work very well.
Q8 is not uploaded here because Imatrix has no effect on this quant.
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Example generations at TEMP = .8, IQ4_XS, REP PEN 1.1
Below are the least creative outputs, prompt is in BOLD.
WARNING: MAYBE... NSFW. Vivid prose. Visceral Details. Violence. HORROR. Swearing. UNCENSORED.
Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman.
Story idea: In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.
I sprint through the crowded marketplace, dodging shoppers and merchants as I weave between stalls selling everything from fresh produce to smuggled goods. My eyes scan the crowd, searching for any sign of trouble. We've had reports of increased patrols in the area, and I know the authorities are cracking down on dissent.
My hand instinctively goes to the small pistol holstered at my waist. I've been training with our rebel cell's security team since I was a teenager, and I'm confident in my ability to defend myself. But I'd rather not have to use it today.
As I navigate through the throng of people, I catch sight of my friend, Jax, standing by a fruit stand. He nods at me discreetly, his eyes darting towards the crowd. We've agreed on a meeting spot, but we need to be careful – if the authorities are watching, they might not hesitate to arrest us both.
"Jax!" I call out, pushing my way through the crowd, "What's going on?"
He glances around nervously before leaning in close. "I got a message from Arin," he whispers, his voice barely audible over the din of the market. "She said the plan is moving forward."
My heart skips a beat. Arin is our leader, and her plans are always carefully considered. If she's decided to proceed, it means we're getting close to something big.
"What does she want us to do?" I ask, scanning the crowd for any signs of trouble.
"She wants us to meet at the old clock tower tonight," Jax replies, his eyes locked on mine. "She'll give us more details then."
I nod, my mind racing with possibilities. The clock tower is a risk – if we're caught, it's likely we'll be beaten or worse. But we can't afford not to take this chance.
As I continue through the crowd, I notice a figure standing at the edge of the market, watching me. My instincts scream warning, but my training kicks in and I keep moving forward, trying to appear nonchalant.
The figure doesn't move, but their eyes never leave mine. It's unnerving, like they're waiting for something to happen.
I push through the crowd, weaving between stalls and shoppers, until I'm out of sight of our would-be watcher. Only then do I dare to glance back over my shoulder.
The figure is gone.
My heart still racing, I make my way to a small café on the outskirts of the market. I've arranged for Jax and Arin to meet me there, and I know it's time to lay low for a while. We can't risk being caught in public if we're spotted by the authorities.
As I push open the door to the café, I'm greeted by the warm aroma of freshly brewed coffee and the hum of quiet conversation. Jax is already seated at a small table near the back, nursing a cup of black coffee.
I slide into the seat across from him, my eyes scanning the room for any signs of trouble. The patrons are mostly locals, sipping their drinks or typing away on their laptops. We're safe here, for now.
"Any word from Arin?" I ask Jax, trying to keep my voice low.
He shakes his head, his eyes locked on mine. "Not yet," he says quietly. "But she's getting ready."
I feel a surge of excitement mixed with fear. What does that mean? Is this the moment we've been waiting for?
As I sit there, sipping my own coffee and trying to calm down, a sudden commotion erupts outside. Shouts and screams echo through the market, followed by the sound of clashing metal.
My heart skips a beat as I glance at Jax. He's already on his feet, grabbing his bag and heading for the door.
"What is it?" I demand, my mind racing with possibilities.
"It's the rebels," Jax replies, his voice tight with urgency. "They're attacking one of the government patrols."
My eyes lock onto his, a spark of adrenaline igniting within me. This is it – we've been waiting for this moment.
Without hesitation, I follow Jax out into the chaos. The sound of gunfire and screams fills my ears as we join the fray. We're surrounded by rebels, all armed to the teeth and fighting for their lives.
I feel a rush of excitement mixed with fear. This is it – we're taking back our city, one battle at a time.
But just as I think things are about to get under control, a loud voice booms through the crowd, echoing off the buildings.
"Enough! Cease fire!"
We stop fighting, looking around in confusion. Where's Arin?
And that's when I see her – standing on top of a nearby building, a megaphone in hand and a fierce look in her eyes.
"Hello, rebels!" she bellows, her voice carrying across the city. "It's time to take back our country!"
But just as we're about to cheer, Arin's expression darkens, and she glances down at something on the ground.
And that's when I see it – a small package, lying on the cobblestones beneath her feet.
Arin's eyes narrow, her grip on the megaphone tightening. "We have an unexpected visitor," she says, her voice dripping with menace.