---
license: other
license_name: mistral-ai-research-licence
license_link: https://mistral.ai/licenses/MRL-0.1.md
base_model: []
library_name: transformers
tags:
- mergekit
- lumikabra-123B
---
# lumikabra-123B
This is lumikabra. It's based on [Mistral-Large-Instruct-2407 ](https://huggingface.co/mistralai/Mistral-Large-Instruct-2407), merged with Magnum-v2-123B, Luminum-v0.1-123B and Tess-3-Mistral-Large-2-123B.
I shamelessly took this idea from [FluffyKaeloky](https://huggingface.co/FluffyKaeloky/Luminum-v0.1-123B). Like him, i always had my troubles with each of the current large mistral based models.
Either it gets repetitive, shows too many GPTisms, is too horny or too unhorny. RP and storytelling is always a matter of taste, and i found myself swiping too often for new answers or even fixing them when I missed a little spice or cleverness.
Luminum was a great improvement, mixing a lot of desired traits, but I still missed some spice, another sauce.
So i took Luminum, added magnum again and also Tess for knowledge and structure.
This is my very first merge, but I feel it has some potential. I was honestly a little surprised when my character was killed in RP just because it kinda fitted the story. So I guess, dark is a possible theme.
## Quants
- [exl2-5.0](https://huggingface.co/schnapper79/lumikabra-123B-exl2-5.0bpw)
- [exl2-8.0](https://huggingface.co/schnapper79/lumikabra-123B-exl2-8.0bpw)
## Merge Details
### Merge Method
This model was merged using [mergekit](https://github.com/cg123/mergekit) with the della_linear merge method using mistralai_Mistral-Large-Instruct-2407 as a base.
### Configuration
The following YAML configuration was used to produce this model:
```yaml
models:
- model: anthracite-org_magnum-v2-123b
parameters:
weight: 0.19
density: 0.5
- model: FluffyKaeloky_Luminum-v0.1-123B
parameters:
weight: 0.34
density: 0.8
- model: migtissera_Tess-3-Mistral-Large-2-123B
parameters:
weight: 0.24
density: 0.7
merge_method: della_linear
base_model: mistralai_Mistral-Large-Instruct-2407
parameters:
epsilon: 0.05
lambda: 1
int8_mask: true
dtype: bfloat16
```
# Example Storywriting
### Settings
```
max_new_tokens: 4096
min_p: 0.05
smoothing factor: 0.25
```
Write me a 3,000 word opening chapter of a 'high fantasy' novel, drawing inspiration from the writing styles of Patrick Rothfuss. Use first person personal. Include dialogue and internal monologues. The POV character for the opening chapter should be a 19 year old female elf bard who is looking for adventure. Add darkness to the story
In the dim glow of the tavern's hearth, I plucked at my lute, fingers dancing across the strings as I sang a tune both haunting and sweet. The patrons, rough men and weathered dwarves, watched me with rapt attention, their eyes gleaming in the flickering firelight. They clapped and cheered, demanding more, but I was only halfway through the song.
My voice soared, pure and clear, weaving a spell of melody that silenced even the rowdiest drinkers. I sang of ancient elven glades, of moonlit dances and lost loves, of battles long past and heroes forgotten. As I played, I closed my eyes and let the music carry me away, transporting me to another time, another place.
But when the final notes faded and I opened my eyes, the magic dissipated, replaced by the gritty reality of the tavern. The men returned to their ale, the dwarves to their dice, and I to my own thoughts. I scanned the room, searching for anyone who might offer a coin or a bed for the night, but most avoided my gaze.
Then I saw him. A cloaked figure in the corner, face obscured by shadows, watching me with unnerving intensity. A chill ran down my spine, but I couldn't look away. His eyes, dark as the night sky, held secrets I yearned to uncover.
I approached him, lute still cradled in my arms. "Did you enjoy the performance, stranger?"
He gestured for me to sit. I hesitated, then slid onto the bench opposite him, keeping a cautious distance.
"You sing with a rare talent, young bard," he said, his voice deep and resonant. "But there is darkness in your songs."
I bristled at the comment. "Life is not all sunlight and laughter. My songs reflect the truth."
"And what truths have you uncovered, I wonder?" His eyes bore into me, probing, questioning.
I met his gaze defiantly. "I have seen much in my travels. War. Suffering. Death. And I sing of them all, to honor the memory of those who have fallen."
The stranger leaned back, steepling his fingers. "Admirable. But tell me, what drives you to seek out such grim tales? What darkness lurks in your own heart?"
The question struck me like a blow. I looked away, my hands tightening around my lute. "I... I don't know what you mean."
"Come now, child." His voice was almost gentle. "You cannot sing of shadows without having walked through them yourself. Tell me your story. Why does a young elf like you wander the roads, seeking sorrow in every song?"
I stared into the fire, my vision blurring with memories. My parents' faces, gaunt with hunger and despair. Our village, burning. The screams. The blood. And me, crouched in the forest, helpless to save them.
"My family is gone," I whispered. "Taken by war. I sing to keep their memory alive. To honor their sacrifice."
The stranger was silent for a moment, then reached across the table to touch my hand. His fingers were warm, comforting. "I am sorry for your loss," he said softly. "But perhaps there is more to life than just remembrance. Have you ever thought to create new memories, instead of dwelling on the past?"
I looked up at him, startled. "What do you mean?"
"There is a whole world out there, waiting to be discovered. Adventure. Magic. Love. Why not seek them out, instead of lingering in the shadows of what once was?"
His words stirred something in me, a longing I had buried deep within. A desire to leave the darkness behind and step into the light. I swallowed hard, my heart racing. "I... I don't know. It seems wrong to forget them."
"You need not forget," the stranger said, his eyes kind. "But neither must you be bound by the chains of grief forever. Your family would want you to live, to thrive. To find joy again."
I felt tears prick the corners of my eyes. "And how would you know what they would want?" I snapped, pulling my hand away. "You didn't even know them."
The stranger's gaze never wavered. "No, I did not. But I know you, young bard. And I see the potential within you, waiting to be unleashed. You are more than just a vessel for sorrowful songs. You are a beacon of hope, a light in the darkness. If you would only let yourself shine."
His words resonated deep within me, igniting a spark of longing that quickly grew into a flame. Suddenly, I saw my future laid out before me - a path winding through forests and mountains, across seas and into the hearts of kings. A journey of music and magic, of danger and discovery, of love and loss. And in that moment, I made my choice.
"You're right," I said, my voice barely above a whisper. "I can't live in the past forever. It's time I found my own story to sing."
The stranger smiled, a slow curve of his lips that filled his face with warmth. "And what tale will you tell, I wonder? What adventures will you find?"
I took a deep breath, steeling myself for the journey ahead. "I don't know. But I'm ready to find out."
With a final nod to the stranger, I rose from the table and shouldered my pack. The patrons barely noticed my departure, lost in their own revelry and cares. But I knew that my life had changed irrevocably, and that the world waited for me just beyond the tavern door.
As I stepped out into the cool night air, I paused and looked back one last time. The stranger still sat in the corner, watching me with a knowing smile. I raised a hand in farewell, then turned and walked away, towards the promise of a new dawn.
And as I walked, I began to compose a new song in my mind. A song of hope and adventure, of dreams yet to be fulfilled. A song that would carry me through the darkest of nights and into the brightest of futures. A song that would be uniquely mine.
The road ahead was long and uncertain, filled with dangers both real and imagined. But for the first time in years, I felt alive. I felt purpose. And I knew, beyond a shadow of a doubt, that my true story was just beginning.