File size: 3,157 Bytes
5293f64 e38540a 5293f64 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 |
---
license: cc-by-4.0
---
# #llama-3 #roleplay
GGUF-IQ-Imatrix quants for [cgato/L3-TheSpice-8b-v0.8.3](https://huggingface.co/cgato/L3-TheSpice-8b-v0.8.3).
> [!IMPORTANT]
> These quants have already been done after the fixes from [llama.cpp/pull/6920](https://github.com/ggerganov/llama.cpp/pull/6920). <br>
> Use **KoboldCpp version 1.64** or higher.
> [!NOTE]
> **Prompt formatting...** <br>
> Prompt format is relatively simple, author seems to recommend **ChatML**.
# Original model information by the author:
Now not overtrained and with the tokenizer fix to base llama3. Trained for 3 epochs.
The latest TheSpice, dipped in Mama Liz's LimaRP Oil.
I've focused on making the model more flexible and provide a more unique experience.
I'm still working on cleaning up my dataset, but I've shrunken it down a lot to focus on a "less is more" approach.
This is ultimate a return to form of the way I used to train Thespis, with more of a focus on a small hand edited dataset.
## Datasets Used
* Capybara
* Claude Multiround 30k
* Augmental
* ToxicQA
* Yahoo Answers
* Airoboros 3.1
* LimaRP
## Features ( Examples from 0.1.1 because I'm too lazy to take new screenshots. Its tested tho. )
Narration
If you request information on objects or characters in the scene, the model will narrate it to you. Most of the time, without moving the story forward.
# You can look at anything mostly as long as you end it with "What do I see?"
# You can also request to know what a character is thinking or planning.
# You can ask for a quick summary on the character as well.
# Before continuing the conversation as normal.
## Prompt Format: Chat ( The default Ooba template and Silly Tavern Template )
If you're using Ooba in verbose mode as a server, you can check if you're console is logging something that looks like this.
```
{System Prompt}
Username: {Input}
BotName: {Response}
Username: {Input}
BotName: {Response}
```
## Presets
All screenshots above were taken with the below SillyTavern Preset.
## Recommended Silly Tavern Preset -> (Temp: 1.25, MinP: 0.1, RepPen: 1.05)
This is a roughly equivalent Kobold Horde Preset.
## Recommended Kobold Horde Preset -> MinP
# Disclaimer
Please prompt responsibly and take anything outputted by any Language Model with a huge grain of salt. Thanks! |