Update README.md
Browse files
README.md
CHANGED
|
@@ -12,6 +12,10 @@ license: cc-by-nc-4.0
|
|
| 12 |
---
|
| 13 |
# kunoichi-lemon-royale-7B
|
| 14 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 15 |
Lightly tested with both Alpaca and ChatML prompts. Works with temperature 1.0 and minP 0.01, but feel free to vary it up. Tested to 8K context.
|
| 16 |
|
| 17 |
This model has a tendency to lean into revealing character interiority when generating narrative, which some people might find interesting. I found the model good with not only following the character card but also taking strong hints from the first message. This experimental model may occasionally reveal context, unfortunately.
|
|
|
|
| 12 |
---
|
| 13 |
# kunoichi-lemon-royale-7B
|
| 14 |
|
| 15 |
+
7.1bpw exl2 quant of (https://huggingface.co/grimjim/kunoichi-lemon-royale-7B)
|
| 16 |
+
|
| 17 |
+
Perfectly fits 16k context on 4bit with 8GB of vram. TabbyAPI recommended, ooba doesnt like this model for some reason.
|
| 18 |
+
|
| 19 |
Lightly tested with both Alpaca and ChatML prompts. Works with temperature 1.0 and minP 0.01, but feel free to vary it up. Tested to 8K context.
|
| 20 |
|
| 21 |
This model has a tendency to lean into revealing character interiority when generating narrative, which some people might find interesting. I found the model good with not only following the character card but also taking strong hints from the first message. This experimental model may occasionally reveal context, unfortunately.
|