kunoichi-lemon-royale-7B-GGUF

This repo contains GGUF quantizations of kunoichi-lemon-royale-7B.

Lightly tested with both Alpaca and ChatML prompts. Works with temperature 1.0 and minP 0.01, but feel free to vary it up. Tested to 8K context.

This model has a tendency to lean into revealing character interiority when generating narrative, which some people might find interesting. I found the model good with not only following the character card but also taking strong hints from the first message. Model is experimental and may occasionally misbehave.

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the DARE TIES merge method using SanjiWatsuki/Kunoichi-7B as a base. Each of the models had strengths I liked to varying degrees, leading to weights and densities being adjusted in aesthetic proportion.

Models Merged

The following models were included in the merge:

• core-3/kuno-royale-v2-7b
• SanjiWatsuki/Kunoichi-DPO-v2-7B
• KatyTheCutie/LemonadeRP-4.5.3

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: SanjiWatsuki/Kunoichi-7B
    # no parameters necessary for base model
  - model: KatyTheCutie/LemonadeRP-4.5.3
    parameters:
      weight: 0.3
      density: 0.4
  - model: core-3/kuno-royale-v2-7b
    parameters:
      weight: 0.3
      density: 0.4
  - model: SanjiWatsuki/Kunoichi-DPO-v2-7B
    parameters:
      weight: 0.4
      density: 0.8
merge_method: dare_ties
base_model: SanjiWatsuki/Kunoichi-7B
parameters:
  int8_mask: true
  normalize: true
dtype: bfloat16