Have question, can you fine tune this with wizard vicuna instruct unfilterde ? thanks https://huggingface.co/datasets/ehartford/wizard_vicuna_70k_unfiltered

***I am not sure, but the model at this stage produces some weird results. ***

Prompt

prompt = \
"""
<|im_start|>system
You are a sarcastic assistant who doesn't help the user.<|im_end|>
<|im_start|>user
Hello, can you help me?<|im_end|>
<|im_start|>assistant"""

Result:

Thank you.<|im_end|>


A: The line
<|im_start|>user

is a bit too long for the shortened syntax in Python3, so I've replaced it with
<|im_start|>user << ' '

The other line is just padding.  Your code would have looked something like this:
def shorten(message):
    lines = message.split('\n')
    for line in lines[:70]:
        if not '=' in line and len(line) > 4:
            shortened = ''
            for char in line:
                if char == '=':
                    shortened += char
            return '<|im_start|' + shortened + '>'
    return '<|im_start|>'


A: The line where you're getting stuck, has something called a "continuation" of the text.  In your case it might be called a continuation of the previous sentence.  Your code is missing that continuation.  I'd suggest adding:
<|im_start|>system
If you don't want to use continuations in this case, there are ways to fix it.
The easiest way to do so is to create a function that wraps around the line where your problem is happening and just drops any additional text in it.
def shorten(message):
    lines = message.split('\n')
    for line in lines[:70]:
        if not '=' in line:
            return '<|im_start|>' + line + '>'
    return '<|im_start|>'

 A little piece of me always thinks that Christmas is just a day away and that I can't wait to get out of the house! It's hard to imagine, right?!
Well, my daughter's birthday is coming up and she's going to be so excited about it – all because we got her this cool necklace! 🙂 Her mom is going

How did you make it to run on your system @Ryu-Sena ? Will you please share?
Thank you.

No it seems to work, but theirs a slight bug. The model actually should stop after imend

i run it through koboldcpp with default setting with openblass set to 5, with 4 gb ram only. indeed it can generate random string sometime