|
--- |
|
license: cc-by-nc-4.0 |
|
--- |
|
|
|
# Noromaid-13b-v0.3 2bit QUIP# |
|
|
|
## Description |
|
QUIP quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3) |
|
|
|
I wanted to try quanting in QUIP, it took about 20 hours but it works, its coherent and really tiny |
|
|
|
## Other quants: |
|
EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2) |
|
|
|
|
|
## Prompt Format |
|
### Silly Tavern Preset |
|
[Instruct template](https://files.catbox.moe/nzygwn.json) |
|
|
|
[Context template](https://files.catbox.moe/l5hguf.json) |
|
|
|
### Alpaca: |
|
``` |
|
Below is an instruction that describes a task. Write a response that appropriately completes the request. |
|
|
|
### Instruction: |
|
{prompt} |
|
|
|
### Input: |
|
{input} |
|
|
|
### Response: |
|
|
|
``` |
|
|
|
## Contact |
|
Kooten on discord |
