Hugging Face's logo

Kooten
/
Noromaid-13b-v0.3-6bpw-exl2

Text Generation
Transformers
Safetensors
llama
text-generation-inference
Inference Endpoints
Model card Files Community
Kooten commited on
Commit
2b97343
•
1 Parent(s): fc5e3be

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -3,15 +3,17 @@
3
  ## Description
4
  Exllama quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
5
 
6
- [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
 
7
 
8
- ## Silly Tavern Preset
 
 
9
  [Instruct template](https://files.catbox.moe/nzygwn.json)
10
 
11
  [Context template](https://files.catbox.moe/l5hguf.json)
12
 
13
- ## Prompt Format
14
-
15
  ```
16
  ### Instruction:
17
  [prompt and charcard here]
 
3
  ## Description
4
  Exllama quant of [NeverSleep/Noromaid-13b-v0.3](https://huggingface.co/NeverSleep/Noromaid-13b-v0.3)
5
 
6
+ ## Other quants:
7
+ EXL2: [8bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Noromaid-13b-v0.3-4bpw-exl2)
8
 
9
+
10
+ ## Prompt Format
11
+ ### Silly Tavern Preset
12
  [Instruct template](https://files.catbox.moe/nzygwn.json)
13
 
14
  [Context template](https://files.catbox.moe/l5hguf.json)
15
 
16
+ ### Alpaca:
 
17
  ```
18
  ### Instruction:
19
  [prompt and charcard here]