File size: 770 Bytes
9346613 da16f62 401f65c 4a764ce 9346613 cb56392 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 |
---
tags:
- not-for-all-audiences
- nsfw
license: other
language:
- en
---
[EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [Undi95's's Xwin-MLewd-13B-V0.2](https://huggingface.co/Undi95/Xwin-MLewd-13B-V0.2).
## Model details
Quantized at 5.33bpw
[3.73bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/3bit)
[4.33bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/4bit)
[6.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/6bit)
[8.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/8bit)
## Prompt Format
```
Below is an instruction that describes a task. Write a response that appropriately completes the request.
### Instruction:
{prompt}
### Response:
``` |