--- tags: - not-for-all-audiences - nsfw license: other language: - en --- [EXL2](https://github.com/turboderp/exllamav2/tree/master#exllamav2) Quantization of [Undi95's's Xwin-MLewd-13B-V0.2](https://huggingface.co/Undi95/Xwin-MLewd-13B-V0.2). ## Model details Quantized at 5.33bpw [3.73bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/3bit) [4.33bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/4bit) [6.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/6bit) [8.13bpw](https://huggingface.co/R136a1/Xwin-MLewd-13B-V0.2-exl2/tree/8bit) ## Prompt Format ``` Below is an instruction that describes a task. Write a response that appropriately completes the request. ### Instruction: {prompt} ### Response: ```