---
library_name: transformers
tags: []
---

# Mistral-Small-Instruct-2409 - EXL2 6.8 rpcal_mk2

This is a 8bpw EXL2 quant of [mistralai/Mistral-Small-Instruct-2409](https://huggingface.co/mistralai/Mistral-Small-Instruct-2409)

This quant was made using exllamav2-0.2.2 with [Fullmoon-light dataset](https://huggingface.co/datasets/ParasiticRogue/Fullmoon-Light) for RP.

I tested this quant shortly in some random RPs (including ones over 8k and 16k context) and it seems to work fine.

## Prompt Templates

Uses Mistral format.

For more details see original model.