metadata
library_name: transformers
tags: []
Mistral-Small-Instruct-2409 - EXL2 6.8 rpcal_mk2
This is a 8bpw EXL2 quant of mistralai/Mistral-Small-Instruct-2409
This quant was made using exllamav2-0.2.2 with Fullmoon-light dataset for RP.
I tested this quant shortly in some random RPs (including ones over 8k and 16k context) and it seems to work fine.
Prompt Templates
Uses Mistral format.
For more details see original model.