File size: 568 Bytes
c90e827 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 |
---
library_name: transformers
tags: []
---
# Mistral-Small-Instruct-2409 - EXL2 6.8 rpcal_mk2
This is a 8bpw EXL2 quant of [mistralai/Mistral-Small-Instruct-2409](https://huggingface.co/mistralai/Mistral-Small-Instruct-2409)
This quant was made using exllamav2-0.2.2 with [Fullmoon-light dataset](https://huggingface.co/datasets/ParasiticRogue/Fullmoon-Light) for RP.
I tested this quant shortly in some random RPs (including ones over 8k and 16k context) and it seems to work fine.
## Prompt Templates
Uses Mistral format.
For more details see original model. |