MiquMaid-v1-70B IQ2
Description
2bit imatrix GGUF quants of NeverSleep/MiquMaid-v1-70B
Imatrix generated from q8 of MiquMaid, 2000 chunks at 500 ctx. Dataset was Wikitext.
These quants take a while to do so please leave a like or a comment on the repo so that i know if there is interest.
Other quants:
GGUF:
Custom format:
### Instruction:
{system prompt}
### Input:
{input}
### Response:
{reply}
Contact
Kooten on discord