File size: 591 Bytes
c4f4b9a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
---
license: cc-by-nc-4.0
base_model:
- BlueNipples/SnowLotus-v2-10.7B
- Himitsui/KuroMitsu-11B
tags:
- mergekit
- merge
---
This is an EXL2 quantized model of [saishf/Kuro-Lotus-10.7B](https://huggingface.co/saishf/Kuro-Lotus-10.7B) using the default calibration dataset.
The quants are uploaded on individual branches and the list is here:
[4bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/4bpw)
[3.75bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.75bpw)
[3.5bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.5bpw)
Prompt format is Alpaca. |