|
--- |
|
license: cc-by-nc-4.0 |
|
base_model: |
|
- BlueNipples/SnowLotus-v2-10.7B |
|
- Himitsui/KuroMitsu-11B |
|
tags: |
|
- mergekit |
|
- merge |
|
--- |
|
|
|
This is an EXL2 quantized model of [saishf/Kuro-Lotus-10.7B](https://huggingface.co/saishf/Kuro-Lotus-10.7B) using the default calibration dataset. |
|
The quants are uploaded on individual branches and the list is here: |
|
[4bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/4bpw) |
|
[3.75bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.75bpw) |
|
[3.5bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.5bpw) |
|
[3.25bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.25bpw) |
|
[3bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3bpw) |
|
|
|
Prompt format is Alpaca. |
