--- license: cc-by-nc-4.0 base_model: - BlueNipples/SnowLotus-v2-10.7B - Himitsui/KuroMitsu-11B tags: - mergekit - merge --- This is an EXL2 quantized model of [saishf/Kuro-Lotus-10.7B](https://huggingface.co/saishf/Kuro-Lotus-10.7B) using the default calibration dataset. The quants are uploaded on individual branches and the list is here: [4bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/4bpw) [3.75bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.75bpw) [3.5bpw](https://huggingface.co/mpasila/Kuro-Lotus-10.7B-exl2/tree/3.5bpw) Prompt format is Alpaca.