lr1729
/

Nous-Hermes-2-SOLAR-10.7B-GGUF-imatrix

Model card Files Files and versions Community

Edit model card

GGUF quants of https://huggingface.co/NousResearch/Nous-Hermes-2-SOLAR-10.7B with importance matrix calculations run on 20k_random_data.txt for improved perplexity.

Downloads last month: 68

GGUF

Model size

10.7B params

Architecture

llama

2-bit

3-bit

4-bit

5-bit

6-bit

Inference API

Inference API (serverless) has been turned off for this model.

Model tree for lr1729/Nous-Hermes-2-SOLAR-10.7B-GGUF-imatrix

Base model

upstage/SOLAR-10.7B-v1.0

Finetuned

NousResearch/Nous-Hermes-2-SOLAR-10.7B

Quantized

(10)

this model

Evaluation results

Metadata error: specify a dataset to view leaderboard