Bakanayatsu
/

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF

Inference Endpoints

Model card Files Files and versions Community

Bakanayatsu commited on Feb 14

Commit

d19c866

•

1 Parent(s): a6536ee

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,4 +5,4 @@ tags:
 ---
 Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser
-```imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f wiki.train.raw -ngl 99 --chunks 1000 -c 512```

 ---
 Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser
+```imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f group_10_merged.txt -ngl 99 -c 256```