Bakanayatsu
/

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF

Inference Endpoints

Model card Files Files and versions Community

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF / README.md

Bakanayatsu's picture

Update README.md

d19c866 verified 9 months ago

|

history blame contribute delete

212 Bytes

	---
	tags:
	- laser
	- mistral
	---
	Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser

	```imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f group_10_merged.txt -ngl 99 -c 256```