Bakanayatsu
/

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF

Inference Endpoints

Model card Files Files and versions Community

NeuralHermes-2.5-Mistral-7B-laser-imatrix-GGUF / README.md

Bakanayatsu's picture

Update README.md

d19c866 verified 9 months ago

|

history blame contribute delete

212 Bytes

metadata

tags:
  - laser
  - mistral

Original Model: https://huggingface.co/mlabonne/NeuralHermes-2.5-Mistral-7B-laser

imatrix -m NeuralHermes-2.5-Mistral-7B-laser-8_0.gguf -f group_10_merged.txt -ngl 99 -c 256