Hugging Face's logo

yam-peleg
/
Hebrew-Mistral-7B

Text Generation
Transformers
Safetensors
English
Hebrew
mistral
text-generation-inference
Inference Endpoints
Model card Files Community
6

Convert to GGUF format

#1
by NHLOCAL - opened
Discussion
NHLOCAL

In order to adapt the model to run on any device, it would be very useful to convert the model also to the GGUF format supported by LLAMA.CPP!

0-hero

https://huggingface.co/QuantFactory/Hebrew-Mistral-7B-GGUF

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment