Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.1
openchat/openchat-3.5-0106
openchat
C-RLFT
arxiv:2309.11235
arxiv:2303.08774
Inference Endpoints
openchat-3.5-0106-Mistral-7B-Instruct-v0.1-GGUF
/
openchat-3.5-0106-Mistral-7B-Instruct-v0.1.Q4_K_M.gguf