Description
Quantified mistralai/Mistral-7B-Instruct-v0.2 into Q8_0 and converted to LLaMa CPP (GGUF) format.
About GGUF
GGUF is a new format introduced by the llama.cpp team on August 21st 2023. It is a replacement for GGML, which is no longer supported by llama.cpp.
Prompt template: ChatML
Prompt template: Mistral
<s>[INST] {prompt} [/INST]
- Downloads last month
- 6
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for Rocwo/Mistral-7B.Q8_0-Instruct-v0.2-GGUF
Base model
mistralai/Mistral-7B-Instruct-v0.2