GGUF
English
Inference Endpoints

Some GGUF v2 quantizations of the model harborwater/wizard-orca-3b

It was trained on 2 epoch of pankajmathur's WizardLM_orca dataset.

Prompt template:

### HUMAN:
{prompt}

### RESPONSE:
<leave a newline for the model to answer>
Downloads last month
46
GGUF
Model size
3.43B params
Architecture
llama

4-bit

5-bit

Inference Providers NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Dataset used to train Aryanne/Wizard-Orca-3B-gguf

Spaces using Aryanne/Wizard-Orca-3B-gguf 6