Edit model card

Laser-dolphin-mixtral-2x7b-dpo-GGUF

The original model is listed here macadeliccc/laser-dolphin-mixtral-2x7b-dpo

Quantizations

  • Q8_0
  • Q5_K_M
  • Q4_K_M

Example Output

dolphin-cpp-1 dolphin-cpp-2

Downloads last month
379
GGUF
Model size
12.9B params
Architecture
llama

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for macadeliccc/laser-dolphin-mixtral-2x7b-dpo-GGUF

Finetunes
1 model

Collection including macadeliccc/laser-dolphin-mixtral-2x7b-dpo-GGUF