Hugging Face's logo

Nan-Do
/
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-GGUF

GGUF
mixtral
Mixture of Experts
quantization
DPO
RL-TUNED
Inference Endpoints
Model card Files Community
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-GGUF / README.md
Nan-Do's picture
Nan-Do
Added model template
756f089 verified
preview code
|
raw
history blame
2.79 kB
metadata
base_model: yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
inference: true
license: mit
model-index:
  - name: Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
    results: []
model_creator: yunconglong
model_name: Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
model_type: mixtral
quantized_by: Nan-Do
tags:
  - mixtral
  - Mixture of Experts
  - quantization
  - DPO
  - RL-TUNED

Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B

Description

This repo contains GGUF format model files for Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B.

Provided files

Name Quantisation method Bits Size
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q3_K_S.gguf Q3_K_S 3 5.59 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q3_K.gguf Q3_K 3 6.21 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q4_0.gguf Q4_0 4 7.28 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q4_1.gguf Q4_1 4 8.08 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q5_0.gguf Q5_0 5 8.87 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q5_1.gguf Q5_1 5 9.67 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q6_K.gguf Q6_K 6 10.06 GB
Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B-Q8_0.gguf Q8_0 8 13.7 GB