Explanation

  • With the base model, attached the DPO applied Adapter

Base Model

Adapter Base Model

Adapter Corpus

Score

Average ARC HellaSwag MMLU TruthfulQA Winogrande GSM8K
76.09 73.89 88.94 65.03 71.24 87.61 69.83

Log

  • 2024.02.13: Initial version Upload

LICENSE

  • MIT
Downloads last month
123
Safetensors
Model size
12.9B params
Tensor type
FP16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Dataset used to train dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach