Llama-Hermes-slerp2-8B / mergekit_config.yml
hotmailuser's picture
Upload folder using huggingface_hub
24e31ef verified
raw
history blame contribute delete
358 Bytes
models:
- model: Saxo/Linkbricks-Horizon-AI-Nous-Hermes-3-Llama3.1-Korean-cpt-8b
- model: meditsolutions/Llama-3.1-MedIT-SUN-8B
merge_method: slerp
base_model: Saxo/Linkbricks-Horizon-AI-Nous-Hermes-3-Llama3.1-Korean-cpt-8b
dtype: bfloat16
parameters:
t: [0, 0.5, 1, 0.5, 0] # V shaped curve: Hermes for input & output, WizardMath in the middle layers