base_model: NousResearch/Hermes-3-Llama-3.1-8B gate_mode: random architecture: mixtral dtype: bfloat16 experts: - source_model: NousResearch/Hermes-3-Llama-3.1-8B - source_model: NousResearch/Hermes-3-Llama-3.1-8B