README.md

metadata

license: apache-2.0
tags:
  - merge
  - mergekit
  - Trelis/Llama-2-7b-chat-hf-function-calling-v3
  - xalss/Qwen2-7B-Instruct-glaive-function-calling
  - InterSync/Mistral-7B-Instruct-v0.2-Function-Calling
  - NousResearch/Hermes-2-Pro-Mistral-7B

Uma-4x7B-MoE-Function-calling-v0.2

Hey there! 👋 Welcome to the Uma-4x7B-MoE-Function-calling-v0.2! This is a merge of multiple models brought together using the awesome VortexMerge kit.

Let's see what we've got in this merge:

• Trelis/Llama-2-7b-chat-hf-function-calling-v3 🚀
• xalss/Qwen2-7B-Instruct-glaive-function-calling 🚀
• InterSync/Mistral-7B-Instruct-v0.2-Function-Calling 🚀
• NousResearch/Hermes-2-Pro-Mistral-7B 🚀

🧩 Configuration

models:
  - model: Trelis/Llama-2-7b-chat-hf-function-calling-v3
    parameters:
      weight: 0.30
  - model: xalss/Qwen2-7B-Instruct-glaive-function-calling
    parameters:
      weight: 0.60
  - model: InterSync/Mistral-7B-Instruct-v0.2-Function-Calling
    parameters:
      weight: 0.90
  - model: NousResearch/Hermes-2-Pro-Mistral-7B
    parameters:
      weight: 1.0
merge_method: linear
dtype: float16