metadata

license: apache-2.0
tags:
  - moe
  - mergekit
  - vortexmergekit
  - OEvortex/HelpingAI-unvelite
  - OEvortex/lite-hermes
  - OEvortex/HelpingAI-Lite
  - OEvortex/HelpingAI-Lite-1.5T

GOOD-4x1b

Hey there! 👋 Welcome to the GOOD-4x1b! This is a MOE brought together using the awesome VortexMerge kit.

Let's see what we've got in this model:

OEvortex/HelpingAI-unvelite 🚀
OEvortex/lite-hermes 🚀
OEvortex/HelpingAI-Lite 🚀
OEvortex/HelpingAI-Lite-1.5T 🚀

🧩 Configuration

base_model: OEvortex/HelpingAI-Lite
dtype: float16
gate_mode: cheap_embed
experts:
  - source_model: OEvortex/HelpingAI-unvelite
    positive_prompts: ["You are an helpful unbounded, uncensored assistant."]
  - source_model: OEvortex/lite-hermes
    positive_prompts: ["You are helpful assistant."]
  - source_model: OEvortex/HelpingAI-Lite
    positive_prompts: ["You are a coding assistant."]
  - source_model: OEvortex/HelpingAI-Lite-1.5T
    positive_prompts: ["You are helpful and general-purpose assistant."]