| license: apache-2.0 | |
| tags: | |
| - merge | |
| - mergekit | |
| - vortexmergekit | |
| - OEvortex/HelpingAI2-6B | |
| # 4x1b | |
| Hey there! 👋 Welcome to the 4x1b! This is a merge of multiple models brought together using the awesome [VortexMerge kit](https://colab.research.google.com/drive/1YjcvCLuNG1PK7Le6_4xhVU5VpzTwvGhk#scrollTo=UG5H2TK4gVyl). | |
| Let's see what we've got in this merge: | |
| * [OEvortex/HelpingAI2-6B](https://huggingface.co/OEvortex/HelpingAI2-6B) 🚀 | |
| * [OEvortex/HelpingAI2-6B](https://huggingface.co/OEvortex/HelpingAI2-6B) 🚀 | |
| * [OEvortex/HelpingAI2-6B](https://huggingface.co/OEvortex/HelpingAI2-6B) 🚀 | |
| * [OEvortex/HelpingAI2-6B](https://huggingface.co/OEvortex/HelpingAI2-6B) 🚀 | |
| ## 🧩 Configuration | |
| ```yaml | |
| dtype: float16 | |
| merge_method: passthrough | |
| slices: | |
| - sources: | |
| - layer_range: [0, 8] | |
| model: OEvortex/HelpingAI2-6B | |
| - sources: | |
| - layer_range: [4, 12] | |
| model: OEvortex/HelpingAI2-6B | |
| - sources: | |
| - layer_range: [8, 16] | |
| model: OEvortex/HelpingAI2-6B | |
| - sources: | |
| - layer_range: [12, 21] | |
| model: OEvortex/HelpingAI2-6B | |