MD-Zephyria-42b [EXPERIMENTAL]
Model Information
Base Model: unsloth/Mistral-Small-Instruct-2409
Strategy: Mid Duplication
Total Layers: 55
Duplication Start: Layer 22 (40% of model)
Duplicated Layers: 27 (49.1% of model)
Unique Final Layers: 7 (12.7% of model)
Model Characteristics
- Models down_proj and o_proj layers have been nulled and will require healing
- Balances early feature extraction and later refinement
- Even split between unique and duplicated sections
- Good for general-purpose tasks with balanced low and high-level processing
- May provide a good compromise for a wide range of applications
Configuration Visualization
[ Unique ][ Duplicated ][ Unique ]
0 ------------- 21 22 ------------- 48 49 ------- 54
40% 49.1% 10.9%