metadata
base_model:
- Qwen/Qwen2.5-14B-Instruct
- qingy2019/Qwen2.5-Math-14B-Instruct
- Qwen/Qwen2.5-14B
library_name: transformers
tags:
- mergekit
- merge
Qwen2.5 Ultimate 14B Instruct
Merged using rombodawg's method and using the first iteration of my Qwen2.5 Math 14B Instruct.
Merge Details
Merge Method
This model was merged using the TIES merge method using Qwen/Qwen2.5-14B as a base.
Models Merged
The following models were included in the merge:
Configuration
The following YAML configuration was used to produce this model:
models:
- model: qingy2019/Qwen2.5-Math-14B-Instruct
parameters:
weight: 1
density: 1
- model: Qwen/Qwen2.5-14B-Instruct
parameters:
weight: 1
density: 1
merge_method: ties
base_model: Qwen/Qwen2.5-14B
parameters:
weight: 1
density: 1
normalize: true
int8_mask: true
tokenizer_source: qingy2019/Qwen2.5-Math-14B-Instruct
dtype: bfloat16