---
library_name: transformers
tags:
- flow-merge
- merge

---
# qwen_merge_2

This model is the result of merge of the following models made with flow-merge:

- Base model:
	- Qwen/Qwen1.5-0.5B
- Models:
	- Qwen/Qwen1.5-0.5B-chat
	- minghaowu/Qwen1.5-0.5B-OpenHermes-2.5


## flow-merge config

The following configuration was used to merge the models:

```yaml
base_model: Qwen/Qwen1.5-0.5B
models:
- path_or_id: Qwen/Qwen1.5-0.5B
- path_or_id: Qwen/Qwen1.5-0.5B-chat
- path_or_id: minghaowu/Qwen1.5-0.5B-OpenHermes-2.5
method: addition-task-arithmetic
device: !!python/object/apply:flow_merge.lib.constants.DeviceIdentifier
- cpu
method_global_parameters:
  scaling_coefficient: 0.7
  normalize: false
directory_settings:
  cache_dir: null
  local_dir: ./models
  output_dir: ./merged_model

```