--- base_model: - xMaulana/FinMatcha-3B-Instruct - PurpleAILAB/Llama-3.2-3B-Instruct-uncensored-LoRA library_name: transformers tags: - mergekit - merge --- # merge This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit). ## Merge Details ### Merge Method This model was merged using the [task arithmetic](https://arxiv.org/abs/2212.04089) merge method using [xMaulana/FinMatcha-3B-Instruct](https://huggingface.co/xMaulana/FinMatcha-3B-Instruct) + [PurpleAILAB/Llama-3.2-3B-Instruct-uncensored-LoRA](https://huggingface.co/PurpleAILAB/Llama-3.2-3B-Instruct-uncensored-LoRA) as a base. ### Models Merged The following models were included in the merge: ### Configuration The following YAML configuration was used to produce this model: ```yaml base_model: xMaulana/FinMatcha-3B-Instruct+PurpleAILAB/Llama-3.2-3B-Instruct-uncensored-LoRA dtype: bfloat16 merge_method: task_arithmetic parameters: normalize: false slices: - sources: - layer_range: [0, 28] model: xMaulana/FinMatcha-3B-Instruct+PurpleAILAB/Llama-3.2-3B-Instruct-uncensored-LoRA parameters: weight: 1.0 ```