File size: 2,079 Bytes
dff6fee d8323fc dff6fee |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 |
---
base_model:
- Sao10K/14B-Qwen2.5-Kunou-v1
- v000000/Qwen2.5-Lumen-14B
- v000000/Qwen2.5-14B-Gutenberg-1e-Delta
- huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
library_name: transformers
tags:
- mergekit
- merge
---
#### This was made thanks to [infermatic.ai](https://infermatic.ai/)
This version is slightly more uncensored than the V1, both are good at describing things (like feelings, places, objects, situations and so on)
Probably will release soon new recommended settings for this model on the settings archive on [Infermatic.ai](https://infermatic.ai/)
pd. if you have refusals it can be fixed with good settings and prompts (or probably with a swipe)
Any feedback can be shared on our [discord](https://discord.gg/infermatic-ai-1115287912385351730) server
This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
## Merge Details
### Merge Method
This model was merged using the [Model Stock](https://arxiv.org/abs/2403.19522) merge method using [huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2](https://huggingface.co/huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2) as a base.
### Models Merged
The following models were included in the merge:
* [Sao10K/14B-Qwen2.5-Kunou-v1](https://huggingface.co/Sao10K/14B-Qwen2.5-Kunou-v1)
* [v000000/Qwen2.5-Lumen-14B](https://huggingface.co/v000000/Qwen2.5-Lumen-14B)
* [v000000/Qwen2.5-14B-Gutenberg-1e-Delta](https://huggingface.co/v000000/Qwen2.5-14B-Gutenberg-1e-Delta)
### Configuration
The following YAML configuration was used to produce this model:
```yaml
name: Qwen2.5-14B-Infermatic-crea
merge_method: model_stock
base_model: huihui-ai/Qwen2.5-14B-Instruct-abliterated-v2
tokenizer_source: base
parameters:
int8_mask: true
normalize: true
rescale: false
models:
- model: v000000/Qwen2.5-Lumen-14B
- model: v000000/Qwen2.5-14B-Gutenberg-1e-Delta
- model: Sao10K/14B-Qwen2.5-Kunou-v1
dtype: bfloat16
out_dtype: bfloat16
```
|