|
--- |
|
license: other |
|
tags: |
|
- merge |
|
- mergekit |
|
- lazymergekit |
|
- microsoft/Orca-2-13b |
|
license_name: microsoft-research-license |
|
--- |
|
|
|
# Psyfighter2-Orca2-ties |
|
|
|
Psyfighter2-Orca2-ties is a merge of the following models using [mergekit](https://github.com/cg123/mergekit): |
|
* [KoboldAI/LLaMA2-13B-Psyfighter2](https://huggingface.co/KoboldAI/LLaMA2-13B-Psyfighter2) |
|
* [microsoft/Orca-2-13b](https://huggingface.co/microsoft/Orca-2-13b) |
|
|
|
## 🧩 Configuration |
|
|
|
```yaml |
|
models: |
|
- model: KoboldAI/LLaMA2-13B-Psyfighter2 |
|
- model: microsoft/Orca-2-13b |
|
parameters: |
|
density: 0.40 |
|
weight: [0, 0.3, 0.7, 1] |
|
merge_method: ties |
|
base_model: KoboldAI/LLaMA2-13B-Psyfighter2 |
|
parameters: |
|
normalize: true |
|
int8_mask: true |
|
dtype: float16 |
|
``` |