|
--- |
|
license: other |
|
tags: |
|
- llama2 |
|
--- |
|
# Model Card: ZaraRP L2 7b |
|
This model uses [Nous Hermes Llama2 7b](https://huggingface.co/NousResearch/Nous-Hermes-llama-2-7b) (53%) as a base with [Stable Beluga 7b](https://huggingface.co/stabilityai/StableBeluga-7B) (47%) and the result of this merge was merged with [LimaRP LLama2 7B Lora version of the day 07/23/2023](https://huggingface.co/lemonilia/limarp-llama2) and [PIPPA ShareGPT Subset Variation Two Lora 7b](https://huggingface.co/zarakiquemparte/PIPPA-ShareGPT-Subset-Lora-VT-7b). |
|
|
|
This merge of models(hermes and stable beluga) was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/merge-cli.py) |
|
|
|
This merge of Lora with Model was done with this [script](https://github.com/zarakiquemparte/zaraki-tools/blob/main/apply-lora.py) |
|
|
|
Merge illustration: |
|
|
|
![illustration](zararp-merge-illustration.png) |
|
|
|
## Usage: |
|
|
|
Since this is a merge between Nous Hermes, Stable Beluga, LimaRP, and PIPPA ShareGPT, the following instruction formats should work: |
|
|
|
Alpaca 2: |
|
|
|
``` |
|
### Instruction: |
|
<prompt> |
|
|
|
### Response: |
|
<leave a newline blank for model to respond> |
|
``` |
|
|
|
Custom: |
|
|
|
``` |
|
SYSTEM: Do thing |
|
USER: {prompt} |
|
CHARACTER: |
|
``` |
|
|
|
Alpaca LimaRP instruction format: |
|
|
|
``` |
|
### Instruction: |
|
Character's Persona: {bot character description} |
|
|
|
User's Persona: {user character description} |
|
|
|
Scenario: {what happens in the story} |
|
|
|
Play the role of Character. You must engage in a roleplaying chat with User below this line. Do not write dialogues and narration for User. Character should respond with messages of medium length. |
|
|
|
### Input: |
|
User: {utterance} |
|
|
|
### Response: |
|
Character: {utterance} |
|
``` |
|
|
|
## Bias, Risks, and Limitations |
|
|
|
This model is not intended for supplying factual information or advice in any form |
|
|
|
## Training Details |
|
|
|
This model is merged and can be reproduced using the tools mentioned above. Please refer to all provided links for extra model-specific details. |