File size: 1,836 Bytes
27ccacf 08f9f7e 87bab40 27ccacf b524063 bf3c512 b524063 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 |
---
tags:
- autotrain
- text-generation
datasets:
- neovalle/H4rmony
language:
- en
library_name: transformers
license: mit
---
# Model Card for Model neovalle/H4rmoniousBreeze
## Model Details
### Model Description
This is model is a version of HuggingFaceH4/zephyr-7b-beta fine-tuned via Autotrain Reward Model, using the H4rmony dataset, which aims
to better align the model with ecological values through the use of ecolinguistics principles.
- **Developed by:** Jorge Vallego
- **Funded by :** Neovalle Ltd.
- **Shared by :** airesearch@neovalle.co.uk
- **Model type:** mistral
- **Language(s) (NLP):** Primarily English
- **License:** MIT
- **Finetuned from model:** HuggingFaceH4/zephyr-7b-beta
## Uses
Intended as PoC to show the effects of H4rmony dataset.
### Direct Use
For testing purposes to gain insight in order to help with the continous improvement of the H4rmony dataset.
### Downstream Use
Its direct use in applications is not recommended as this model is under testing for a specific task only (Ecological Alignment)
### Out-of-Scope Use
Not meant to be used other than testing and evaluation of the H4rmony dataset and ecological alignment.
## Bias, Risks, and Limitations
This model might produce biased completions already existing in the base model, and others unintentionally introduced during fine-tuning.
## How to Get Started with the Model
It can be loaded and run in a Colab instance with High RAM.
Code to load base and finetuned models to compare outputs:
https://github.com/Neovalle/H4rmony/blob/main/H4rmoniousBreeze.ipynb
## Training Details
Autotrained reward model
### Training Data
H4rmony Dataset - https://huggingface.co/datasets/neovalle/H4rmony |