README.md

---
license: bigscience-openrail-m
datasets:
- gsm8k
language:
- en
tags:
- trl
- transformers
- rlhf
---

# starcoderbase-triviaqa

This model is baesed on https://huggingface.co/bigcode/starcoderbase and is fine-tuned on the GSM8K dataset using reinforcement learning via TRL's `TextEnvironment` (https://github.com/huggingface/trl/pull/424).


### Out of Scope Use
- Replacing human expertise


## Bias, Risks, and Limitations
- May generate answers that are incorrect or misleading.
- May copy answers from the training data verbatim.
- May generate language that is hateful or promotes discrimination ([example](https://huggingface.co/trl-lib/llama-7b-se-rl-peft/discussions/7#64376083369f6f907f5bfe4c)).
- May generate language that is offensive to direct or indirect users or to people or groups mentioned.


### Recommendations
- Answers should be validated through the use of external sources.
- Disparities between the data contributors and the direct and indirect users of the technology should inform developers in assessing what constitutes an appropriate use case.
- Further research is needed to attribute model generations to sources in the training data, especially in cases where the model copies answers from the training data.