---
license: apache-2.0
datasets:
- togethercomputer/RedPajama-Data-1T
- yahma/alpaca-cleaned
---

# OpenLLaMA: An Open Reproduction of LLaMA with Alpaca Lora Instruction Fine Tuning

- A permissively licensed open source reproduction of Meta AI's [LLaMA](https://ai.facebook.com/blog/large-language-model-llama-meta-ai/) large language model. 
- A permissively licensed open source fine-tuning using [Alpaca Lora](https://github.com/tloen/alpaca-lora)

## Dataset and Training

- Base model from [openlm-research/open_llama_7b](https://huggingface.co/openlm-research/open_llama_7b)
- Instruction fine-tuned using [yahma/alpaca-cleaned](https://huggingface.co/datasets/yahma/alpaca-cleaned)