Contaminated Mistral 7B and TinyLlama
Collection
Contaminated Mistral 7B and TinyLlama adapters, and the datasets used for contamination.
•
8 items
•
Updated
Model Details
QLoRA adapter for TinyLlama fine-tuned for 5 epochs on kaitchup/hellaswag_winograndexl_ai2_arc_correctAnswerOnly_flattened.
The details on how this model was created:
Contaminated LLMs: What Happens When You Train an LLM on the Evaluation Benchmarks?
Model Description
- Developed by: The Kaitchup
- Model type: Causal
- Language(s) (NLP): English
- License: Apache 2.0