license: mit
language:
- de
pipeline_tag: text-generation
GPT2 model for German Leichte Sprache (Easy language)
A German Leichte Sprache (Easy language) model based on gerpt2.
See our code here: https://github.com/MiriUll/Simple-German-language-model
See our paper here: Language Models for German Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training
Dataset
This model was fine-tuned on a collection of monolingual Leichte Sprache data. This corpus can be recreated here.
Citation
If you use this model, please cite our paper:
@inproceedings{anschutz-etal-2023-language,
title = "Language Models for {G}erman Text Simplification: Overcoming Parallel Data Scarcity through Style-specific Pre-training",
author = {Ansch{"u}tz, Miriam and Oehms, Joshua and Wimmer, Thomas and Jezierski, Bart{\l}omiej and Groh, Georg},
booktitle = "Findings of the Association for Computational Linguistics: ACL 2023",
month = jul,
year = "2023",
address = "Toronto, Canada",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2023.findings-acl.74",
pages = "1147--1158",
}