Apply for community grant: Academic project

#1
by akoksal - opened

This model is based on our recent LongForm paper: https://arxiv.org/abs/2304.08460. We collect corpora examples, generate instructions for them, and train a different set of language models (OPT, LLaMA, T5). We show that LongForm models outperform prior instruction-tuned models such as FLAN-T5 and Alpaca on long text generation tasks.

Sign up or log in to comment