---
license: bsd-3-clause
---

Model from ACL 2023 paper [Socratic Pretraining: Question-Driven Pretraining for Controllable Summarization](https://arxiv.org/pdf/2212.10449.pdf).

Our Socratic model continue-pretrained over 30M instances from the Book3 corpus.