The code is highly based on [TencentPretrain](https://github.com/Tencent/TencentPretrain).