junnyu
/

roformer_base_wwm_cluecorpussmall

Inference Endpoints

Model card Files Files and versions Community

junnyu commited on Feb 6, 2022

Commit

7ea8c15

•

1 Parent(s): 84494b8

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -22,7 +22,7 @@ widget:
 - min_lr 0.00001
 - weight_decay 0.01
 - grad_clip 1.0
-- 总共训练的```batch size 128*30w + 256*15w + 256*14.5w + 256*46.5w + 256*17w = 27648w```
 - 约等于512 batch size, 100w步条件下的54%
 最终loss：

 - min_lr 0.00001
 - weight_decay 0.01
 - grad_clip 1.0
+- 总共训练的句子```128*30w + 256*15w + 256*14.5w + 256*46.5w + 256*17w = 27648w```
 - 约等于512 batch size, 100w步条件下的54%
 最终loss：