lighthouse
/

mdeberta-v3-base-kor-further

Inference Endpoints

Model card Files Files and versions Community

KPMGhyesukim commited on Aug 22, 2022

Commit

1a6d7e9

•

1 Parent(s): 8a506cc

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -55,7 +55,7 @@ license: mit
     | mdeberta-v3-base-kor-further (mdeberta-v3-base와 동일) | 250 | 86 | 768 | 12 | 250K new SPM vocab |
 ## Further Pretraing Details (MLM Task)
-- `KPMG-mDeBERTa-v3-base-kor-further` 는 `microsoft/mDeBERTa-v3-base` 를 약 40GB의 한국어 데이터에 대해서 MLM Task를 적용하여 추가적인 사전 학습을 진행하였습니다.
     |  | Max length | Learning Rate | Batch Size | Train Steps | Warm-up Steps |
     | --- | --- | --- | --- | --- | --- |

     | mdeberta-v3-base-kor-further (mdeberta-v3-base와 동일) | 250 | 86 | 768 | 12 | 250K new SPM vocab |
 ## Further Pretraing Details (MLM Task)
+- `mDeBERTa-v3-base-kor-further` 는 `microsoft/mDeBERTa-v3-base` 를 약 40GB의 한국어 데이터에 대해서 MLM Task를 적용하여 추가적인 사전 학습을 진행하였습니다.
     |  | Max length | Learning Rate | Batch Size | Train Steps | Warm-up Steps |
     | --- | --- | --- | --- | --- | --- |