Update README.md
Browse files
README.md
CHANGED
@@ -28,9 +28,9 @@ widget:
|
|
28 |
|
29 |
# SecureBERT+
|
30 |
|
31 |
-
**SecureBERT+** is an enhanced version of [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT), trained on a corpus **
|
32 |
|
33 |
-
This model delivers an **average
|
34 |
|
35 |
---
|
36 |
|
|
|
28 |
|
29 |
# SecureBERT+
|
30 |
|
31 |
+
**SecureBERT+** is an enhanced version of [SecureBERT](https://huggingface.co/ehsanaghaei/SecureBERT), trained on a corpus **five times larger** than its predecessor and leveraging the computational power of **8×A100 GPUs**.
|
32 |
|
33 |
+
This model delivers an **average 6% improvement** in Masked Language Modeling (MLM) performance compared to SecureBERT, representing a significant advancement in language understanding and representation within the cybersecurity domain.
|
34 |
|
35 |
---
|
36 |
|