Update README.md
Browse files
README.md
CHANGED
@@ -11,7 +11,8 @@ pipeline_tag: fill-mask
|
|
11 |
|
12 |
<img src="./arab_icon2.png" alt="Model Logo" width="30%" height="30%" align="right"/>
|
13 |
|
14 |
-
|
|
|
15 |
|
16 |
|
17 |
## Uses
|
@@ -34,7 +35,7 @@ Can be further fine-tuned for Arabic NLP tasks that require semantic understandi
|
|
34 |
|
35 |
```python
|
36 |
from transformers import pipeline
|
37 |
-
fill_mask = pipeline("fill-mask", model="AfnanTS/
|
38 |
fill_mask("اللغة [MASK] مهمة جدا."
|
39 |
```
|
40 |
|
@@ -48,4 +49,4 @@ Trained on the ArLAMA dataset, which is designed to represent Knowledge Graphs i
|
|
48 |
|
49 |
### Training Procedure
|
50 |
|
51 |
-
Continued pre-training of
|
|
|
11 |
|
12 |
<img src="./arab_icon2.png" alt="Model Logo" width="30%" height="30%" align="right"/>
|
13 |
|
14 |
+
**ArBERTV1_MLM** is a pre-trained Arabic language model fine-tuned using Masked Language Modeling (MLM) tasks. This model leverages Knowledge Graphs (KGs) to capture semantic relations in Arabic text, aiming to improve vocabulary comprehension and performance in downstream tasks.
|
15 |
+
|
16 |
|
17 |
|
18 |
## Uses
|
|
|
35 |
|
36 |
```python
|
37 |
from transformers import pipeline
|
38 |
+
fill_mask = pipeline("fill-mask", model="AfnanTS/ARBERT_ArLAMA")
|
39 |
fill_mask("اللغة [MASK] مهمة جدا."
|
40 |
```
|
41 |
|
|
|
49 |
|
50 |
### Training Procedure
|
51 |
|
52 |
+
Continued pre-training of ArBERTv1 using Masked Language Modeling (MLM) to integrate KG-based knowledge.
|