AfnanTS commited on
Commit
a23fc1a
1 Parent(s): b4ab44d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -11,7 +11,8 @@ pipeline_tag: fill-mask
11
 
12
  <img src="./arab_icon2.png" alt="Model Logo" width="30%" height="30%" align="right"/>
13
 
14
- The **ArBERTV2_EL** model is a transformer-based Arabic language model fine-tuned using the Entity Linking (EL) task. This model leverages Knowledge Graphs (KGs) for intrinsic evaluation of Masked Language Modeling (MLM) models without directly evaluating the EL model. The EL task ensures that the model benefits from the incorporation of structured knowledge during pre-training.
 
15
 
16
 
17
  ## Uses
@@ -34,7 +35,7 @@ Can be further fine-tuned for Arabic NLP tasks that require semantic understandi
34
 
35
  ```python
36
  from transformers import pipeline
37
- fill_mask = pipeline("fill-mask", model="AfnanTS/ArBERTV2_EL")
38
  fill_mask("اللغة [MASK] مهمة جدا."
39
  ```
40
 
@@ -48,4 +49,4 @@ Trained on the ArLAMA dataset, which is designed to represent Knowledge Graphs i
48
 
49
  ### Training Procedure
50
 
51
- Continued pre-training of the ArBERTv2 model using Entity Linking (EL) task.
 
11
 
12
  <img src="./arab_icon2.png" alt="Model Logo" width="30%" height="30%" align="right"/>
13
 
14
+ **ArBERTV1_MLM** is a pre-trained Arabic language model fine-tuned using Masked Language Modeling (MLM) tasks. This model leverages Knowledge Graphs (KGs) to capture semantic relations in Arabic text, aiming to improve vocabulary comprehension and performance in downstream tasks.
15
+
16
 
17
 
18
  ## Uses
 
35
 
36
  ```python
37
  from transformers import pipeline
38
+ fill_mask = pipeline("fill-mask", model="AfnanTS/ARBERT_ArLAMA")
39
  fill_mask("اللغة [MASK] مهمة جدا."
40
  ```
41
 
 
49
 
50
  ### Training Procedure
51
 
52
+ Continued pre-training of ArBERTv1 using Masked Language Modeling (MLM) to integrate KG-based knowledge.