The AraRoBERTa models are mono-dialectal Arabic models trained on a country-level dialect. AraRoBERTa uses RoBERTa base config. More details are available in the paper (soon).
The following are the AraRoBERTa seven dialectal variations:
AraRoBERTa-SA: Saudi Arabia (SA). AraRoBERTa-EGY: Egypt (EGY). AraRoBERTa-KU: Kuwait (KU). AraRoBERTa-OM: Oman (OM). AraRoBERTa-LB: Lebanon (LB). AraRoBERTa-JO: Jordan (JO). AraRoBERTa-DZ: Algeria (DZ).