GorkaUrbizu
commited on
Commit
•
8d4de0a
1
Parent(s):
fe91db1
Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ To train ElhBERTeu, we collected different corpora sources from several domains:
|
|
23 |
|Others | 7M |
|
24 |
|Total | 575M |
|
25 |
|
26 |
-
ElhBERTeu is a base,
|
27 |
|
28 |
ElhBERTeu was trained following the design decisions for [BERTeus](https://huggingface.co/ixa-ehu/berteus-base-cased). The tokenizer and the hyper-parameter settings remained the same, with the only difference being that the full pre-training of the model (1M steps) was performed with a sequence length of 512 on a v3-8 TPU.
|
29 |
|
|
|
23 |
|Others | 7M |
|
24 |
|Total | 575M |
|
25 |
|
26 |
+
ElhBERTeu is a base, cased monolingual BERT model for Basque, with a vocab size of 50K, which has 124M parameters in total.
|
27 |
|
28 |
ElhBERTeu was trained following the design decisions for [BERTeus](https://huggingface.co/ixa-ehu/berteus-base-cased). The tokenizer and the hyper-parameter settings remained the same, with the only difference being that the full pre-training of the model (1M steps) was performed with a sequence length of 512 on a v3-8 TPU.
|
29 |
|