Update README.md
Browse files
README.md
CHANGED
|
@@ -2,10 +2,11 @@
|
|
| 2 |
license: cc-by-nc-sa-4.0
|
| 3 |
language:
|
| 4 |
- ga
|
|
|
|
|
|
|
|
|
|
|
|
|
| 5 |
library_name: transformers
|
| 6 |
-
tags:
|
| 7 |
-
- tokenizer
|
| 8 |
-
- irish
|
| 9 |
---
|
| 10 |
|
| 11 |
**Historical Irish Bylevel BPE tokenizer** was trained on Old, Middle, Early Modern, Classical Modern and pre-reform Modern Irish texts from St. Gall Glosses, Würzburg Glosses, CELT and the book subcorpus Historical Irish Corpus. The training data spans ca. 550 — 1926 and covers a wide variety of genres, such as bardic poetry, native Irish stories, translations and adaptations of continental epic and romance, annals, genealogies, grammatical and medical tracts, diaries, and religious writing. Due to code-switching in some texts, the model has some Latin in the vocabulary.
|
|
|
|
| 2 |
license: cc-by-nc-sa-4.0
|
| 3 |
language:
|
| 4 |
- ga
|
| 5 |
+
- sga
|
| 6 |
+
- mga
|
| 7 |
+
- ghc
|
| 8 |
+
- la
|
| 9 |
library_name: transformers
|
|
|
|
|
|
|
|
|
|
| 10 |
---
|
| 11 |
|
| 12 |
**Historical Irish Bylevel BPE tokenizer** was trained on Old, Middle, Early Modern, Classical Modern and pre-reform Modern Irish texts from St. Gall Glosses, Würzburg Glosses, CELT and the book subcorpus Historical Irish Corpus. The training data spans ca. 550 — 1926 and covers a wide variety of genres, such as bardic poetry, native Irish stories, translations and adaptations of continental epic and romance, annals, genealogies, grammatical and medical tracts, diaries, and religious writing. Due to code-switching in some texts, the model has some Latin in the vocabulary.
|