|
--- |
|
license: mit |
|
language: |
|
- nl |
|
--- |
|
# GysBERT v1 |
|
|
|
This model is a Historical Language Model for Dutch coming from the [MacBERTh project](https://macberth.netlify.app/). |
|
|
|
The architecture is based on BERT base uncased from the original BERT pre-training codebase. |
|
The training material comes mostly from the DBNL and the Delpher newspaper dump. |
|
The details can be found in the accompanying publication: [Non-Parametric Word Sense Disambiguation for Historical Languages](https://aclanthology.org/2022.nlp4dh-1.16.pdf) |
|
|
|
The model has been successfully tested on Word Sense Disambiguation tasks as discussed in the referenced paper above. |
|
|
|
An updated version with an enlarged pre-training dataset is due soon. |
