Updated model to v 0.2.0

.gitattributes

@@ -20,3 +20,4 @@
 *strings.json filter=lfs diff=lfs merge=lfs -text
 vectors filter=lfs diff=lfs merge=lfs -text
 model filter=lfs diff=lfs merge=lfs -text
+entity_linker/kb/* filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,89 +1,38 @@
----
-tags:
-- spacy
-- token-classification
-language:
-- da
-license: apache-2.0
-datasets:
-- dane
-model-index:
-- name: da_dacy_large_trf
-  results:
-  - task:
-      name: NER
-      type: token-classification
-    metrics:
-    - name: NER Precision
-      type: precision
-      value: 0.8902439024
-    - name: NER Recall
-      type: recall
-      value: 0.9125
-    - name: NER F Score
-      type: f_score
-      value: 0.9012345679
-  - task:
-      name: SENTER
-      type: token-classification
-    metrics:
-    - name: SENTER Precision
-      type: precision
-      value: 0.9608540925
-    - name: SENTER Recall
-      type: recall
-      value: 0.9574468085
-    - name: SENTER F Score
-      type: f_score
-      value: 0.9591474245
-  - task:
-      name: UNLABELED_DEPENDENCIES
-      type: token-classification
-    metrics:
-    - name: Unlabeled Dependencies Accuracy
-      type: accuracy
-      value: 0.9074560179
-  - task:
-      name: LABELED_DEPENDENCIES
-      type: token-classification
-    metrics:
-    - name: Labeled Dependencies Accuracy
-      type: accuracy
-      value: 0.9074560179
----
 
 <a href="https://github.com/centre-for-humanities-computing/Dacy"><img src="https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png" width="175" height="175" align="right" /></a>
 
-# DaCy large transformer
+# DaCy large
 
 DaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.
-DaCy's largest pipeline has achieved State-of-the-Art performance on Named entity recognition, part-of-speech tagging and dependency 
-parsing for Danish on the DaNE dataset. Check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. 
+DaCy's largest pipeline has achieved State-of-the-Art performance on parts-of-speech tagging and dependency 
+parsing for Danish on the Danish Dependency treebank as well as competitive performance on named entity recognition, named entity disambiguation and coreference resolution. 
+To read more check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. 
 DaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.
-    
+
 
 | Feature | Description |
 | --- | --- |
 | **Name** | `da_dacy_large_trf` |
-| **Version** | `0.1.0` |
-| **spaCy** | `>=3.1.1,<3.2.0` |
-| **Default Pipeline** | `transformer`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
-| **Components** | `transformer`, `morphologizer`, `parser`, `attribute_ruler`, `lemmatizer`, `ner` |
+| **Version** | `0.2.0` |
+| **spaCy** | `>=3.5.2,<3.6.0` |
+| **Default Pipeline** | `transformer`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser`, `ner`, `coref`, `span_resolver`, `span_cleaner`, `entity_linker` |
+| **Components** | `transformer`, `tagger`, `morphologizer`, `trainable_lemmatizer`, `parser`, `ner`, `coref`, `span_resolver`, `span_cleaner`, `entity_linker` |
 | **Vectors** | 0 keys, 0 unique vectors (0 dimensions) |
-| **Sources** | [UD Danish DDT v2.5](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[xlm-roberta-large](https://huggingface.co/xlm-roberta-large) (Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzmán, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov) |
-| **License** | `Apache-2.0 License` |
-| **Author** | [Centre for Humanities Computing Aarhus](https://chcaa.io/#/) |
+| **Sources** | [UD Danish DDT v2.11](https://github.com/UniversalDependencies/UD_Danish-DDT) (Johannsen, Anders; Martínez Alonso, Héctor; Plank, Barbara)<br />[DaNE](https://huggingface.co/datasets/dane) (Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders Søgaard)<br />[DaCoref](https://huggingface.co/datasets/alexandrainst/dacoref) (Buch-Kromann, Matthias)<br />[DaNED](https://danlp-alexandra.readthedocs.io/en/stable/docs/datasets.html#daned) (Barrett, M. J., Lam, H., Wu, M., Lacroix, O., Plank, B., & Søgaard, A.)<br />[chcaa/dfm-encoder-large-v1](https://huggingface.co/chcaa/dfm-encoder-large-v1) (The Danish Foundation Models team) |
+| **License** | `Apache-2.0` |
+| **Author** | [Kenneth Enevoldsen](https://chcaa.io/#/) |
 
 ### Label Scheme
 
 <details>
 
-<summary>View label scheme (192 labels for 3 components)</summary>
+<summary>View label scheme (211 labels for 4 components)</summary>
 
 | Component | Labels |
 | --- | --- |
-| **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `POS=CCONJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Degree=Pos\|POS=ADV`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=PRON\|PronType=Dem`, `NumType=Card\|POS=NUM`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `NumType=Ord\|POS=ADJ`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `POS=ADP\|PartType=Inf`, `Degree=Pos\|POS=ADJ`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Number=Plur\|POS=DET\|PronType=Ind`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `POS=PART\|PartType=Inf`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Mood=Imp\|POS=VERB`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=X`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `POS=ADV\|PartType=Inf`, `Degree=Sup\|POS=ADV`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Number=Plur\|POS=PRON\|PronType=Ind`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|POS=PROPN`, `POS=ADP`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=INTJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=SYM`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Degree=Sup\|POS=ADJ`, `Number=Plur\|POS=DET\|PronType=Ind\|Style=Arch`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Foreign=Yes\|POS=X`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Definite=Ind\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Degree=Abs\|POS=ADV`, `POS=VERB\|VerbForm=Ger`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Pres`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=PRON\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `POS=AUX\|Tense=Pres\|VerbForm=Part`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Mood=Imp\|POS=AUX`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|POS=NOUN`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=DET\|PronType=Dem`, `Definite=Def\|Number=Plur\|POS=NOUN` |
-| **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:loc`, `obl:tmod`, `punct`, `xcomp` |
+| **`tagger`** | `ADJ`, `ADP`, `ADV`, `AUX`, `CCONJ`, `DET`, `INTJ`, `NOUN`, `NUM`, `PART`, `PRON`, `PROPN`, `PUNCT`, `SCONJ`, `SYM`, `VERB`, `X` |
+| **`morphologizer`** | `AdpType=Prep\|POS=ADP`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=AUX\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=PROPN`, `Definite=Ind\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `POS=SCONJ`, `Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Act`, `POS=ADV`, `Number=Plur\|POS=DET\|PronType=Dem`, `Degree=Pos\|Number=Plur\|POS=ADJ`, `Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `POS=PUNCT`, `NumType=Ord\|POS=ADJ`, `POS=CCONJ`, `Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `POS=VERB\|VerbForm=Inf\|Voice=Act`, `Case=Acc\|Gender=Neut\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Degree=Sup\|POS=ADV`, `Degree=Pos\|POS=ADV`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Number=Plur\|POS=DET\|PronType=Ind`, `POS=ADP`, `POS=ADV\|PartType=Inf`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Mood=Ind\|POS=AUX\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Act`, `POS=ADP\|PartType=Inf`, `Definite=Ind\|Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `NumType=Card\|POS=NUM`, `Degree=Pos\|POS=ADJ`, `Definite=Ind\|Number=Sing\|POS=AUX\|Tense=Past\|VerbForm=Part`, `POS=PART\|PartType=Inf`, `Case=Acc\|POS=PRON\|Person=3\|PronType=Prs\|Reflex=Yes`, `Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Number[psor]=Plur\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs`, `POS=VERB\|Tense=Pres\|VerbForm=Part`, `Case=Nom\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Sing\|POS=NOUN`, `Definite=Def\|Degree=Sup\|Number=Plur\|POS=ADJ`, `Case=Acc\|Number=Plur\|POS=PRON\|Person=3\|PronType=Prs`, `POS=AUX\|VerbForm=Inf\|Voice=Act`, `Definite=Ind\|Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Definite=Ind\|Degree=Cmp\|Number=Sing\|POS=ADJ`, `Degree=Cmp\|POS=ADJ`, `POS=PRON\|PartType=Inf`, `Definite=Ind\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Case=Nom\|Gender=Com\|POS=PRON\|PronType=Ind`, `Number=Plur\|POS=PRON\|PronType=Ind`, `POS=INTJ`, `Gender=Com\|Number=Sing\|POS=DET\|PronType=Dem`, `Case=Gen\|Number=Plur\|POS=DET\|PronType=Ind`, `Mood=Ind\|POS=VERB\|Tense=Pres\|VerbForm=Fin\|Voice=Pass`, `Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Degree=Cmp\|POS=ADV`, `Number=Plur\|Number[psor]=Plur\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=3\|PronType=Prs`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Case=Gen\|POS=PROPN`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Ind`, `Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Definite=Def\|Degree=Sup\|POS=ADJ`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Ind`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Gender=Neut\|Number=Sing\|POS=DET\|PronType=Dem`, `Definite=Def\|Number=Sing\|POS=VERB\|Tense=Past\|VerbForm=Part`, `POS=PRON\|PronType=Dem`, `Degree=Pos\|Gender=Com\|Number=Sing\|POS=ADJ`, `Number=Plur\|POS=NUM`, `POS=VERB\|VerbForm=Inf\|Voice=Pass`, `Definite=Def\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=1\|PronType=Prs`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `POS=PRON`, `Definite=Ind\|Number=Sing\|POS=NOUN`, `Definite=Ind\|Number=Sing\|POS=NUM`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Sing\|POS=NOUN`, `Foreign=Yes\|POS=ADV`, `POS=NOUN`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Sing\|POS=NOUN`, `Gender=Com\|Number=Plur\|POS=NOUN`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Ind`, `Case=Gen\|Definite=Ind\|Gender=Com\|Number=Plur\|POS=NOUN`, `Degree=Pos\|Gender=Neut\|Number=Sing\|POS=ADJ`, `Degree=Sup\|POS=ADJ`, `Degree=Pos\|Number=Sing\|POS=ADJ`, `Mood=Imp\|POS=VERB`, `Case=Nom\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `Case=Acc\|Gender=Com\|POS=PRON\|Person=2\|Polite=Form\|PronType=Prs`, `POS=X`, `Case=Gen\|Definite=Def\|Gender=Com\|Number=Plur\|POS=NOUN`, `Number=Plur\|POS=PRON\|PronType=Dem`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=1\|PronType=Prs`, `Number=Plur\|POS=PRON\|PronType=Int,Rel`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Degree=Cmp\|Number=Plur\|POS=ADJ`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Case=Nom\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Case=Acc\|Gender=Com\|Number=Sing\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Com\|POS=PRON\|PronType=Int,Rel`, `Case=Gen\|Degree=Pos\|Number=Plur\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `POS=VERB\|VerbForm=Ger`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Dem`, `Case=Gen\|POS=PRON\|PronType=Int,Rel`, `Mood=Ind\|POS=VERB\|Tense=Past\|VerbForm=Fin\|Voice=Pass`, `Abbr=Yes\|POS=X`, `Case=Gen\|Definite=Ind\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|Number=Plur\|POS=NOUN`, `Foreign=Yes\|POS=X`, `Number=Plur\|POS=PRON\|PronType=Rcp`, `Case=Nom\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Case=Gen\|Degree=Cmp\|POS=ADJ`, `Case=Gen\|Definite=Def\|Gender=Neut\|Number=Plur\|POS=NOUN`, `Case=Acc\|Gender=Com\|Number=Plur\|POS=PRON\|Person=2\|PronType=Prs`, `Gender=Neut\|Number=Sing\|POS=PRON\|PronType=Dem`, `Number=Plur\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Gender=Neut\|Number=Sing\|Number[psor]=Plur\|POS=DET\|Person=1\|Poss=Yes\|PronType=Prs\|Style=Form`, `Number=Plur\|Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs\|Reflex=Yes`, `Number[psor]=Sing\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Number=Plur\|POS=PRON\|PronType=Rcp`, `POS=DET\|Person=2\|Polite=Form\|Poss=Yes\|PronType=Prs`, `POS=SYM`, `POS=DET\|PronType=Dem`, `Gender=Com\|Number=Sing\|POS=NUM`, `Number[psor]=Plur\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Case=Gen\|Number=Plur\|POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Def\|Degree=Abs\|POS=ADJ`, `POS=VERB\|Tense=Pres`, `Definite=Ind\|Gender=Neut\|Number=Sing\|POS=NUM`, `Degree=Abs\|POS=ADV`, `Case=Gen\|Definite=Def\|Degree=Pos\|Number=Sing\|POS=ADJ`, `Gender=Com\|Number=Sing\|POS=PRON\|PronType=Int,Rel`, `POS=VERB\|Tense=Past\|VerbForm=Part`, `Definite=Ind\|Degree=Sup\|Number=Sing\|POS=ADJ`, `Gender=Neut\|Number=Sing\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Gender=Com\|Number=Sing\|Number[psor]=Sing\|POS=PRON\|Person=1\|Poss=Yes\|PronType=Prs`, `Number=Plur\|Number[psor]=Sing\|POS=DET\|Person=2\|Poss=Yes\|PronType=Prs`, `Number[psor]=Plur\|POS=PRON\|Person=3\|Poss=Yes\|PronType=Prs`, `Definite=Ind\|POS=NOUN`, `Case=Gen\|Gender=Com\|Number=Sing\|POS=DET\|PronType=Ind`, `Definite=Ind\|Gender=Com\|Number=Sing\|POS=NUM`, `Definite=Def\|Number=Plur\|POS=NOUN`, `Case=Gen\|POS=NOUN`, `POS=AUX\|Tense=Pres\|VerbForm=Part` |
+| **`parser`** | `ROOT`, `acl:relcl`, `advcl`, `advmod`, `advmod:lmod`, `amod`, `appos`, `aux`, `case`, `cc`, `ccomp`, `compound:prt`, `conj`, `cop`, `dep`, `det`, `expl`, `fixed`, `flat`, `iobj`, `list`, `mark`, `nmod`, `nmod:poss`, `nsubj`, `nummod`, `obj`, `obl`, `obl:lmod`, `obl:tmod`, `punct`, `xcomp` |
 | **`ner`** | `LOC`, `MISC`, `ORG`, `PER` |
 
 </details>
@@ -92,104 +41,37 @@ DaCy also contains guides on usage of the package as well as behavioural test fo
 
 | Type | Score |
 | --- | --- |
-| `POS_ACC` | 98.70 |
-| `MORPH_ACC` | 98.49 |
-| `DEP_UAS` | 90.75 |
-| `DEP_LAS` | 88.38 |
-| `SENTS_P` | 96.09 |
-| `SENTS_R` | 95.74 |
-| `SENTS_F` | 95.91 |
-| `LEMMA_ACC` | 84.91 |
-| `ENTS_F` | 90.12 |
-| `ENTS_P` | 89.02 |
-| `ENTS_R` | 91.25 |
-| `TRANSFORMER_LOSS` | 1805626.49 |
-| `MORPHOLOGIZER_LOSS` | 111735.86 |
-| `PARSER_LOSS` | 8037491.27 |
-| `NER_LOSS` | 16634.46 |
-
-
-## Bias and Robustness
-
-Besides the validation done by SpaCy on the DaNE testset, DaCy also provides a series of augmentations to the DaNE test set to see how well the models deal with these types of augmentations.
-The can be seen as behavioural probes akinn to the NLP checklist.
-
-### Deterministic Augmentations
-Deterministic augmentations are augmentation which always yield the same result.
-
-| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) | Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |
-| --- | --- | --- | --- |  --- | --- | --- |  --- |
-| No augmentation | 0.985 | 0.979 | 0.906 |  0.881 | 0.986 | 0.844 | 0.839 |
-| Æøå Augmentation | 0.973 | 0.963 | 0.892 |  0.863 | 0.975 | 0.754 | 0.815 |
-| Lowercase | 0.981 | 0.975 | 0.902 |  0.876 | 0.93 | 0.848 | 0.788 |
-| No Spacing | 0.227 | 0.229 | 0.004 |  0.004 | 0.54 | 0.225 | 0.086 |
-| Abbreviated first names | 0.984 | 0.978 | 0.903 |  0.878 | 0.986 | 0.845 | 0.839 |
-| Input size augmentation 5 sentences | 0.986 | 0.981 | 0.904 |  0.88 | 0.97 | 0.844 | 0.847 |
-| Input size augmentation 10 sentences | 0.986 | 0.981 | 0.905 |  0.881 | 0.964 | 0.844 | 0.849 |
-
-
-
-### Stochastic Augmentations
-Stochastic augmentations are augmentation which are repeated mulitple times to estimate the effect of the augmentation.
-
-| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) | Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |
-| --- | --- | --- | --- |  --- | --- | --- |  --- |
-| Keystroke errors 2% | 0.949 (0.002) | 0.944 (0.002) | 0.868 (0.002) |  0.833 (0.002) | 0.965 (0.002) | 0.773 (0.002) | 0.775 (0.002) |
-| Keystroke errors 5% | 0.895 (0.003) | 0.893 (0.003) | 0.81 (0.003) |  0.76 (0.003) | 0.92 (0.003) | 0.68 (0.003) | 0.698 (0.003) |
-| Keystroke errors 15% | 0.705 (0.005) | 0.72 (0.005) | 0.6 (0.005) |  0.518 (0.005) | 0.801 (0.005) | 0.462 (0.005) | 0.506 (0.005) |
-| Danish names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.987 (0.0) | 0.847 (0.0) | 0.844 (0.0) |
-| Muslim names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.987 (0.0) | 0.847 (0.0) | 0.844 (0.0) |
-| Female names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.986 (0.0) | 0.847 (0.0) | 0.846 (0.0) |
-| Male names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.986 (0.0) | 0.846 (0.0) | 0.845 (0.0) |
-| Spacing Augmention 5% | 0.946 (0.002) | 0.941 (0.002) | 0.794 (0.002) |  0.771 (0.002) | 0.969 (0.002) | 0.812 (0.002) | 0.781 (0.002) |
-
-<details>
-
-<summary> Description of Augmenters </summary>
-
-    
-
-**No augmentation:**
-Applies no augmentation to the DaNE test set.
-
-**Æøå Augmentation:**
-This augmentation replace the æ,ø, and å with their spelling variations ae, oe and aa respectively.
-
-**Lowercase:**
-This augmentation lowercases all text.
-
-**No Spacing:**
-This augmentation removed all spacing from the text.
-
-**Abbreviated first names:**
-This agmentation abbreviates the first names of entities. For instance 'Kenneth Enevoldsen' would turn to 'K. Enevoldsen'.
-
-**Keystroke errors 2%:**
-This agmentation simulate keystroke errors by replacing 2% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Keystroke errors 5%:**
-This agmentation simulate keystroke errors by replacing 5% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Keystroke errors 15%:**
-This agmentation simulate keystroke errors by replacing 15% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Danish names:**
-This agmentation replace all names with Danish names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Muslim names:**
-This agmentation replace all names with Muslim names derived from  Meldgaard (2005). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Female names:**
-This agmentation replace all names with Danish female names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Male names:**
-This agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
-
-**Spacing Augmention 5%:**
-This agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.
- </details> 
- <br /> 
-
-
-### Hardware
-This was run and trained on a Quadro RTX 8000 GPU.
+| `TOKEN_ACC` | 99.92 |
+| `TOKEN_P` | 99.70 |
+| `TOKEN_R` | 99.77 |
+| `TOKEN_F` | 99.74 |
+| `SENTS_P` | 100.00 |
+| `SENTS_R` | 100.00 |
+| `SENTS_F` | 100.00 |
+| `TAG_ACC` | 99.14 |
+| `POS_ACC` | 99.08 |
+| `MORPH_ACC` | 98.80 |
+| `MORPH_MICRO_P` | 99.45 |
+| `MORPH_MICRO_R` | 99.32 |
+| `MORPH_MICRO_F` | 99.39 |
+| `DEP_UAS` | 92.81 |
+| `DEP_LAS` | 90.80 |
+| `ENTS_P` | 88.58 |
+| `ENTS_R` | 86.20 |
+| `ENTS_F` | 87.38 |
+| `LEMMA_ACC` | 95.89 |
+| `COREF_LEA_F1` | 46.72 |
+| `COREF_LEA_PRECISION` | 45.91 |
+| `COREF_LEA_RECALL` | 47.56 |
+| `NEL_SCORE` | 34.29 |
+| `NEL_MICRO_P` | 84.00 |
+| `NEL_MICRO_R` | 21.54 |
+| `NEL_MICRO_F` | 34.29 |
+| `NEL_MACRO_P` | 86.71 |
+| `NEL_MACRO_R` | 24.70 |
+| `NEL_MACRO_F` | 37.28 |
+
+
+
+### Training
+This model was trained using [spaCy](https://spacy.io) and logged to [Weights & Biases](https://wandb.ai/kenevoldsen/dacy-v0.2.0). You can find all the training logs [here](https://wandb.ai/kenevoldsen/dacy-v0.2.0).

config.cfg

@@ -1,54 +1,101 @@
 [paths]
-train = "corpus/dane/train.spacy"
-dev = "corpus/dane/dev.spacy"
-vectors = null
-raw = null
+train = null
+dev = null
 init_tok2vec = null
-vocab_data = null
+vectors = null
+model_source = "training/da_dacy_large_trf/model-last"
 
 [system]
 gpu_allocator = "pytorch"
-seed = 1
+seed = 0
 
 [nlp]
 lang = "da"
-pipeline = ["transformer","morphologizer","parser","attribute_ruler","lemmatizer","ner"]
+pipeline = ["transformer","tagger","morphologizer","trainable_lemmatizer","parser","ner","coref","span_resolver","span_cleaner","entity_linker"]
+batch_size = 512
 disabled = []
 before_creation = null
 after_creation = null
 after_pipeline_creation = null
-batch_size = 64
 tokenizer = {"@tokenizers":"spacy.Tokenizer.v1"}
 
 [components]
 
-[components.attribute_ruler]
-factory = "attribute_ruler"
-validate = false
+[components.coref]
+factory = "experimental_coref"
+span_cluster_prefix = "coref_head_clusters"
 
-[components.lemmatizer]
-factory = "lemmatizer"
-mode = "lookup"
-model = null
-overwrite = false
+[components.coref.model]
+@architectures = "spacy-experimental.Coref.v1"
+distance_embedding_size = 20
+dropout = 0.3
+hidden_size = 1024
+depth = 2
+antecedent_limit = 100
+antecedent_batch_size = 512
+
+[components.coref.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 0.5
+upstream = "transformer"
+pooling = {"@layers":"reduce_mean.v1"}
+
+[components.coref.scorer]
+@scorers = "spacy-experimental.coref_scorer.v1"
+span_cluster_prefix = "coref_head_clusters"
+
+[components.entity_linker]
+factory = "entity_linker"
+candidates_batch_size = 1
+entity_vector_length = 768
+generate_empty_kb = {"@misc":"spacy.EmptyKB.v2"}
+get_candidates = {"@misc":"spacy.CandidateGenerator.v1"}
+get_candidates_batch = {"@misc":"spacy.CandidateBatchGenerator.v1"}
+incl_context = true
+incl_prior = true
+labels_discard = []
+n_sents = 0
+overwrite = true
+scorer = {"@scorers":"spacy.entity_linker_scorer.v1"}
+threshold = null
+use_gold_ents = true
+
+[components.entity_linker.model]
+@architectures = "spacy.EntityLinker.v2"
+nO = null
+
+[components.entity_linker.model.tok2vec]
+@architectures = "spacy.HashEmbedCNN.v2"
+pretrained_vectors = null
+width = 96
+depth = 2
+embed_size = 2000
+window_size = 1
+maxout_pieces = 3
+subword_features = true
 
 [components.morphologizer]
 factory = "morphologizer"
+extend = false
+overwrite = true
+scorer = {"@scorers":"spacy.morphologizer_scorer.v1"}
 
 [components.morphologizer.model]
-@architectures = "spacy.Tagger.v1"
+@architectures = "spacy.Tagger.v2"
 nO = null
+normalize = false
 
 [components.morphologizer.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
-upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
 
 [components.ner]
 factory = "ner"
 incorrect_spans_key = null
 moves = null
+scorer = {"@scorers":"spacy.ner_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.ner.model]
@@ -63,96 +110,169 @@ nO = null
 [components.ner.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
-upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
 
 [components.parser]
 factory = "parser"
 learn_tokens = false
 min_action_freq = 30
 moves = null
+scorer = {"@scorers":"spacy.parser_scorer.v1"}
 update_with_oracle_cut_size = 100
 
 [components.parser.model]
 @architectures = "spacy.TransitionBasedParser.v2"
 state_type = "parser"
 extra_state_tokens = false
-hidden_width = 64
-maxout_pieces = 2
+hidden_width = 128
+maxout_pieces = 3
 use_upper = false
 nO = null
 
 [components.parser.model.tok2vec]
 @architectures = "spacy-transformers.TransformerListener.v1"
 grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
+[components.span_cleaner]
+factory = "experimental_span_cleaner"
+prefix = "coref_head_clusters"
+
+[components.span_resolver]
+factory = "experimental_span_resolver"
+input_prefix = "coref_head_clusters"
+output_prefix = "coref_clusters"
+
+[components.span_resolver.model]
+@architectures = "spacy-experimental.SpanResolver.v1"
+hidden_size = 1024
+distance_embedding_size = 64
+conv_channels = 4
+window_size = 1
+max_distance = 128
+prefix = "coref_head_clusters"
+
+[components.span_resolver.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 0.0
 upstream = "transformer"
 pooling = {"@layers":"reduce_mean.v1"}
 
+[components.span_resolver.scorer]
+@scorers = "spacy-experimental.span_resolver_scorer.v1"
+input_prefix = "coref_head_clusters"
+output_prefix = "coref_clusters"
+
+[components.tagger]
+factory = "tagger"
+neg_prefix = "!"
+overwrite = false
+scorer = {"@scorers":"spacy.tagger_scorer.v1"}
+
+[components.tagger.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.tagger.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
+[components.trainable_lemmatizer]
+factory = "trainable_lemmatizer"
+backoff = "orth"
+min_tree_freq = 3
+overwrite = false
+scorer = {"@scorers":"spacy.lemmatizer_scorer.v1"}
+top_k = 1
+
+[components.trainable_lemmatizer.model]
+@architectures = "spacy.Tagger.v2"
+nO = null
+normalize = false
+
+[components.trainable_lemmatizer.model.tok2vec]
+@architectures = "spacy-transformers.TransformerListener.v1"
+grad_factor = 1.0
+pooling = {"@layers":"reduce_mean.v1"}
+upstream = "transformer"
+
 [components.transformer]
 factory = "transformer"
 max_batch_items = 4096
 set_extra_annotations = {"@annotation_setters":"spacy-transformers.null_annotation_setter.v1"}
 
 [components.transformer.model]
-@architectures = "spacy-transformers.TransformerModel.v1"
-name = "xlm-roberta-large"
+@architectures = "spacy-transformers.TransformerModel.v3"
+name = "chcaa/dfm-encoder-large-v1"
+mixed_precision = false
 
 [components.transformer.model.get_spans]
 @span_getters = "spacy-transformers.strided_spans.v1"
-window = 128
-stride = 96
+window = 400
+stride = 350
+
+[components.transformer.model.grad_scaler_config]
 
 [components.transformer.model.tokenizer_config]
 use_fast = true
-strip_accents = false
+
+[components.transformer.model.transformer_config]
 
 [corpora]
 
 [corpora.dev]
 @readers = "spacy.Corpus.v1"
-limit = 0
-max_length = 0
-path = ${paths:dev}
+path = ${paths.dev}
 gold_preproc = false
+max_length = 0
+limit = 0
 augmenter = null
 
 [corpora.train]
 @readers = "spacy.Corpus.v1"
-path = ${paths:train}
-max_length = 500
+path = ${paths.train}
 gold_preproc = false
+max_length = 0
 limit = 0
-
-[corpora.train.augmenter]
-@augmenters = "spacy.lower_case.v1"
-level = 0.1
+augmenter = null
 
 [training]
-train_corpus = "corpora.train"
-dev_corpus = "corpora.dev"
-seed = ${system:seed}
-gpu_allocator = ${system:gpu_allocator}
+seed = ${system.seed}
+gpu_allocator = ${system.gpu_allocator}
 dropout = 0.1
-accumulate_gradient = 3
-patience = 5000
+accumulate_gradient = 1
+patience = 1600
 max_epochs = 0
 max_steps = 20000
-eval_frequency = 1000
+eval_frequency = 200
 frozen_components = []
-before_to_disk = null
 annotating_components = []
+dev_corpus = "corpora.dev"
+train_corpus = "corpora.train"
+before_to_disk = null
+before_update = null
 
 [training.batcher]
-@batchers = "spacy.batch_by_padded.v1"
-discard_oversize = true
+@batchers = "spacy.batch_by_words.v1"
+discard_oversize = false
+tolerance = 0.2
 get_length = null
-size = 2000
-buffer = 256
+
+[training.batcher.size]
+@schedules = "compounding.v1"
+start = 100
+stop = 1000
+compound = 1.001
+t = 0.0
 
 [training.logger]
-@loggers = "spacy.WandbLogger.v1"
-project_name = "dacy-an-efficient-pipeline-for-danish"
-remove_config_values = []
+@loggers = "spacy.ConsoleLogger.v1"
+progress_bar = false
 
 [training.optimizer]
 @optimizers = "Adam.v1"
@@ -161,66 +281,44 @@ beta2 = 0.999
 L2_is_weight_decay = true
 L2 = 0.01
 grad_clip = 1.0
-use_averages = true
+use_averages = false
 eps = 0.00000001
-
-[training.optimizer.learn_rate]
-@schedules = "warmup_linear.v1"
-warmup_steps = 250
-total_steps = 20000
-initial_rate = 0.00005
+learn_rate = 0.001
 
 [training.score_weights]
-pos_acc = 0.08
-morph_acc = 0.08
+tag_acc = 0.12
+pos_acc = 0.06
+morph_acc = 0.06
 morph_per_feat = null
-dep_uas = 0.0
-dep_las = 0.16
+lemma_acc = 0.12
+dep_uas = 0.06
+dep_las = 0.06
 dep_las_per_type = null
 sents_p = null
 sents_r = null
-sents_f = 0.02
-lemma_acc = 0.5
-ents_f = 0.16
+sents_f = 0.0
+ents_f = 0.12
 ents_p = 0.0
 ents_r = 0.0
 ents_per_type = null
+coref_f = 0.12
+coref_p = null
+coref_r = null
+span_accuracy = 0.12
+nel_micro_f = 0.12
+nel_micro_r = null
+nel_micro_p = null
 
 [pretraining]
 
 [initialize]
-vocab_data = ${paths.vocab_data}
 vectors = ${paths.vectors}
 init_tok2vec = ${paths.init_tok2vec}
+vocab_data = null
+lookups = null
 before_init = null
 after_init = null
 
 [initialize.components]
 
-[initialize.components.morphologizer]
-
-[initialize.components.morphologizer.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/morphologizer.json"
-require = false
-
-[initialize.components.ner]
-
-[initialize.components.ner.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/ner.json"
-require = false
-
-[initialize.components.parser]
-
-[initialize.components.parser.labels]
-@readers = "spacy.read_labels.v1"
-path = "corpus/labels/parser.json"
-require = false
-
-[initialize.lookups]
-@misc = "spacy.LookupsDataLoader.v1"
-lang = ${nlp.lang}
-tables = ["lexeme_norm"]
-
 [initialize.tokenizer]

coref/cfg

@@ -0,0 +1,3 @@
+{
+  "nI":1024
+}

transformer/model/pytorch_model.bin → coref/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8964c70b5415b19dc9a2bb01a796e60df3ada1c543263b1803c61c269213e89b
-size 2239724887
+oid sha256:530693cc6611b9b24a03c8cabd239861c9565c5015490d33c2682d3755991014
+size 54662492

da_dacy_large_trf-any-py3-none-any.whl

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8b3a113d8d6e3e3d9077fcbb4511cf8182765ee5063790a8a87952a1f916cdbf
-size 1823104200
+oid sha256:e892bff73b78466e9a3f1f5bfe987d46e320161d83429d636687e1dcfb787200
+size 1394022249

entity_linker/cfg

@@ -0,0 +1,3 @@
+{
+  "overwrite":true
+}

entity_linker/kb/contents

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ff702a30fb3360af93dd43795238cb332814bc6a6889f2a477f4ff2d050ad9d4
+size 11649540

transformer/model/sentencepiece.bpe.model → entity_linker/kb/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:cfc8146abe2a0488e9e2a0c56de7952f7c11ab059eca145a0a727afce0db2865
-size 5069051
+oid sha256:ec97f460233cd7e225ffce56c87cfe570210c27ccdb209855f13ebba48c7a1bf
+size 544073

entity_linker/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:4676186143a40b26ea1e023fda43b9ef083c68f4f32354253f132dd8b6151209
+size 3510902

meta.json

@@ -1,14 +1,14 @@
 {
   "lang":"da",
   "name":"dacy_large_trf",
-  "version":"0.1.0",
-  "description":"\n<a href=\"https://github.com/centre-for-humanities-computing/Dacy\"><img src=\"https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png\" width=\"175\" height=\"175\" align=\"right\" /></a>\n\n# DaCy large transformer\n\nDaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.\nDaCy's largest pipeline has achieved State-of-the-Art performance on Named entity recognition, part-of-speech tagging and dependency \nparsing for Danish on the DaNE dataset. Check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. \nDaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.\n    ",
-  "author":"Centre for Humanities Computing Aarhus",
+  "version":"0.2.0",
+  "description":"\n<a href=\"https://github.com/centre-for-humanities-computing/Dacy\"><img src=\"https://centre-for-humanities-computing.github.io/DaCy/_static/icon.png\" width=\"175\" height=\"175\" align=\"right\" /></a>\n\n# DaCy large\n\nDaCy is a Danish language processing framework with state-of-the-art pipelines as well as functionality for analysing Danish pipelines.\nDaCy's largest pipeline has achieved State-of-the-Art performance on parts-of-speech tagging and dependency \nparsing for Danish on the Danish Dependency treebank as well as competitive performance on named entity recognition, named entity disambiguation and coreference resolution. \nTo read more check out the [DaCy repository](https://github.com/centre-for-humanities-computing/DaCy) for material on how to use DaCy and reproduce the results. \nDaCy also contains guides on usage of the package as well as behavioural test for biases and robustness of Danish NLP pipelines.\n",
+  "author":"Kenneth Enevoldsen",
   "email":"Kenneth.enevoldsen@cas.au.dk",
   "url":"https://chcaa.io/#/",
-  "license":"Apache-2.0 License",
-  "spacy_version":">=3.1.1,<3.2.0",
-  "spacy_git_version":"ffaead8fe",
+  "license":"Apache-2.0",
+  "spacy_version":">=3.5.2,<3.6.0",
+  "spacy_git_version":"Unknown",
   "vectors":{
     "width":0,
     "vectors":0,
@@ -18,6 +18,25 @@
   "labels":{
     "transformer":[
 
+    ],
+    "tagger":[
+      "ADJ",
+      "ADP",
+      "ADV",
+      "AUX",
+      "CCONJ",
+      "DET",
+      "INTJ",
+      "NOUN",
+      "NUM",
+      "PART",
+      "PRON",
+      "PROPN",
+      "PUNCT",
+      "SCONJ",
+      "SYM",
+      "VERB",
+      "X"
     ],
     "morphologizer":[
       "AdpType=Prep|POS=ADP",
@@ -34,155 +53,157 @@
       "Degree=Pos|Number=Plur|POS=ADJ",
       "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
       "POS=PUNCT",
+      "NumType=Ord|POS=ADJ",
       "POS=CCONJ",
-      "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ",
-      "Degree=Cmp|POS=ADJ",
-      "POS=PRON|PartType=Inf",
-      "Gender=Com|Number=Sing|POS=DET|PronType=Ind",
-      "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ",
-      "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs",
       "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
-      "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
-      "Gender=Neut|Number=Sing|POS=DET|PronType=Dem",
+      "POS=VERB|VerbForm=Inf|Voice=Act",
+      "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs",
+      "Degree=Sup|POS=ADV",
       "Degree=Pos|POS=ADV",
-      "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
-      "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
-      "POS=PRON|PronType=Dem",
-      "NumType=Card|POS=NUM",
-      "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
-      "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Gender=Com|Number=Sing|POS=DET|PronType=Ind",
+      "Number=Plur|POS=DET|PronType=Ind",
+      "POS=ADP",
+      "POS=ADV|PartType=Inf",
       "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
-      "NumType=Ord|POS=ADJ",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
       "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act",
-      "POS=VERB|VerbForm=Inf|Voice=Act",
+      "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
+      "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs",
       "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act",
-      "POS=NOUN",
-      "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass",
       "POS=ADP|PartType=Inf",
+      "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "NumType=Card|POS=NUM",
       "Degree=Pos|POS=ADJ",
+      "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part",
+      "POS=PART|PartType=Inf",
+      "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes",
       "Definite=Def|Gender=Com|Number=Plur|POS=NOUN",
-      "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs",
+      "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
+      "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs",
+      "POS=VERB|Tense=Pres|VerbForm=Part",
+      "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs",
       "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN",
+      "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ",
+      "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs",
       "POS=AUX|VerbForm=Inf|Voice=Act",
-      "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
+      "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ",
+      "Degree=Cmp|POS=ADJ",
+      "POS=PRON|PartType=Inf",
+      "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ",
+      "Case=Nom|Gender=Com|POS=PRON|PronType=Ind",
+      "Number=Plur|POS=PRON|PronType=Ind",
+      "POS=INTJ",
       "Gender=Com|Number=Sing|POS=DET|PronType=Dem",
-      "Number=Plur|POS=DET|PronType=Ind",
-      "Gender=Com|Number=Sing|POS=PRON|PronType=Ind",
-      "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes",
-      "POS=PART|PartType=Inf",
+      "Case=Gen|Number=Plur|POS=DET|PronType=Ind",
+      "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass",
+      "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
+      "Degree=Cmp|POS=ADV",
+      "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs",
+      "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Case=Gen|POS=PROPN",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind",
+      "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
+      "Definite=Def|Degree=Sup|POS=ADJ",
       "Gender=Neut|Number=Sing|POS=DET|PronType=Ind",
-      "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs",
-      "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN",
-      "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs",
+      "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
+      "Gender=Neut|Number=Sing|POS=DET|PronType=Dem",
+      "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
+      "POS=PRON|PronType=Dem",
+      "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ",
+      "Number=Plur|POS=NUM",
+      "POS=VERB|VerbForm=Inf|Voice=Pass",
+      "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ",
+      "Number=Sing|POS=PRON|PronType=Int,Rel",
       "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
-      "Case=Nom|Gender=Com|POS=PRON|PronType=Ind",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind",
-      "Mood=Imp|POS=VERB",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
       "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part",
-      "POS=X",
+      "POS=PRON",
+      "Definite=Ind|Number=Sing|POS=NOUN",
+      "Definite=Ind|Number=Sing|POS=NUM",
+      "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN",
+      "Foreign=Yes|POS=ADV",
+      "POS=NOUN",
+      "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN",
+      "Gender=Com|Number=Plur|POS=NOUN",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel",
       "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
+      "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs",
+      "Gender=Com|Number=Sing|POS=PRON|PronType=Ind",
+      "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
+      "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
+      "Degree=Sup|POS=ADJ",
+      "Degree=Pos|Number=Sing|POS=ADJ",
+      "Mood=Imp|POS=VERB",
+      "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
+      "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
+      "POS=X",
       "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN",
-      "POS=VERB|Tense=Pres|VerbForm=Part",
-      "Number=Plur|POS=PRON|PronType=Int,Rel",
-      "POS=VERB|VerbForm=Inf|Voice=Pass",
-      "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN",
-      "Degree=Cmp|POS=ADV",
-      "POS=ADV|PartType=Inf",
-      "Degree=Sup|POS=ADV",
       "Number=Plur|POS=PRON|PronType=Dem",
-      "Number=Plur|POS=PRON|PronType=Ind",
-      "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs",
-      "Case=Gen|POS=PROPN",
-      "POS=ADP",
+      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
+      "Number=Plur|POS=PRON|PronType=Int,Rel",
+      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
       "Degree=Cmp|Number=Plur|POS=ADJ",
-      "Definite=Def|Degree=Sup|POS=ADJ",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Degree=Pos|Number=Sing|POS=ADJ",
-      "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
       "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+      "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
+      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
+      "Gender=Com|POS=PRON|PronType=Int,Rel",
+      "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ",
+      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+      "POS=VERB|VerbForm=Ger",
+      "Gender=Com|Number=Sing|POS=PRON|PronType=Dem",
+      "Case=Gen|POS=PRON|PronType=Int,Rel",
+      "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass",
+      "Abbr=Yes|POS=X",
+      "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
+      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Definite=Ind|Number=Plur|POS=NOUN",
+      "Foreign=Yes|POS=X",
       "Number=Plur|POS=PRON|PronType=Rcp",
+      "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
       "Case=Gen|Degree=Cmp|POS=ADJ",
       "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN",
-      "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs",
-      "POS=INTJ",
-      "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ",
-      "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-      "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN",
-      "Number=Sing|POS=PRON|PronType=Int,Rel",
+      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
+      "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem",
       "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel",
-      "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ",
-      "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Definite=Ind|Number=Sing|POS=NOUN",
-      "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
+      "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form",
       "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "POS=SYM",
-      "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
-      "Degree=Sup|POS=ADJ",
-      "Number=Plur|POS=DET|PronType=Ind|Style=Arch",
-      "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem",
-      "Foreign=Yes|POS=X",
+      "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
+      "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp",
       "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs",
-      "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem",
-      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs",
-      "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN",
-      "Case=Gen|POS=PRON|PronType=Int,Rel",
-      "Gender=Com|Number=Sing|POS=PRON|PronType=Dem",
-      "Abbr=Yes|POS=X",
-      "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN",
+      "POS=SYM",
+      "POS=DET|PronType=Dem",
+      "Gender=Com|Number=Sing|POS=NUM",
+      "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
       "Definite=Def|Degree=Abs|POS=ADJ",
-      "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ",
-      "Definite=Ind|POS=NOUN",
-      "Gender=Com|Number=Plur|POS=NOUN",
-      "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs",
-      "Gender=Com|POS=PRON|PronType=Int,Rel",
-      "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
+      "POS=VERB|Tense=Pres",
+      "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM",
       "Degree=Abs|POS=ADV",
-      "POS=VERB|VerbForm=Ger",
-      "POS=VERB|Tense=Past|VerbForm=Part",
-      "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ",
-      "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form",
       "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ",
-      "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ",
-      "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs",
       "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel",
-      "POS=VERB|Tense=Pres",
-      "Case=Gen|Number=Plur|POS=DET|PronType=Ind",
-      "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs",
+      "POS=VERB|Tense=Past|VerbForm=Part",
+      "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ",
       "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
-      "POS=AUX|Tense=Pres|VerbForm=Part",
-      "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass",
-      "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Degree=Sup|Number=Plur|POS=ADJ",
-      "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs",
-      "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-      "Definite=Ind|Number=Plur|POS=NOUN",
-      "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part",
-      "Mood=Imp|POS=AUX",
       "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs",
-      "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
-      "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part",
       "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs",
+      "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
+      "Definite=Ind|POS=NOUN",
       "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind",
+      "Definite=Ind|Gender=Com|Number=Sing|POS=NUM",
+      "Definite=Def|Number=Plur|POS=NOUN",
       "Case=Gen|POS=NOUN",
-      "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs",
-      "POS=DET|PronType=Dem",
-      "Definite=Def|Number=Plur|POS=NOUN"
+      "POS=AUX|Tense=Pres|VerbForm=Part"
     ],
     "parser":[
       "ROOT",
       "acl:relcl",
       "advcl",
       "advmod",
+      "advmod:lmod",
       "amod",
       "appos",
       "aux",
@@ -206,144 +227,162 @@
       "nummod",
       "obj",
       "obl",
-      "obl:loc",
+      "obl:lmod",
       "obl:tmod",
       "punct",
       "xcomp"
-    ],
-    "attribute_ruler":[
-
-    ],
-    "lemmatizer":[
-
     ],
     "ner":[
       "LOC",
       "MISC",
       "ORG",
       "PER"
+    ],
+    "coref":[
+
+    ],
+    "span_resolver":[
+
+    ],
+    "entity_linker":[
+
     ]
   },
   "pipeline":[
     "transformer",
+    "tagger",
     "morphologizer",
+    "trainable_lemmatizer",
     "parser",
-    "attribute_ruler",
-    "lemmatizer",
-    "ner"
+    "ner",
+    "coref",
+    "span_resolver",
+    "span_cleaner",
+    "entity_linker"
   ],
   "components":[
     "transformer",
+    "tagger",
     "morphologizer",
+    "trainable_lemmatizer",
     "parser",
-    "attribute_ruler",
-    "lemmatizer",
-    "ner"
+    "ner",
+    "coref",
+    "span_resolver",
+    "span_cleaner",
+    "entity_linker"
   ],
   "disabled":[
 
   ],
-  "_sourced_vectors_hashes":{
-
-  },
+  "requirements":[
+    "spacy-experimental>=0.6.2,<0.7.0",
+    "spacy-transformers>=1.2.3,<1.3.0"
+  ],
   "performance":{
-    "pos_acc":0.9869714729,
-    "morph_acc":0.984937279,
+    "token_acc":0.9992023928,
+    "token_p":0.9970089731,
+    "token_r":0.9977052779,
+    "token_f":0.9973570039,
+    "sents_p":1.0,
+    "sents_r":1.0,
+    "sents_f":1.0,
+    "tag_acc":0.9913668347,
+    "pos_acc":0.9908174469,
+    "morph_acc":0.9880227568,
+    "morph_micro_p":0.9945294243,
+    "morph_micro_r":0.9932106296,
+    "morph_micro_f":0.9938695894,
     "morph_per_feat":{
-      "Mood":{
-        "p":0.9942802669,
-        "r":0.9942802669,
-        "f":0.9942802669
-      },
-      "Tense":{
-        "p":0.9924471299,
-        "r":0.9894578313,
-        "f":0.9909502262
+      "NumType":{
+        "p":0.9826589595,
+        "r":0.988372093,
+        "f":0.9855072464
       },
-      "VerbForm":{
-        "p":0.99200492,
-        "r":0.9871481028,
-        "f":0.9895705521
+      "Degree":{
+        "p":0.9973753281,
+        "r":0.9819121447,
+        "f":0.9895833333
       },
-      "Voice":{
-        "p":0.9955123411,
-        "r":0.9947683109,
-        "f":0.9951401869
+      "Number":{
+        "p":0.991821771,
+        "r":0.9912626832,
+        "f":0.9915421483
       },
       "Definite":{
-        "p":0.9916666667,
-        "r":0.987356776,
-        "f":0.9895070283
+        "p":0.9910141207,
+        "r":0.9910141207,
+        "f":0.9910141207
       },
       "Gender":{
-        "p":0.989656323,
-        "r":0.9857095381,
-        "f":0.9876789877
+        "p":0.9905329593,
+        "r":0.9901857694,
+        "f":0.9903593339
       },
-      "Number":{
-        "p":0.9921486522,
-        "r":0.9887845592,
-        "f":0.9904637492
+      "Mood":{
+        "p":0.9990393852,
+        "r":0.9980806142,
+        "f":0.9985597696
       },
-      "AdpType":{
-        "p":1.0,
-        "r":0.9946949602,
-        "f":0.9973404255
+      "Tense":{
+        "p":0.9953343701,
+        "r":0.9976617303,
+        "f":0.9964966913
       },
-      "PartType":{
+      "VerbForm":{
+        "p":0.9956140351,
+        "r":0.9968632371,
+        "f":0.9962382445
+      },
+      "Voice":{
+        "p":0.9970149254,
+        "r":0.9962714392,
+        "f":0.9966430436
+      },
+      "AdpType":{
         "p":1.0,
         "r":1.0,
         "f":1.0
       },
-      "Case":{
-        "p":0.9905362776,
-        "r":0.9921011058,
-        "f":0.9913180742
-      },
-      "Person":{
-        "p":0.9911816578,
-        "r":0.9982238011,
-        "f":0.9946902655
-      },
       "PronType":{
-        "p":0.9934210526,
-        "r":0.9934210526,
-        "f":0.9934210526
+        "p":0.9990966576,
+        "r":0.9981949458,
+        "f":0.9986455982
       },
-      "NumType":{
-        "p":0.9931506849,
-        "r":0.9602649007,
-        "f":0.9764309764
+      "Case":{
+        "p":1.0,
+        "r":0.992248062,
+        "f":0.9961089494
       },
-      "Degree":{
-        "p":0.980861244,
-        "r":0.9879518072,
-        "f":0.9843937575
+      "Person":{
+        "p":0.9982638889,
+        "r":0.9965337955,
+        "f":0.9973980919
       },
-      "Reflex":{
+      "Number[psor]":{
         "p":1.0,
         "r":1.0,
         "f":1.0
       },
-      "Number[psor]":{
+      "Poss":{
         "p":1.0,
         "r":1.0,
         "f":1.0
       },
-      "Poss":{
+      "PartType":{
+        "p":0.9962406015,
+        "r":0.9962406015,
+        "f":0.9962406015
+      },
+      "Reflex":{
         "p":1.0,
         "r":1.0,
         "f":1.0
       },
       "Foreign":{
-        "p":0.875,
-        "r":0.7,
-        "f":0.7777777778
-      },
-      "Abbr":{
-        "p":1.0,
-        "r":0.4,
-        "f":0.5714285714
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
       "Style":{
         "p":1.0,
@@ -352,230 +391,295 @@
       },
       "Polite":{
         "p":1.0,
-        "r":1.0,
-        "f":1.0
+        "r":0.6666666667,
+        "f":0.8
+      },
+      "Abbr":{
+        "p":1.0,
+        "r":0.5,
+        "f":0.6666666667
       }
     },
-    "dep_uas":0.9074560179,
-    "dep_las":0.8837754817,
+    "dep_uas":0.9280885781,
+    "dep_las":0.9079997669,
     "dep_las_per_type":{
-      "advmod":{
-        "p":0.8407821229,
-        "r":0.8502824859,
-        "f":0.845505618
+      "nummod":{
+        "p":0.8738738739,
+        "r":0.8584070796,
+        "f":0.8660714286
       },
-      "root":{
-        "p":0.9359430605,
-        "r":0.9326241135,
-        "f":0.9342806394
+      "amod":{
+        "p":0.9130434783,
+        "r":0.9247706422,
+        "f":0.9188696445
       },
-      "nsubj":{
-        "p":0.9429175476,
-        "r":0.94092827,
-        "f":0.9419218585
+      "nmod":{
+        "p":0.8213507625,
+        "r":0.8231441048,
+        "f":0.8222464558
       },
-      "case":{
-        "p":0.9418837675,
-        "r":0.9288537549,
-        "f":0.9353233831
+      "nsubj":{
+        "p":0.9587737844,
+        "r":0.9597883598,
+        "f":0.9592808038
       },
-      "obl":{
-        "p":0.8398133748,
-        "r":0.8398133748,
-        "f":0.8398133748
+      "flat":{
+        "p":0.9672131148,
+        "r":0.9414893617,
+        "f":0.9541778976
       },
       "cc":{
-        "p":0.9041916168,
-        "r":0.8779069767,
-        "f":0.8908554572
+        "p":0.9019607843,
+        "r":0.9139072848,
+        "f":0.9078947368
       },
       "conj":{
-        "p":0.8244680851,
-        "r":0.8266666667,
-        "f":0.8255659121
+        "p":0.8904899135,
+        "r":0.8930635838,
+        "f":0.8917748918
       },
-      "obj":{
-        "p":0.933460076,
-        "r":0.9533980583,
-        "f":0.9433237272
+      "root":{
+        "p":0.9468085106,
+        "r":0.9451327434,
+        "f":0.9459698849
+      },
+      "advmod":{
+        "p":0.9056316591,
+        "r":0.892053973,
+        "f":0.8987915408
+      },
+      "mark":{
+        "p":0.9572072072,
+        "r":0.9465478842,
+        "f":0.9518477044
       },
       "aux":{
-        "p":0.9298245614,
-        "r":0.9271137026,
-        "f":0.9284671533
+        "p":0.9782608696,
+        "r":0.9692307692,
+        "f":0.9737248841
       },
-      "acl:relcl":{
-        "p":0.8206521739,
-        "r":0.8162162162,
-        "f":0.8184281843
+      "ccomp":{
+        "p":0.7931034483,
+        "r":0.8734177215,
+        "f":0.8313253012
       },
-      "obl:loc":{
-        "p":0.7808219178,
-        "r":0.8142857143,
-        "f":0.7972027972
+      "case":{
+        "p":0.9511677282,
+        "r":0.9401888772,
+        "f":0.945646438
       },
       "det":{
-        "p":0.9488448845,
-        "r":0.9472817133,
-        "f":0.9480626546
+        "p":0.96,
+        "r":0.9677419355,
+        "f":0.9638554217
       },
-      "amod":{
-        "p":0.9011925043,
-        "r":0.9027303754,
-        "f":0.9019607843
+      "obl":{
+        "p":0.8901453958,
+        "r":0.8732171157,
+        "f":0.8816
       },
       "nmod:poss":{
-        "p":0.7524752475,
-        "r":0.7524752475,
-        "f":0.7524752475
+        "p":0.8245614035,
+        "r":0.8623853211,
+        "f":0.8430493274
       },
-      "ccomp":{
-        "p":0.7727272727,
-        "r":0.8225806452,
-        "f":0.796875
-      },
-      "nummod":{
-        "p":0.832,
-        "r":0.8666666667,
-        "f":0.8489795918
+      "obj":{
+        "p":0.9362101313,
+        "r":0.9504761905,
+        "f":0.943289225
       },
-      "flat":{
-        "p":0.8674698795,
-        "r":0.9536423841,
-        "f":0.9085173502
+      "cop":{
+        "p":0.9036144578,
+        "r":0.9202453988,
+        "f":0.9118541033
       },
-      "compound:prt":{
-        "p":0.75,
-        "r":0.512195122,
-        "f":0.6086956522
+      "acl:relcl":{
+        "p":0.8554913295,
+        "r":0.8087431694,
+        "f":0.8314606742
       },
       "advcl":{
-        "p":0.7818181818,
-        "r":0.7413793103,
-        "f":0.7610619469
-      },
-      "mark":{
-        "p":0.9354166667,
-        "r":0.9219712526,
-        "f":0.9286452947
+        "p":0.754601227,
+        "r":0.7884615385,
+        "f":0.7711598746
       },
-      "cop":{
-        "p":0.9314285714,
-        "r":0.9314285714,
-        "f":0.9314285714
+      "compound:prt":{
+        "p":0.7,
+        "r":0.6176470588,
+        "f":0.65625
       },
       "dep":{
-        "p":0.2564102564,
-        "r":0.5660377358,
-        "f":0.3529411765
+        "p":0.1368421053,
+        "r":0.4333333333,
+        "f":0.208
       },
-      "nmod":{
-        "p":0.7987679671,
-        "r":0.759765625,
-        "f":0.7787787788
+      "fixed":{
+        "p":0.9655172414,
+        "r":0.9032258065,
+        "f":0.9333333333
       },
       "iobj":{
-        "p":1.0,
-        "r":0.8181818182,
-        "f":0.9
+        "p":0.9230769231,
+        "r":0.8,
+        "f":0.8571428571
+      },
+      "appos":{
+        "p":0.8,
+        "r":0.7368421053,
+        "f":0.7671232877
+      },
+      "obl:tmod":{
+        "p":0.75,
+        "r":0.375,
+        "f":0.5
       },
       "xcomp":{
-        "p":0.8695652174,
-        "r":0.6779661017,
-        "f":0.7619047619
+        "p":0.92,
+        "r":0.71875,
+        "f":0.8070175439
+      },
+      "advmod:lmod":{
+        "p":0.8775510204,
+        "r":0.8958333333,
+        "f":0.8865979381
+      },
+      "expl":{
+        "p":0.972972973,
+        "r":0.9230769231,
+        "f":0.9473684211
       },
       "list":{
-        "p":0.7,
-        "r":0.3888888889,
-        "f":0.5
+        "p":0.3636363636,
+        "r":0.2352941176,
+        "f":0.2857142857
       },
-      "vocative":{
+      "obl:lmod":{
+        "p":0.5,
+        "r":0.3333333333,
+        "f":0.4
+      },
+      "parataxis":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       },
-      "fixed":{
-        "p":0.9487179487,
-        "r":0.880952381,
-        "f":0.9135802469
+      "orphan":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "expl":{
-        "p":0.96875,
-        "r":0.9117647059,
-        "f":0.9393939394
+      "vocative":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "appos":{
-        "p":0.7428571429,
-        "r":0.7878787879,
-        "f":0.7647058824
+      "discourse":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "obl:tmod":{
-        "p":1.0,
-        "r":0.3888888889,
-        "f":0.56
+      "dislocated":{
+        "p":0.0,
+        "r":0.0,
+        "f":0.0
       },
-      "discourse":{
+      "compound":{
         "p":0.0,
         "r":0.0,
         "f":0.0
       }
     },
-    "sents_p":0.9608540925,
-    "sents_r":0.9574468085,
-    "sents_f":0.9591474245,
-    "lemma_acc":0.8491041162,
-    "ents_f":0.9012345679,
-    "ents_p":0.8902439024,
-    "ents_r":0.9125,
+    "ents_p":0.8858195212,
+    "ents_r":0.8620071685,
+    "ents_f":0.8737511353,
     "ents_per_type":{
+      "LOC":{
+        "p":0.8613861386,
+        "r":0.90625,
+        "f":0.883248731
+      },
       "PER":{
-        "p":0.9620253165,
-        "r":0.9156626506,
-        "f":0.9382716049
+        "p":0.9550561798,
+        "r":0.9444444444,
+        "f":0.9497206704
       },
       "ORG":{
-        "p":0.9047619048,
-        "r":0.8444444444,
-        "f":0.8735632184
+        "p":0.8819444444,
+        "r":0.7888198758,
+        "f":0.8327868852
       },
       "MISC":{
-        "p":0.7555555556,
-        "r":0.9026548673,
-        "f":0.8225806452
+        "p":0.8083333333,
+        "r":0.8016528926,
+        "f":0.8049792531
+      }
+    },
+    "lemma_acc":0.9589423796,
+    "coref_lea_f1":0.4672143289,
+    "coref_lea_precision":0.4590991705,
+    "coref_lea_recall":0.4756215411,
+    "nel_score":0.3428571429,
+    "nel_score_desc":"micro F",
+    "nel_micro_p":0.84,
+    "nel_micro_r":0.2153846154,
+    "nel_micro_f":0.3428571429,
+    "nel_macro_p":0.8670634921,
+    "nel_macro_r":0.2470462544,
+    "nel_macro_f":0.3727980563,
+    "nel_f_per_type":{
+      "MISC":{
+        "p":1.0,
+        "r":0.2777777778,
+        "f":0.4347826087
+      },
+      "PER":{
+        "p":0.8571428571,
+        "r":0.1,
+        "f":0.1791044776
       },
       "LOC":{
-        "p":0.9391304348,
-        "r":0.972972973,
-        "f":0.9557522124
+        "p":1.0,
+        "r":0.4411764706,
+        "f":0.612244898
+      },
+      "ORG":{
+        "p":0.6111111111,
+        "r":0.1692307692,
+        "f":0.265060241
       }
-    },
-    "transformer_loss":18056.2649203666,
-    "morphologizer_loss":1117.3585804609,
-    "parser_loss":80374.9126560178,
-    "ner_loss":166.3446418822
+    }
   },
   "sources":[
     {
-      "name":"UD Danish DDT v2.5",
+      "name":"UD Danish DDT v2.11",
       "url":"https://github.com/UniversalDependencies/UD_Danish-DDT",
       "license":"CC BY-SA 4.0",
       "author":"Johannsen, Anders; Mart\u00ednez Alonso, H\u00e9ctor; Plank, Barbara"
     },
     {
       "name":"DaNE",
-      "url":"https://github.com/alexandrainst/danlp/blob/master/docs/datasets.md#danish-dependency-treebank-dane",
+      "url":"https://huggingface.co/datasets/dane",
       "license":"CC BY-SA 4.0",
       "author":"Rasmus Hvingelby, Amalie B. Pauli, Maria Barrett, Christina Rosted, Lasse M. Lidegaard, Anders S\u00f8gaard"
     },
     {
-      "name":"xlm-roberta-large",
-      "author":"Alexis Conneau, Kartikay Khandelwal, Naman Goyal, Vishrav Chaudhary, Guillaume Wenzek, Francisco Guzm\u00e1n, Edouard Grave, Myle Ott, Luke Zettlemoyer, Veselin Stoyanov",
-      "url":"https://huggingface.co/xlm-roberta-large",
+      "name":"DaCoref",
+      "url":"https://huggingface.co/datasets/alexandrainst/dacoref",
+      "license":"CC BY-SA 4.0",
+      "author":"Buch-Kromann, Matthias"
+    },
+    {
+      "name":"DaNED",
+      "url":"https://danlp-alexandra.readthedocs.io/en/stable/docs/datasets.html#daned",
+      "license":"CC BY-SA 4.0",
+      "author":"Barrett, M. J., Lam, H., Wu, M., Lacroix, O., Plank, B., & S\u00f8gaard, A."
+    },
+    {
+      "name":"chcaa/dfm-encoder-large-v1",
+      "author":"The Danish Foundation Models team",
+      "url":"https://huggingface.co/chcaa/dfm-encoder-large-v1",
       "license":"CC BY 4.0"
     }
   ],
-  "requirements":[
-    "spacy-transformers>=1.0.3,<1.1.0"
-  ],
-  "notes":"\n## Bias and Robustness\n\nBesides the validation done by SpaCy on the DaNE testset, DaCy also provides a series of augmentations to the DaNE test set to see how well the models deal with these types of augmentations.\nThe can be seen as behavioural probes akinn to the NLP checklist.\n\n### Deterministic Augmentations\nDeterministic augmentations are augmentation which always yield the same result.\n\n| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) |\u00a0Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |\n| --- | --- | --- | --- |  --- | --- | --- |  --- |\n| No augmentation | 0.985 | 0.979 | 0.906 |  0.881 | 0.986 | 0.844 | 0.839 |\n| \u00c6\u00f8\u00e5 Augmentation | 0.973 | 0.963 | 0.892 |  0.863 | 0.975 | 0.754 | 0.815 |\n| Lowercase | 0.981 | 0.975 | 0.902 |  0.876 | 0.93 | 0.848 | 0.788 |\n| No Spacing | 0.227 | 0.229 | 0.004 |  0.004 | 0.54 | 0.225 | 0.086 |\n| Abbreviated first names | 0.984 | 0.978 | 0.903 |  0.878 | 0.986 | 0.845 | 0.839 |\n| Input size augmentation 5 sentences | 0.986 | 0.981 | 0.904 |  0.88 | 0.97 | 0.844 | 0.847 |\n| Input size augmentation 10 sentences | 0.986 | 0.981 | 0.905 |  0.881 | 0.964 | 0.844 | 0.849 |\n\n\n\n### Stochastic Augmentations\nStochastic augmentations are augmentation which are repeated mulitple times to estimate the effect of the augmentation.\n\n| Augmentation | Part-of-speech tagging (Accuracy) | Morphological tagging (Accuracy) | Dependency Parsing (UAS) | Dependency Parsing (LAS) |\u00a0Sentence segmentation (F1) | Lemmatization (Accuracy) | Named entity recognition (F1) |\n| --- | --- | --- | --- |  --- | --- | --- |  --- |\n| Keystroke errors 2% | 0.949 (0.002) | 0.944 (0.002) | 0.868 (0.002) |  0.833 (0.002) | 0.965 (0.002) | 0.773 (0.002) | 0.775 (0.002) |\n| Keystroke errors 5% | 0.895 (0.003) | 0.893 (0.003) | 0.81 (0.003) |  0.76 (0.003) | 0.92 (0.003) | 0.68 (0.003) | 0.698 (0.003) |\n| Keystroke errors 15% | 0.705 (0.005) | 0.72 (0.005) | 0.6 (0.005) |  0.518 (0.005) | 0.801 (0.005) | 0.462 (0.005) | 0.506 (0.005) |\n| Danish names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.987 (0.0) | 0.847 (0.0) | 0.844 (0.0) |\n| Muslim names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.987 (0.0) | 0.847 (0.0) | 0.844 (0.0) |\n| Female names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.986 (0.0) | 0.847 (0.0) | 0.846 (0.0) |\n| Male names | 0.984 (0.0) | 0.979 (0.0) | 0.904 (0.0) |  0.879 (0.0) | 0.986 (0.0) | 0.846 (0.0) | 0.845 (0.0) |\n| Spacing Augmention 5% | 0.946 (0.002) | 0.941 (0.002) | 0.794 (0.002) |  0.771 (0.002) | 0.969 (0.002) | 0.812 (0.002) | 0.781 (0.002) |\n\n<details>\n\n<summary> Description of Augmenters </summary>\n\n    \n\n**No augmentation:**\nApplies no augmentation to the DaNE test set.\n\n**\u00c6\u00f8\u00e5 Augmentation:**\nThis augmentation replace the \u00e6,\u00f8, and \u00e5 with their spelling variations ae, oe and aa respectively.\n\n**Lowercase:**\nThis augmentation lowercases all text.\n\n**No Spacing:**\nThis augmentation removed all spacing from the text.\n\n**Abbreviated first names:**\nThis agmentation abbreviates the first names of entities. For instance 'Kenneth Enevoldsen' would turn to 'K. Enevoldsen'.\n\n**Keystroke errors 2%:**\nThis agmentation simulate keystroke errors by replacing 2% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Keystroke errors 5%:**\nThis agmentation simulate keystroke errors by replacing 5% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Keystroke errors 15%:**\nThis agmentation simulate keystroke errors by replacing 15% of keys with a neighbouring key on a Danish QWERTY keyboard. As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Danish names:**\nThis agmentation replace all names with Danish names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Muslim names:**\nThis agmentation replace all names with Muslim names derived from  Meldgaard (2005). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Female names:**\nThis agmentation replace all names with Danish female names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Male names:**\nThis agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n\n**Spacing Augmention 5%:**\nThis agmentation replace all names with Danish male names derived from Danmarks Statistik (2021). As this agmentation is stochastic it is repeated 20 times to obtain a consistent estimate and the mean is provided with its standard deviation in parenthesis.\n </details> \n <br /> \n\n\n### Hardware\nThis was run an trained on a Quadro RTX 8000 GPU."
+  "notes":"\n\n### Training\nThis model was trained using [spaCy](https://spacy.io) and logged to [Weights & Biases](https://wandb.ai/kenevoldsen/dacy-v0.2.0). You can find all the training logs [here](https://wandb.ai/kenevoldsen/dacy-v0.2.0)."
 }

morphologizer/cfg

@@ -1,4 +1,5 @@
 {
+  "extend":false,
   "labels_morph":{
     "AdpType=Prep|POS=ADP":"AdpType=Prep",
     "Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Com|Number=Sing",
@@ -14,149 +15,150 @@
     "Degree=Pos|Number=Plur|POS=ADJ":"Degree=Pos|Number=Plur",
     "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Definite=Ind|Gender=Com|Number=Plur",
     "POS=PUNCT":"",
+    "NumType=Ord|POS=ADJ":"NumType=Ord",
     "POS=CCONJ":"",
-    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Cmp|Number=Sing",
-    "Degree=Cmp|POS=ADJ":"Degree=Cmp",
-    "POS=PRON|PartType=Inf":"PartType=Inf",
-    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
-    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Number=Sing",
-    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Neut|Number=Sing|Person=3|PronType=Prs",
     "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Plur",
-    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Def|Degree=Pos|Number=Sing",
-    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
+    "POS=VERB|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
+    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Neut|Number=Sing|Person=3|PronType=Prs",
+    "Degree=Sup|POS=ADV":"Degree=Sup",
     "Degree=Pos|POS=ADV":"Degree=Pos",
-    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Number=Sing|Tense=Past|VerbForm=Part",
-    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Sing",
-    "POS=PRON|PronType=Dem":"PronType=Dem",
-    "NumType=Card|POS=NUM":"NumType=Card",
-    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=3|PronType=Prs",
-    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Com|Number=Sing",
+    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
+    "Number=Plur|POS=DET|PronType=Ind":"Number=Plur|PronType=Ind",
+    "POS=ADP":"",
+    "POS=ADV|PartType=Inf":"PartType=Inf",
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=3|PronType=Prs",
-    "NumType=Ord|POS=ADJ":"NumType=Ord",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
     "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Act",
-    "POS=VERB|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
+    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Def|Degree=Pos|Number=Sing",
+    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
     "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Act",
-    "POS=NOUN":"",
-    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Pres|VerbForm=Fin|Voice=Pass",
     "POS=ADP|PartType=Inf":"PartType=Inf",
+    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Com|Number=Sing",
+    "NumType=Card|POS=NUM":"NumType=Card",
     "Degree=Pos|POS=ADJ":"Degree=Pos",
+    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":"Definite=Ind|Number=Sing|Tense=Past|VerbForm=Part",
+    "POS=PART|PartType=Inf":"PartType=Inf",
+    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":"Case=Acc|Person=3|PronType=Prs|Reflex=Yes",
     "Definite=Def|Gender=Com|Number=Plur|POS=NOUN":"Definite=Def|Gender=Com|Number=Plur",
-    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Definite=Ind|Gender=Neut|Number=Sing",
+    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
+    "POS=VERB|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
+    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Number=Plur|Person=3|PronType=Prs",
     "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Com|Number=Sing",
+    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":"Definite=Def|Degree=Sup|Number=Plur",
+    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Number=Plur|Person=3|PronType=Prs",
     "POS=AUX|VerbForm=Inf|Voice=Act":"VerbForm=Inf|Voice=Act",
-    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Com|Number=Sing",
+    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing",
+    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Cmp|Number=Sing",
+    "Degree=Cmp|POS=ADJ":"Degree=Cmp",
+    "POS=PRON|PartType=Inf":"PartType=Inf",
+    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Pos|Number=Sing",
+    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":"Case=Nom|Gender=Com|PronType=Ind",
+    "Number=Plur|POS=PRON|PronType=Ind":"Number=Plur|PronType=Ind",
+    "POS=INTJ":"",
     "Gender=Com|Number=Sing|POS=DET|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
-    "Number=Plur|POS=DET|PronType=Ind":"Number=Plur|PronType=Ind",
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
-    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":"Case=Acc|Person=3|PronType=Prs|Reflex=Yes",
-    "POS=PART|PartType=Inf":"PartType=Inf",
+    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":"Case=Gen|Number=Plur|PronType=Ind",
+    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Pres|VerbForm=Fin|Voice=Pass",
+    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Def|Gender=Neut|Number=Plur",
+    "Degree=Cmp|POS=ADV":"Degree=Cmp",
+    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=3|PronType=Prs",
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Case=Gen|POS=PROPN":"Case=Gen",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
+    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Number=Plur|Tense=Past|VerbForm=Part",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=1|PronType=Prs",
+    "Definite=Def|Degree=Sup|POS=ADJ":"Definite=Def|Degree=Sup",
     "Gender=Neut|Number=Sing|POS=DET|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
-    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Acc|Number=Plur|Person=3|PronType=Prs",
-    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Sing",
-    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":"Case=Nom|Number=Plur|Person=3|PronType=Prs",
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Sing",
+    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
+    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Number=Sing|Tense=Past|VerbForm=Part",
+    "POS=PRON|PronType=Dem":"PronType=Dem",
+    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Com|Number=Sing",
+    "Number=Plur|POS=NUM":"Number=Plur",
+    "POS=VERB|VerbForm=Inf|Voice=Pass":"VerbForm=Inf|Voice=Pass",
+    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Def|Degree=Sup|Number=Sing",
+    "Number=Sing|POS=PRON|PronType=Int,Rel":"Number=Sing|PronType=Int,Rel",
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=1|PronType=Prs",
-    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":"Case=Nom|Gender=Com|PronType=Ind",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":"Gender=Neut|Number=Sing|PronType=Ind",
-    "Mood=Imp|POS=VERB":"Mood=Imp",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":"Definite=Ind|Number=Sing|Tense=Past|VerbForm=Part",
-    "POS=X":"",
+    "POS=PRON":"",
+    "Definite=Ind|Number=Sing|POS=NOUN":"Definite=Ind|Number=Sing",
+    "Definite=Ind|Number=Sing|POS=NUM":"Definite=Ind|Number=Sing",
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Sing",
+    "Foreign=Yes|POS=ADV":"Foreign=Yes",
+    "POS=NOUN":"",
+    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Sing",
+    "Gender=Com|Number=Plur|POS=NOUN":"Gender=Com|Number=Plur",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Neut|Number=Sing|PronType=Int,Rel",
     "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=1|PronType=Prs",
+    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs",
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":"Gender=Com|Number=Sing|PronType=Ind",
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Plur",
+    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Neut|Number=Sing",
+    "Degree=Sup|POS=ADJ":"Degree=Sup",
+    "Degree=Pos|Number=Sing|POS=ADJ":"Degree=Pos|Number=Sing",
+    "Mood=Imp|POS=VERB":"Mood=Imp",
+    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Nom|Gender=Com|Person=2|Polite=Form|PronType=Prs",
+    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Acc|Gender=Com|Person=2|Polite=Form|PronType=Prs",
+    "POS=X":"",
     "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Def|Gender=Com|Number=Plur",
-    "POS=VERB|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
-    "Number=Plur|POS=PRON|PronType=Int,Rel":"Number=Plur|PronType=Int,Rel",
-    "POS=VERB|VerbForm=Inf|Voice=Pass":"VerbForm=Inf|Voice=Pass",
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Sing",
-    "Degree=Cmp|POS=ADV":"Degree=Cmp",
-    "POS=ADV|PartType=Inf":"PartType=Inf",
-    "Degree=Sup|POS=ADV":"Degree=Sup",
     "Number=Plur|POS=PRON|PronType=Dem":"Number=Plur|PronType=Dem",
-    "Number=Plur|POS=PRON|PronType=Ind":"Number=Plur|PronType=Ind",
-    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Definite=Def|Gender=Neut|Number=Plur",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=1|PronType=Prs",
-    "Case=Gen|POS=PROPN":"Case=Gen",
-    "POS=ADP":"",
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=1|PronType=Prs",
+    "Number=Plur|POS=PRON|PronType=Int,Rel":"Number=Plur|PronType=Int,Rel",
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
     "Degree=Cmp|Number=Plur|POS=ADJ":"Degree=Cmp|Number=Plur",
-    "Definite=Def|Degree=Sup|POS=ADJ":"Definite=Def|Degree=Sup",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Degree=Pos|Number=Sing|POS=ADJ":"Degree=Pos|Number=Sing",
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
     "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Com|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
+    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=2|PronType=Prs",
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=2|PronType=Prs",
+    "Gender=Com|POS=PRON|PronType=Int,Rel":"Gender=Com|PronType=Int,Rel",
+    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":"Case=Gen|Degree=Pos|Number=Plur",
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
+    "POS=VERB|VerbForm=Ger":"VerbForm=Ger",
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
+    "Case=Gen|POS=PRON|PronType=Int,Rel":"Case=Gen|PronType=Int,Rel",
+    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Pass",
+    "Abbr=Yes|POS=X":"Abbr=Yes",
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Plur",
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
+    "Definite=Ind|Number=Plur|POS=NOUN":"Definite=Ind|Number=Plur",
+    "Foreign=Yes|POS=X":"Foreign=Yes",
     "Number=Plur|POS=PRON|PronType=Rcp":"Number=Plur|PronType=Rcp",
+    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=2|PronType=Prs",
     "Case=Gen|Degree=Cmp|POS=ADJ":"Case=Gen|Degree=Cmp",
     "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Def|Gender=Neut|Number=Plur",
-    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
-    "POS=INTJ":"",
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":"Degree=Pos|Gender=Neut|Number=Sing",
-    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Neut|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Sing|Person=2|PronType=Prs",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Plur",
-    "Number=Sing|POS=PRON|PronType=Int,Rel":"Number=Sing|PronType=Int,Rel",
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=2|PronType=Prs",
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
     "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Neut|Number=Sing|PronType=Int,Rel",
-    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":"Definite=Def|Degree=Sup|Number=Plur",
-    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Sing|Person=2|PronType=Prs",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Definite=Ind|Number=Sing|POS=NOUN":"Definite=Ind|Number=Sing",
-    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Number=Plur|Tense=Past|VerbForm=Part",
+    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Gender=Neut|Number=Sing|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
     "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Number=Plur|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "POS=SYM":"",
-    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Nom|Gender=Com|Person=2|Polite=Form|PronType=Prs",
-    "Degree=Sup|POS=ADJ":"Degree=Sup",
-    "Number=Plur|POS=DET|PronType=Ind|Style=Arch":"Number=Plur|PronType=Ind|Style=Arch",
-    "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem":"Case=Gen|Gender=Com|Number=Sing|PronType=Dem",
-    "Foreign=Yes|POS=X":"Foreign=Yes",
+    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
+    "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp":"Case=Gen|Number=Plur|PronType=Rcp",
     "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs":"Person=2|Polite=Form|Poss=Yes|PronType=Prs",
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":"Gender=Neut|Number=Sing|PronType=Dem",
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=1|PronType=Prs",
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Neut|Number=Sing",
-    "Case=Gen|POS=PRON|PronType=Int,Rel":"Case=Gen|PronType=Int,Rel",
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":"Gender=Com|Number=Sing|PronType=Dem",
-    "Abbr=Yes|POS=X":"Abbr=Yes",
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":"Case=Gen|Definite=Ind|Gender=Com|Number=Plur",
+    "POS=SYM":"",
+    "POS=DET|PronType=Dem":"PronType=Dem",
+    "Gender=Com|Number=Sing|POS=NUM":"Gender=Com|Number=Sing",
+    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=2|Poss=Yes|PronType=Prs",
+    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Case=Gen|Number=Plur|Tense=Past|VerbForm=Part",
     "Definite=Def|Degree=Abs|POS=ADJ":"Definite=Def|Degree=Abs",
-    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Sup|Number=Sing",
-    "Definite=Ind|POS=NOUN":"Definite=Ind",
-    "Gender=Com|Number=Plur|POS=NOUN":"Gender=Com|Number=Plur",
-    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs",
-    "Gender=Com|POS=PRON|PronType=Int,Rel":"Gender=Com|PronType=Int,Rel",
-    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Nom|Gender=Com|Number=Plur|Person=2|PronType=Prs",
+    "POS=VERB|Tense=Pres":"Tense=Pres",
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM":"Definite=Ind|Gender=Neut|Number=Sing",
     "Degree=Abs|POS=ADV":"Degree=Abs",
-    "POS=VERB|VerbForm=Ger":"VerbForm=Ger",
-    "POS=VERB|Tense=Past|VerbForm=Part":"Tense=Past|VerbForm=Part",
-    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Def|Degree=Sup|Number=Sing",
-    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":"Number=Plur|Number[psor]=Plur|Person=1|Poss=Yes|PronType=Prs|Style=Form",
     "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":"Case=Gen|Definite=Def|Degree=Pos|Number=Sing",
-    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":"Case=Gen|Degree=Pos|Number=Plur",
-    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":"Case=Acc|Gender=Com|Person=2|Polite=Form|PronType=Prs",
     "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel":"Gender=Com|Number=Sing|PronType=Int,Rel",
-    "POS=VERB|Tense=Pres":"Tense=Pres",
-    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":"Case=Gen|Number=Plur|PronType=Ind",
-    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=2|Poss=Yes|PronType=Prs",
-    "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs":"Person=2|Polite=Form|Poss=Yes|PronType=Prs",
+    "POS=VERB|Tense=Past|VerbForm=Part":"Tense=Past|VerbForm=Part",
+    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":"Definite=Ind|Degree=Sup|Number=Sing",
     "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
-    "POS=AUX|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part",
-    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":"Mood=Ind|Tense=Past|VerbForm=Fin|Voice=Pass",
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Degree=Sup|Number=Plur|POS=ADJ":"Degree=Sup|Number=Plur",
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":"Case=Acc|Gender=Com|Number=Plur|Person=2|PronType=Prs",
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":"Gender=Neut|Number=Sing|Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes",
-    "Definite=Ind|Number=Plur|POS=NOUN":"Definite=Ind|Number=Plur",
-    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":"Case=Gen|Number=Plur|Tense=Past|VerbForm=Part",
-    "Mood=Imp|POS=AUX":"Mood=Imp",
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs":"Gender=Com|Number=Sing|Number[psor]=Sing|Person=1|Poss=Yes|PronType=Prs",
-    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Sing|Person=3|Poss=Yes|PronType=Prs",
-    "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":"Definite=Def|Gender=Com|Number=Sing|Tense=Past|VerbForm=Part",
     "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":"Number=Plur|Number[psor]=Sing|Person=2|Poss=Yes|PronType=Prs",
+    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
+    "Definite=Ind|POS=NOUN":"Definite=Ind",
     "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind":"Case=Gen|Gender=Com|Number=Sing|PronType=Ind",
+    "Definite=Ind|Gender=Com|Number=Sing|POS=NUM":"Definite=Ind|Gender=Com|Number=Sing",
+    "Definite=Def|Number=Plur|POS=NOUN":"Definite=Def|Number=Plur",
     "Case=Gen|POS=NOUN":"Case=Gen",
-    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":"Number[psor]=Plur|Person=3|Poss=Yes|PronType=Prs",
-    "POS=DET|PronType=Dem":"PronType=Dem",
-    "Definite=Def|Number=Plur|POS=NOUN":"Definite=Def|Number=Plur"
+    "POS=AUX|Tense=Pres|VerbForm=Part":"Tense=Pres|VerbForm=Part"
   },
   "labels_pos":{
     "AdpType=Prep|POS=ADP":85,
@@ -173,148 +175,150 @@
     "Degree=Pos|Number=Plur|POS=ADJ":84,
     "Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
     "POS=PUNCT":97,
+    "NumType=Ord|POS=ADJ":84,
     "POS=CCONJ":89,
-    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":84,
-    "Degree=Cmp|POS=ADJ":84,
-    "POS=PRON|PartType=Inf":95,
-    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
-    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
     "Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":90,
+    "POS=VERB|VerbForm=Inf|Voice=Act":100,
+    "Case=Acc|Gender=Neut|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
+    "Degree=Sup|POS=ADV":86,
     "Degree=Pos|POS=ADV":86,
-    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "POS=PRON|PronType=Dem":95,
-    "NumType=Card|POS=NUM":93,
-    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
-    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
+    "Number=Plur|POS=DET|PronType=Ind":90,
+    "POS=ADP":85,
+    "POS=ADV|PartType=Inf":86,
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
-    "NumType=Ord|POS=ADJ":84,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
     "Mood=Ind|POS=AUX|Tense=Past|VerbForm=Fin|Voice=Act":87,
-    "POS=VERB|VerbForm=Inf|Voice=Act":100,
+    "Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
     "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Act":100,
-    "POS=NOUN":92,
-    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":100,
     "POS=ADP|PartType=Inf":85,
+    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "NumType=Card|POS=NUM":93,
     "Degree=Pos|POS=ADJ":84,
+    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":87,
+    "POS=PART|PartType=Inf":94,
+    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":95,
     "Definite=Def|Gender=Com|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
+    "POS=VERB|Tense=Pres|VerbForm=Part":100,
+    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
     "Case=Gen|Definite=Def|Gender=Com|Number=Sing|POS=NOUN":92,
+    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":84,
+    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
     "POS=AUX|VerbForm=Inf|Voice=Act":87,
-    "Definite=Ind|Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Definite=Ind|Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
+    "Definite=Ind|Degree=Cmp|Number=Sing|POS=ADJ":84,
+    "Degree=Cmp|POS=ADJ":84,
+    "POS=PRON|PartType=Inf":95,
+    "Definite=Ind|Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":95,
+    "Number=Plur|POS=PRON|PronType=Ind":95,
+    "POS=INTJ":91,
     "Gender=Com|Number=Sing|POS=DET|PronType=Dem":90,
-    "Number=Plur|POS=DET|PronType=Ind":90,
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":95,
-    "Case=Acc|POS=PRON|Person=3|PronType=Prs|Reflex=Yes":95,
-    "POS=PART|PartType=Inf":94,
+    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":90,
+    "Mood=Ind|POS=VERB|Tense=Pres|VerbForm=Fin|Voice=Pass":100,
+    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
+    "Degree=Cmp|POS=ADV":86,
+    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":95,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=3|PronType=Prs":95,
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Case=Gen|POS=PROPN":96,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":95,
+    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
+    "Definite=Def|Degree=Sup|POS=ADJ":84,
     "Gender=Neut|Number=Sing|POS=DET|PronType=Ind":90,
-    "Case=Acc|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
-    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "Case=Nom|Number=Plur|POS=PRON|Person=3|PronType=Prs":95,
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Gender=Neut|Number=Sing|POS=DET|PronType=Dem":90,
+    "Definite=Def|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "POS=PRON|PronType=Dem":95,
+    "Degree=Pos|Gender=Com|Number=Sing|POS=ADJ":84,
+    "Number=Plur|POS=NUM":93,
+    "POS=VERB|VerbForm=Inf|Voice=Pass":100,
+    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":84,
+    "Number=Sing|POS=PRON|PronType=Int,Rel":95,
     "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Nom|Gender=Com|POS=PRON|PronType=Ind":95,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Ind":95,
-    "Mood=Imp|POS=VERB":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Definite=Ind|Number=Sing|POS=AUX|Tense=Past|VerbForm=Part":87,
-    "POS=X":101,
+    "POS=PRON":95,
+    "Definite=Ind|Number=Sing|POS=NOUN":92,
+    "Definite=Ind|Number=Sing|POS=NUM":93,
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":92,
+    "Foreign=Yes|POS=ADV":86,
+    "POS=NOUN":92,
+    "Case=Gen|Definite=Def|Gender=Neut|Number=Sing|POS=NOUN":92,
+    "Gender=Com|Number=Plur|POS=NOUN":92,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":95,
     "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
+    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Ind":95,
+    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
+    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
+    "Degree=Sup|POS=ADJ":84,
+    "Degree=Pos|Number=Sing|POS=ADJ":84,
+    "Mood=Imp|POS=VERB":100,
+    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
+    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
+    "POS=X":101,
     "Case=Gen|Definite=Def|Gender=Com|Number=Plur|POS=NOUN":92,
-    "POS=VERB|Tense=Pres|VerbForm=Part":100,
-    "Number=Plur|POS=PRON|PronType=Int,Rel":95,
-    "POS=VERB|VerbForm=Inf|Voice=Pass":100,
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Sing|POS=NOUN":92,
-    "Degree=Cmp|POS=ADV":86,
-    "POS=ADV|PartType=Inf":86,
-    "Degree=Sup|POS=ADV":86,
     "Number=Plur|POS=PRON|PronType=Dem":95,
-    "Number=Plur|POS=PRON|PronType=Ind":95,
-    "Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Gen|POS=PROPN":96,
-    "POS=ADP":85,
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
+    "Number=Plur|POS=PRON|PronType=Int,Rel":95,
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
     "Degree=Cmp|Number=Plur|POS=ADJ":84,
-    "Definite=Def|Degree=Sup|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
+    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
     "Gender=Com|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
+    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
+    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
+    "Gender=Com|POS=PRON|PronType=Int,Rel":95,
+    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":84,
+    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
+    "POS=VERB|VerbForm=Ger":100,
+    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":95,
+    "Case=Gen|POS=PRON|PronType=Int,Rel":95,
+    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":100,
+    "Abbr=Yes|POS=X":101,
+    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
+    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Definite=Ind|Number=Plur|POS=NOUN":92,
+    "Foreign=Yes|POS=X":101,
     "Number=Plur|POS=PRON|PronType=Rcp":95,
+    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
     "Case=Gen|Degree=Cmp|POS=ADJ":84,
     "Case=Gen|Definite=Def|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Plur|POS=DET|Person=3|Poss=Yes|PronType=Prs":90,
-    "POS=INTJ":91,
-    "Number=Plur|Number[psor]=Sing|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Degree=Pos|Gender=Neut|Number=Sing|POS=ADJ":84,
-    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
-    "Case=Acc|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Plur|POS=NOUN":92,
-    "Number=Sing|POS=PRON|PronType=Int,Rel":95,
+    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
+    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":95,
     "Number=Plur|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Int,Rel":95,
-    "Definite=Def|Degree=Sup|Number=Plur|POS=ADJ":84,
-    "Case=Nom|Gender=Com|Number=Sing|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":90,
-    "Definite=Ind|Number=Sing|POS=NOUN":92,
-    "Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Gender=Neut|Number=Sing|Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs|Style=Form":90,
     "Number=Plur|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "POS=SYM":99,
-    "Case=Nom|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
-    "Degree=Sup|POS=ADJ":84,
-    "Number=Plur|POS=DET|PronType=Ind|Style=Arch":90,
-    "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Dem":90,
-    "Foreign=Yes|POS=X":101,
+    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
+    "Case=Gen|Number=Plur|POS=PRON|PronType=Rcp":95,
     "POS=DET|Person=2|Polite=Form|Poss=Yes|PronType=Prs":90,
-    "Gender=Neut|Number=Sing|POS=PRON|PronType=Dem":95,
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=1|PronType=Prs":95,
-    "Case=Gen|Definite=Ind|Gender=Neut|Number=Sing|POS=NOUN":92,
-    "Case=Gen|POS=PRON|PronType=Int,Rel":95,
-    "Gender=Com|Number=Sing|POS=PRON|PronType=Dem":95,
-    "Abbr=Yes|POS=X":101,
-    "Case=Gen|Definite=Ind|Gender=Com|Number=Plur|POS=NOUN":92,
+    "POS=SYM":99,
+    "POS=DET|PronType=Dem":90,
+    "Gender=Com|Number=Sing|POS=NUM":93,
+    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
     "Definite=Def|Degree=Abs|POS=ADJ":84,
-    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":84,
-    "Definite=Ind|POS=NOUN":92,
-    "Gender=Com|Number=Plur|POS=NOUN":92,
-    "Number[psor]=Plur|POS=DET|Person=1|Poss=Yes|PronType=Prs":90,
-    "Gender=Com|POS=PRON|PronType=Int,Rel":95,
-    "Case=Nom|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
+    "POS=VERB|Tense=Pres":100,
+    "Definite=Ind|Gender=Neut|Number=Sing|POS=NUM":93,
     "Degree=Abs|POS=ADV":86,
-    "POS=VERB|VerbForm=Ger":100,
-    "POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Definite=Def|Degree=Sup|Number=Sing|POS=ADJ":84,
-    "Number=Plur|Number[psor]=Plur|POS=PRON|Person=1|Poss=Yes|PronType=Prs|Style=Form":95,
     "Case=Gen|Definite=Def|Degree=Pos|Number=Sing|POS=ADJ":84,
-    "Case=Gen|Degree=Pos|Number=Plur|POS=ADJ":84,
-    "Case=Acc|Gender=Com|POS=PRON|Person=2|Polite=Form|PronType=Prs":95,
     "Gender=Com|Number=Sing|POS=PRON|PronType=Int,Rel":95,
-    "POS=VERB|Tense=Pres":100,
-    "Case=Gen|Number=Plur|POS=DET|PronType=Ind":90,
-    "Number[psor]=Plur|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "POS=PRON|Person=2|Polite=Form|Poss=Yes|PronType=Prs":95,
+    "POS=VERB|Tense=Past|VerbForm=Part":100,
+    "Definite=Ind|Degree=Sup|Number=Sing|POS=ADJ":84,
     "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
-    "POS=AUX|Tense=Pres|VerbForm=Part":87,
-    "Mood=Ind|POS=VERB|Tense=Past|VerbForm=Fin|Voice=Pass":100,
-    "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "Degree=Sup|Number=Plur|POS=ADJ":84,
-    "Case=Acc|Gender=Com|Number=Plur|POS=PRON|Person=2|PronType=Prs":95,
-    "Gender=Neut|Number=Sing|Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs|Reflex=Yes":95,
-    "Definite=Ind|Number=Plur|POS=NOUN":92,
-    "Case=Gen|Number=Plur|POS=VERB|Tense=Past|VerbForm=Part":100,
-    "Mood=Imp|POS=AUX":87,
     "Gender=Com|Number=Sing|Number[psor]=Sing|POS=PRON|Person=1|Poss=Yes|PronType=Prs":95,
-    "Number[psor]=Sing|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
-    "Definite=Def|Gender=Com|Number=Sing|POS=VERB|Tense=Past|VerbForm=Part":100,
     "Number=Plur|Number[psor]=Sing|POS=DET|Person=2|Poss=Yes|PronType=Prs":90,
+    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
+    "Definite=Ind|POS=NOUN":92,
     "Case=Gen|Gender=Com|Number=Sing|POS=DET|PronType=Ind":90,
+    "Definite=Ind|Gender=Com|Number=Sing|POS=NUM":93,
+    "Definite=Def|Number=Plur|POS=NOUN":92,
     "Case=Gen|POS=NOUN":92,
-    "Number[psor]=Plur|POS=PRON|Person=3|Poss=Yes|PronType=Prs":95,
-    "POS=DET|PronType=Dem":90,
-    "Definite=Def|Number=Plur|POS=NOUN":92
-  }
+    "POS=AUX|Tense=Pres|VerbForm=Part":87
+  },
+  "overwrite":true
 }

morphologizer/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:23f57fc1675443668f91cec6eebb387f059ca61d03964b3546612a8127a44bf6
-size 644296
+oid sha256:bb86086f9d66038f2aa26709d98c16c55019bee46b71a06aed3b849e91b32ac7
+size 648448

ner/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a37d9bbf3eda077a5e3e488554779e4cf6e852a62f2a0b8bc8b70c8a638d8dc0
+oid sha256:c8ae79ba510d4fd1ea694860d0e3988e802d2117641e58945ecd22dd0316a6dd
 size 291498

ner/moves

@@ -1 +1 @@
-��moves��{"0":{},"1":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"2":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"3":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144},"4":{"PER":2146,"MISC":1273,"ORG":1267,"LOC":1144,"":1},"5":{"":1}}�cfg��neg_key�
+��moves��{"0":{},"1":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"2":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"3":{"PER":1361,"ORG":943,"MISC":826,"LOC":768},"4":{"PER":1361,"ORG":943,"MISC":826,"LOC":768,"":1},"5":{"":1}}�cfg��neg_key�

parser/model

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1e771118fbecf3915fd2e7788de4d712a3aacece2e084415887537fce51a3947
-size 521693
+oid sha256:8b730ca95666b48456598fd9d9cb8b32b541a62b966389ba845fa7404f46002a
+size 1219859

parser/moves

@@ -1 +1 @@
-��moves�2{"0":{"":41514},"1":{"":34292},"2":{"case":7489,"nsubj":6009,"det":4334,"amod":3968,"advmod":3657,"mark":3529,"aux":2432,"cc":2261,"punct":2182,"cop":1329,"obl":894,"nummod":799,"nmod:poss":651,"nmod":460,"expl":291,"ccomp":202,"obj":195,"xcomp":122,"case||nmod":73,"obl:tmod":53,"dep":49,"acl:relcl":43},"3":{"punct":8600,"obl":3949,"obj":3758,"nmod":3565,"conj":2743,"advmod":2095,"flat":1294,"nsubj":1172,"acl:relcl":1131,"advcl":808,"amod":629,"obl:loc":467,"fixed":390,"dep":322,"xcomp":272,"appos":268,"compound:prt":261,"ccomp":252,"acl:relcl||nsubj":237,"case":202,"nummod":167,"list":161,"nmod:poss":156,"punct||conj":151,"mark":137,"cc":135,"iobj":107,"expl":77,"cop":69,"nmod||case":60,"aux":48,"obl:tmod":45,"cc||case":43,"advcl||advmod":43,"cc||conj":40,"case||obl":38,"punct||case":33},"4":{"ROOT":4367}}�cfg��neg_key�
+��moves��{"0":{"":30710},"1":{"":22084},"2":{"case":5238,"nsubj":4163,"punct":3257,"det":3028,"amod":2815,"advmod":2482,"mark":2317,"aux":1748,"cc":1610,"cop":823,"obl":627,"nummod":620,"nmod:poss":457,"nmod":384,"expl":193,"obj":188,"ccomp":155,"advcl":110,"xcomp":81,"case||nmod":45,"dep":32,"obl:tmod":31},"3":{"punct":4355,"obl":2759,"obj":2659,"nmod":2503,"conj":1923,"advmod":1246,"flat":886,"nsubj":805,"acl:relcl":800,"advcl":744,"amod":415,"xcomp":307,"advmod:lmod":273,"fixed":267,"dep":218,"compound:prt":211,"appos":187,"ccomp":177,"acl:relcl||nsubj":144,"case":130,"nmod:poss":112,"mark":103,"iobj":99,"nummod":93,"list":86,"cc":72,"expl":55,"cop":40,"obl:lmod":35,"obl:tmod":34,"cc||case":31},"4":{"ROOT":2970}}�cfg��neg_key�

span_resolver/cfg

@@ -0,0 +1,3 @@
+{
+  "nI":1024
+}

span_resolver/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:9bfe5b3362ecdf657add5ec93ccaa0d26dacc396d2251816bb6717e67e744a3f
+size 9810117

tagger/cfg

@@ -0,0 +1,23 @@
+{
+  "labels":[
+    "ADJ",
+    "ADP",
+    "ADV",
+    "AUX",
+    "CCONJ",
+    "DET",
+    "INTJ",
+    "NOUN",
+    "NUM",
+    "PART",
+    "PRON",
+    "PROPN",
+    "PUNCT",
+    "SCONJ",
+    "SYM",
+    "VERB",
+    "X"
+  ],
+  "neg_prefix":"!",
+  "overwrite":false
+}

tagger/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:2eb750a8d2d34ce50a457f972731c0dda7229e46a98cbbe87ec46acfe089ca4c
+size 70342

trainable_lemmatizer/cfg

@@ -0,0 +1,348 @@
+{
+  "labels":[
+    1,
+    2,
+    4,
+    6,
+    8,
+    10,
+    12,
+    14,
+    16,
+    18,
+    20,
+    24,
+    26,
+    29,
+    30,
+    34,
+    36,
+    38,
+    42,
+    44,
+    46,
+    48,
+    50,
+    52,
+    54,
+    56,
+    57,
+    60,
+    63,
+    65,
+    67,
+    69,
+    71,
+    73,
+    75,
+    76,
+    78,
+    81,
+    83,
+    84,
+    86,
+    88,
+    92,
+    96,
+    98,
+    100,
+    103,
+    106,
+    108,
+    110,
+    113,
+    115,
+    117,
+    119,
+    121,
+    124,
+    125,
+    127,
+    129,
+    131,
+    133,
+    134,
+    138,
+    140,
+    142,
+    144,
+    146,
+    148,
+    151,
+    153,
+    155,
+    156,
+    159,
+    160,
+    162,
+    164,
+    166,
+    167,
+    168,
+    170,
+    172,
+    175,
+    177,
+    180,
+    182,
+    185,
+    188,
+    190,
+    191,
+    194,
+    197,
+    199,
+    201,
+    205,
+    208,
+    211,
+    212,
+    213,
+    215,
+    217,
+    219,
+    220,
+    221,
+    223,
+    224,
+    226,
+    229,
+    231,
+    232,
+    233,
+    236,
+    238,
+    240,
+    242,
+    244,
+    246,
+    249,
+    250,
+    252,
+    255,
+    256,
+    257,
+    228,
+    259,
+    262,
+    264,
+    266,
+    269,
+    271,
+    274,
+    276,
+    279,
+    281,
+    283,
+    284,
+    285,
+    286,
+    288,
+    289,
+    290,
+    291,
+    293,
+    294,
+    297,
+    298,
+    300,
+    302,
+    303,
+    305,
+    307,
+    308,
+    309,
+    311,
+    312,
+    314,
+    316,
+    318,
+    321,
+    322,
+    323,
+    324,
+    325,
+    327,
+    329,
+    331,
+    333,
+    334,
+    336,
+    338,
+    340,
+    341,
+    343,
+    345,
+    348,
+    351,
+    353,
+    355,
+    356,
+    357,
+    360,
+    362,
+    366,
+    368,
+    370,
+    372,
+    374,
+    376,
+    377,
+    379,
+    381,
+    382,
+    383,
+    384,
+    386,
+    388,
+    389,
+    391,
+    392,
+    395,
+    396,
+    398,
+    400,
+    401,
+    402,
+    403,
+    405,
+    407,
+    408,
+    409,
+    410,
+    412,
+    414,
+    415,
+    418,
+    419,
+    421,
+    422,
+    425,
+    427,
+    428,
+    430,
+    432,
+    433,
+    435,
+    436,
+    438,
+    440,
+    442,
+    443,
+    444,
+    445,
+    446,
+    448,
+    451,
+    452,
+    453,
+    455,
+    456,
+    458,
+    461,
+    463,
+    464,
+    466,
+    467,
+    468,
+    469,
+    470,
+    473,
+    475,
+    479,
+    481,
+    482,
+    486,
+    488,
+    490,
+    492,
+    493,
+    495,
+    497,
+    502,
+    503,
+    504,
+    505,
+    508,
+    509,
+    510,
+    511,
+    512,
+    513,
+    514,
+    515,
+    516,
+    518,
+    519,
+    521,
+    522,
+    524,
+    528,
+    529,
+    530,
+    534,
+    535,
+    537,
+    539,
+    542,
+    544,
+    547,
+    549,
+    550,
+    551,
+    553,
+    555,
+    556,
+    557,
+    559,
+    560,
+    562,
+    566,
+    567,
+    568,
+    570,
+    573,
+    576,
+    579,
+    581,
+    583,
+    584,
+    585,
+    587,
+    590,
+    592,
+    595,
+    597,
+    598,
+    599,
+    600,
+    604,
+    606,
+    608,
+    609,
+    611,
+    612,
+    613,
+    614,
+    616,
+    618,
+    619,
+    622,
+    623,
+    624,
+    625,
+    626,
+    627,
+    628,
+    632,
+    635,
+    636,
+    637,
+    639,
+    640,
+    641,
+    642,
+    643,
+    644
+  ]
+}

trainable_lemmatizer/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d61d949fe113253b9ba1fdcc196ebb83925fc85232068a0a48a84a46a7f7ae75
+size 1411053

transformer/model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:5e876008aaa91bb3bdc8e5902a85993adcfc8036e7b96307e4d70159cc590f2f
+size 1422087053

transformer/model/config.json

@@ -1,27 +0,0 @@
-{
-  "_name_or_path": "xlm-roberta-large",
-  "architectures": [
-    "XLMRobertaForMaskedLM"
-  ],
-  "attention_probs_dropout_prob": 0.1,
-  "bos_token_id": 0,
-  "eos_token_id": 2,
-  "gradient_checkpointing": false,
-  "hidden_act": "gelu",
-  "hidden_dropout_prob": 0.1,
-  "hidden_size": 1024,
-  "initializer_range": 0.02,
-  "intermediate_size": 4096,
-  "layer_norm_eps": 1e-05,
-  "max_position_embeddings": 514,
-  "model_type": "xlm-roberta",
-  "num_attention_heads": 16,
-  "num_hidden_layers": 24,
-  "output_past": true,
-  "pad_token_id": 1,
-  "position_embedding_type": "absolute",
-  "transformers_version": "4.5.1",
-  "type_vocab_size": 1,
-  "use_cache": true,
-  "vocab_size": 250002
-}

transformer/model/special_tokens_map.json

@@ -1 +0,0 @@
-{"bos_token": "<s>", "eos_token": "</s>", "unk_token": "<unk>", "sep_token": "</s>", "pad_token": "<pad>", "cls_token": "<s>", "mask_token": {"content": "<mask>", "single_word": false, "lstrip": true, "rstrip": false, "normalized": false}}

transformer/model/tokenizer_config.json

@@ -1 +0,0 @@
-{"bos_token": "<s>", "eos_token": "</s>", "sep_token": "</s>", "cls_token": "<s>", "unk_token": "<unk>", "pad_token": "<pad>", "mask_token": {"content": "<mask>", "single_word": false, "lstrip": true, "rstrip": false, "normalized": true, "__type": "AddedToken"}, "strip_accents": false, "model_max_length": 512, "special_tokens_map_file": null, "name_or_path": "xlm-roberta-large"}

vocab/lookups.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a6f4a94131759bf84baec98b3347bcef57ffb2d6712f7f3b8f611e9ef4b3df35
-size 20402
+oid sha256:76be8b528d0075f7aae98d6fa57a6d3c83ae480a8469e668d7b0af968995ac71
+size 1

vocab/strings.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5b50a86603f748496e4fd87a8aaa203a32bf82d4b3768bf54187ff40de3ca6f9
-size 460120
+oid sha256:ec97f460233cd7e225ffce56c87cfe570210c27ccdb209855f13ebba48c7a1bf
+size 544073

vocab/vectors.cfg

@@ -0,0 +1,3 @@
+{
+  "mode":"default"
+}