Commit
•
0c18fdb
1
Parent(s):
6f0883a
Update README.md
Browse files
README.md
CHANGED
|
@@ -7,6 +7,8 @@ license: openrail
|
|
| 7 |
|
| 8 |
LegalBert-pt is a language model for the legal domain in the Portuguese language. The model was pre-trained to acquire specialization for the domain, and later it could be adjusted for use in specific tasks. Two versions of the model were created: one as a complement to the BERTimbau model, and the other from scratch. The effectiveness of the model based on BERTimbau was evident when analyzing the perplexity measure of the models. Experiments were also carried out in the tasks of identifying legal entities and classifying legal petitions. The results show that the use of specific language models outperforms those obtained using the generic language model in all tasks, suggesting that the specialization of the language model for the legal domain is an important factor for improving the accuracy of learning algorithms.
|
| 9 |
|
|
|
|
|
|
|
| 10 |
## Available models
|
| 11 |
|Model|Initial model|#Layers|#Params|
|
| 12 |
|-|-|-|-|
|
|
|
|
| 7 |
|
| 8 |
LegalBert-pt is a language model for the legal domain in the Portuguese language. The model was pre-trained to acquire specialization for the domain, and later it could be adjusted for use in specific tasks. Two versions of the model were created: one as a complement to the BERTimbau model, and the other from scratch. The effectiveness of the model based on BERTimbau was evident when analyzing the perplexity measure of the models. Experiments were also carried out in the tasks of identifying legal entities and classifying legal petitions. The results show that the use of specific language models outperforms those obtained using the generic language model in all tasks, suggesting that the specialization of the language model for the legal domain is an important factor for improving the accuracy of learning algorithms.
|
| 9 |
|
| 10 |
+
Keywords: Language model, Legal Bert pt, Legal domain
|
| 11 |
+
|
| 12 |
## Available models
|
| 13 |
|Model|Initial model|#Layers|#Params|
|
| 14 |
|-|-|-|-|
|