denocris's picture
Update README.md
ade6ab7
|
raw
history blame
1.04 kB
metadata
language: it
license: mit

WineBERTo 🍷🥂

wineberto-italian-cased is a BERT model obtained by MLM adaptive-tuning bert-base-italian-xxl-cased model on Italian drink recipes and wine descriptions, approximately 77k sentences (3.3M words).

Author: Cristiano De Nobili (@denocris on Twitter, LinkedIn) for VINHOOD.


Perplexity

Test set of 14k sentences about food.

Model Perplexity
wineberto-italian-cased 2.29
bert-base-italian-xxl-cased 4.60

Usage

from transformers import AutoModel, AutoTokenizer
model_name = "vinhood/wineberto-italian-cased"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)