Problem with load_metric. With update to evaluation, the results are now: exact_match: 43.547 and f1: 56.6346
load_metric dont work now. >>> https://discuss.huggingface.co/t/cant-import-load-metric-from-datasets/107524
New results {'exact_match': 43.54777672658467, 'f1': 56.63463177712266}
my code: https://drive.google.com/file/d/1DKKo5O9gAZbQtqw3Dgsi7pvMHqnROss0/view?usp=sharing
Problema com load_metric
Atualmente, a função load_metric não está funcionando corretamente. Esse problema foi discutido em um tópico no fórum da Hugging Face: https://discuss.huggingface.co/t/cant-import-load-metric-from-datasets/107524
Novos Resultados
Os resultados obtidos após ajustes no código são os seguintes:
Exact Match: 43.55%
F1 Score: 56.63%
Meu Código
O código completo pode ser acessado através deste link: https://drive.google.com/file/d/1DKKo5O9gAZbQtqw3Dgsi7pvMHqnROss0/view?usp=sharing
I thought that the dataset from 'https://docs.google.com/uc?export=download&id=1Q0IaIlv2h2BC468MwUFmUST0EyN7gNkn' was based on nunorc/squad_v1_pt. I don't understand the difference in performance/results."
Exact Match: 43.55% F1 Score: 56.63%
VS
{'exact_match': 70.10406811731315, 'f1': 82.27695438736154}
With the dataset provided in the source code, I obtained the results. Ok
{'exact_match': 70.10406811731315, 'f1': 82.27695438736154}