bert-base-spanish-wwm-cased-nubes

This model is a finetuned version of bert-base-spanish-wwm-cased for the nubes dataset used in a benchmark in the paper TODO. The model has a F1 of 0.908

Please refer to the original publication for more information TODO LINK

Parameters used

parameter	Value
batch size	16
learning rate	3e-05
classifier dropout	0.1
warmup ratio	0
warmup steps	0
weight decay	0
optimizer	AdamW
epochs	10
early stopping patience	3

BibTeX entry and citation info

TODO

Downloads last month: 5

Safetensors

Model size

110M params

Tensor type

I64

F32

Inference Providers NEW

Token Classification

This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including IIC/bert-base-spanish-wwm-cased-nubes

👨🏻‍⚕️ Spanish Clinical Encoders Analysis

Collection

Models and datasets used in the paper `A comparative analysis of Spanish Clinical encoder-based models on NER and classification tasks` • 92 items • Updated Jan 23, 2024 • 1

Evaluation results

f1 on nubes
test set self-reported

0.908

View on Papers With Code