Some weights of the model checkpoint at ../DNABERT-2-117M/ were not used when initializing BertModel

by Yudy95 - opened Jul 28, 2023

Discussion

Yudy95

Jul 28, 2023

Hi Zhihan,
When I load the model, it raises the following warnings. Is it in expectation?

Thanks for your help

zhihan1996

Owner Jul 28, 2023

Hey,

This is not expected. As shown in the warning, most of the weights are randomly initialized instead of been loaded. This is because the model I uploaded has different parameter name as the original BERT model. So please let the model with:

model = AutoModel.from_pretrained("zhihan1996/DNABERT-2-117M", trust_remote_code=True)

zhihan1996 changed discussion status to closed Jul 28, 2023

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment