Is the trained model for text classification already available?

#16
by PedroRuizCode - opened

Hi there,

When I try to use the AutoModelForSequenceClassification class it says the following:

Some weights of ModernBertForSequenceClassification were not initialized from the model checkpoint at answerdotai/ModernBERT-base and are newly initialized: ['classifier.bias', 'classifier.weight']
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.

This warning indicates that the final linear classification layer is newly initialized due to "AutoModelForSequenceClassification", it's doesn't matter.

@gaof23 perfect. Thanks!

PedroRuizCode changed discussion status to closed

Sign up or log in to comment