maritaca-ai/sabia-7b · BERTimbau replacement for domain-specific text classification in Portuguese

Hi,

I'm starting this discussion as I currently have fine-tuned three BERTimbau base models for text classification in a Social Listening project. Now that the beta version was successfully released, I'm looking further to improve the overall performance of the project - so, I'm considering two other options:

• Build a simple context based agent using this model along with LangChain;
• Try something around Zero-Shot Classification.

So, I would like to ask if Sabia would be a good fit - as well as if any of these options above are reasonable and make sense.

Best,
Naomi Lago

Notes:

The project uses Brazilian Portuguese data, hence I do have the need to find relevant models that could also perform well in this language.

I'm new to this field, so I'd really appreciate any resource recommendations and guidance, in case I missed something.