---
language: en
license: apache-2.0
widget:
- text: U.S. stocks were set to rise on Monday, led by [MASK] in Apple which neared $3 trillion in market capitalization, while investors braced for a Federal Reserve meeting later this week.
tags:
- fill-mask
---
`FinancialBERT` is a BERT model pre-trained on a large corpora of financial communications. The purpose is to enhance financial NLP research and practice in financial domain, we hope financial practitioners and researchers can benefit from our model without the necessity of the significant computational resources required to train the model. 

Our model was trained on a large corpus of financial texts:
 - TRC2-financial: 1.8M news articles that were published by Reuters between 2008 and 2010.
 - Bloomberg News: 400,000 articles between 2006 and 2013.
 - Corporate Reports: 192,000 transcripts (10-K & 10-Q)
 - Earning Calls: 42,156 documents.
 
More details on `FinancialBERT`'s pre-training process can be found at: https://wandb.ai/ahmedrachid/huggingface/reports/Financial-BERT--VmlldzoxMzQwMTgy

It can be further fine-tuned on downstream tasks such as Sentiment Analysis or Classification & Categorisation on financial news.