Instructions to use mosaicml/mosaic-bert-base-seqlen-1024 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use mosaicml/mosaic-bert-base-seqlen-1024 with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="mosaicml/mosaic-bert-base-seqlen-1024", trust_remote_code=True)# Load model directly from transformers import AutoTokenizer, AutoModelForMaskedLM tokenizer = AutoTokenizer.from_pretrained("mosaicml/mosaic-bert-base-seqlen-1024", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("mosaicml/mosaic-bert-base-seqlen-1024", trust_remote_code=True) - Notebooks
- Google Colab
- Kaggle
Adding `safetensors` variant of this model
#5 opened over 1 year ago
by
SFconvertbot
Update config.json
#4 opened about 2 years ago
by
clarine
Update bert_layers.py
#3 opened about 2 years ago
by
clarine
Error with the custom BERT config
#1 opened almost 3 years ago
by
shreyansh26