answerdotai
/

ModernBERT-base

Model card Files Files and versions Community

ModernBERT-base / tokenizer_config.json

Commit History

undo last commit

94032bb
verified

bclavie commited on 1 day ago

Add `"add_prefix_space": true,`; this allows for much stronger token-level performance (e.g. NER, ColBERT) (#48)

b7cc329
verified

tomaarsen HF staff commited on 1 day ago

Update tokenizer: Set lstrip=True for [MASK]

51c9b61

Tom Aarsen commited on 26 days ago

Upload ModernBERT-base model

cb3183f

Tom Aarsen commited on Dec 11, 2024