joe32140
/

ModernBERT-large-msmarco

Sentence Similarity

sentence-transformers

feature-extraction

Generated from Trainer

dataset_size:11662655

loss:CachedMultipleNegativesRankingLoss

Inference Endpoints

Model card Files Files and versions Community

joe32140 commited on 2 days ago

Commit

6cd7091

•

1 Parent(s): 6a332b4

Update README.md

Files changed (1) hide show

README.md +11 -7

README.md CHANGED Viewed

@@ -281,13 +281,17 @@ You can finetune this model on your own dataset.
 #### Retrieval tasks compared to original numbers in the paper
-|                         	| NFCorpus 	| SciFact 	| TREC-Covid 	|  FiQA 	| ArguAna 	| SciDocs 	| FEVER 	| Climate-FEVER 	| MLDR - OOD 	|
-|:-----------------------:	|:--------:	|:-------:	|:----------:	|:-----:	|:-------:	|:-------:	|-------	|---------------	|:----------:	|
-| ModernBERT-base         	| 23.7     	| 57.0    	| 72.1       	| 28.8  	| 35.7    	| 12.5    	| 59.9  	| 23.6          	| 27.4       	|
-| ModernBERT-base (ours)  	| 26.66    	| 61.64   	| 71.43      	| 30.73 	| 46.38   	| 13.67   	| 65.7  	| 22.6          	| 30.58      	|
-| ModernBERT-large        	| 26.2     	| 60.4    	| 74.1       	| 33.1  	| 38.2    	| 13.8    	| 62.7  	| 20.5          	| 34.3       	|
-| ModernBERT-large (ours) 	| 28.44    	| 63.66   	| 77.49      	| 34.35 	| 47.79   	| 15.78   	| 68.2  	| 22.9          	| 38.99      	|
 <!--
 ## Bias, Risks and Limitations

 #### Retrieval tasks compared to original numbers in the paper
+|               	| ModernBERT-base 	| ModernBERT-base (ours) 	| ModernBERT-large 	| ModernBERT-large (ours) 	|
+|:-------------:	|-----------------	|------------------------	|------------------	|-------------------------	|
+|    NFCorpus   	| 23.7            	| 26.66                  	| 26.2             	| 28.44                   	|
+|    SciFact    	| 57.0            	| 61.64                  	| 60.4             	| 63.66                   	|
+|   TREC-Covid  	| 72.1            	| 71.43                  	| 74.1             	| 77.49                   	|
+|      FiQA     	| 28.8            	| 30.73                  	| 33.1             	| 34.35                   	|
+|    ArguAna    	| 35.7            	| 46.38                  	| 38.2             	| 47.79                   	|
+|    SciDocs    	| 12.5            	| 13.67                  	| 13.8             	| 15.78                   	|
+| FEVER         	| 59.9            	| 65.7                   	| 62.7             	| 68.2                    	|
+| Climate-FEVER 	| 23.6            	| 22.6                   	| 20.5             	| 22.9                    	|
+|   MLDR - OOD  	| 27.4            	| 30.58                  	| 34.3             	| 38.99                   	|
 <!--
 ## Bias, Risks and Limitations