File size: 553 Bytes
552c37e 83658e1 552c37e 83658e1 552c37e 0db5f40 8cb4a54 0db5f40 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 |
# Dense Encoder - Distilbert - Frozen Token Embeddings
This model is a distilbert-base-uncased model trained for 30 epochs (235k steps), 64 batch size with MarginMSE Loss on MS MARCO dataset.
The token embeddings were frozen.
| Dataset | Model with updated token embeddings | Model with frozen embeddings |
| --- | :---: | :---: |
| TREC-DL 19 | 70.68 | 68.60 |
| TREC-DL 20 | 67.69 | 70.21 |
| FiQA | 28.89 | 28.60 |
| Robust04 | 39.56 | 39.08 |
| TREC-COVID v2 | 69.80 | 69.84 |
| TREC-NEWS | 37.97 | 38.27 |
| Avg. 4 BEIR tasks | 44.06 | 43.95 |
|