Commit
•
d4dc899
1
Parent(s):
8a1da2b
init
Browse files
README.md
CHANGED
|
@@ -19563,6 +19563,17 @@ KaLM-embedding-multilingual-mini is trained from [Qwen/Qwen2-0.5B](https://huggi
|
|
| 19563 |
- [ ] Training Data
|
| 19564 |
|
| 19565 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 19566 |
|
| 19567 |
## Requirements
|
| 19568 |
Since we have used the Qwen2 model, we advise you to install `transformers>=4.37.0`, or you might encounter the following error:
|
|
|
|
| 19563 |
- [ ] Training Data
|
| 19564 |
|
| 19565 |
|
| 19566 |
+
## Evaluation
|
| 19567 |
+
|
| 19568 |
+
| Model Name | Model Size | C-MTEB(35) | MTEB(56) | avg
|
| 19569 |
+
|:----:|:---:|:---:|:---:|:---:|
|
| 19570 |
+
| [multilingual-e5-large](https://huggingface.co/intfloat/multilingual-e5-large) | 560M | 58.81 | 61.5 | 60.16
|
| 19571 |
+
| [bge-m3 (dense)](https://huggingface.co/BAAI/bge-m3) | 560M | 60.80 | 59.84 | 60.32
|
| 19572 |
+
| [gte-multilingual-base (dense)](https://huggingface.co/Alibaba-NLP/gte-multilingual-base) | **305M** | 62.72 | 61.40 | 62.06
|
| 19573 |
+
| [KaLM-embedding-multilingual-mini-v1](https://huggingface.co/HIT-TMG/KaLM-embedding-multilingual-mini-v1) | 494M | 62.31 | 61.87 | 62.09
|
| 19574 |
+
| [KaLM-embedding-multilingual-mini-instruct-v1](https://huggingface.co/HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1) | 494M | **63.57** | **64.74** | **64.16**
|
| 19575 |
+
|
| 19576 |
+
|
| 19577 |
|
| 19578 |
## Requirements
|
| 19579 |
Since we have used the Qwen2 model, we advise you to install `transformers>=4.37.0`, or you might encounter the following error:
|