sergeyzh commited on
Commit
16f5cf9
1 Parent(s): 397a4c7

Updating the test table

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -41,17 +41,17 @@ print(util.dot_score(embeddings, embeddings))
41
 
42
  | Model | CPU | GPU | size | Mean S | Mean S+W | dim |
43
  |:-----------------------------------|----------:|---------:|---------:|----------:|-----------:|-------:|
44
- | **sergeyzh/LaBSE-ru-turbo** | **133.40**|**15.30** |**490** | **0.789**| **0.703** | **768**|
45
  | BAAI/bge-m3 | 523.40 | 22.50 | 2166 | 0.787 | 0.696 | 1024 |
46
  | intfloat/multilingual-e5-large | 506.80 | 30.80 | 2136 | 0.780 | 0.686 | 1024 |
47
  | intfloat/multilingual-e5-base | 130.61 | 14.39 | 1061 | 0.761 | 0.669 | 768 |
48
  | sergeyzh/rubert-tiny-turbo | 5.51 | 3.25 | 111 | 0.749 | 0.667 | 312 |
49
  | intfloat/multilingual-e5-small | 40.86 | 12.09 | 449 | 0.742 | 0.645 | 384 |
50
- | cointegrated/LaBSE-en-ru | 133.40 | 15.30 | 490 | 0.739 | 0.667 | 768 |
51
 
52
  | Model | STS | PI | NLI | SA | TI | IA | IC | ICX | NE1 | NE2 |
53
  |:-----------------------------------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|
54
- | **sergeyzh/LaBSE-ru-turbo** |**0.864** |**0.748** |**0.490** |**0.814** |**0.974** |**0.806** |**0.815** |**0.802** |**0.320** |**0.401** |
55
  | BAAI/bge-m3 | 0.864 | 0.749 | 0.510 | 0.819 | 0.973 | 0.792 | 0.809 | 0.783 | 0.240 | 0.422 |
56
  | intfloat/multilingual-e5-large | 0.862 | 0.727 | 0.473 | 0.810 | 0.979 | 0.798 | 0.819 | 0.773 | 0.224 | 0.374 |
57
  | intfloat/multilingual-e5-base | 0.835 | 0.704 | 0.459 | 0.796 | 0.964 | 0.783 | 0.802 | 0.738 | 0.235 | 0.376 |
 
41
 
42
  | Model | CPU | GPU | size | Mean S | Mean S+W | dim |
43
  |:-----------------------------------|----------:|---------:|---------:|----------:|-----------:|-------:|
44
+ | **sergeyzh/LaBSE-ru-turbo** | **120.40**| **8.05** |**490** | **0.789**| **0.702** | **768**|
45
  | BAAI/bge-m3 | 523.40 | 22.50 | 2166 | 0.787 | 0.696 | 1024 |
46
  | intfloat/multilingual-e5-large | 506.80 | 30.80 | 2136 | 0.780 | 0.686 | 1024 |
47
  | intfloat/multilingual-e5-base | 130.61 | 14.39 | 1061 | 0.761 | 0.669 | 768 |
48
  | sergeyzh/rubert-tiny-turbo | 5.51 | 3.25 | 111 | 0.749 | 0.667 | 312 |
49
  | intfloat/multilingual-e5-small | 40.86 | 12.09 | 449 | 0.742 | 0.645 | 384 |
50
+ | cointegrated/LaBSE-en-ru | 120.40 | 8.05 | 490 | 0.739 | 0.667 | 768 |
51
 
52
  | Model | STS | PI | NLI | SA | TI | IA | IC | ICX | NE1 | NE2 |
53
  |:-----------------------------------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|:---------|
54
+ | **sergeyzh/LaBSE-ru-turbo** |**0.864** |**0.748** |**0.490** |**0.814** |**0.974** |**0.806** |**0.815** |**0.801** |**0.305** |**0.404** |
55
  | BAAI/bge-m3 | 0.864 | 0.749 | 0.510 | 0.819 | 0.973 | 0.792 | 0.809 | 0.783 | 0.240 | 0.422 |
56
  | intfloat/multilingual-e5-large | 0.862 | 0.727 | 0.473 | 0.810 | 0.979 | 0.798 | 0.819 | 0.773 | 0.224 | 0.374 |
57
  | intfloat/multilingual-e5-base | 0.835 | 0.704 | 0.459 | 0.796 | 0.964 | 0.783 | 0.802 | 0.738 | 0.235 | 0.376 |