Chrislu commited on
Commit
0a212f8
·
verified ·
1 Parent(s): a24f520

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +573 -3
README.md CHANGED
@@ -1,7 +1,577 @@
1
  ---
2
- # For reference on model card metadata, see the spec: https://github.com/huggingface/hub-docs/blob/main/modelcard.md?plain=1
3
- # Doc / guide: https://huggingface.co/docs/hub/model-cards
4
- {}
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  # Chuxin-Embedding
 
1
  ---
2
+ model-index:
3
+ - name: PLACEHOLDER
4
+ results:
5
+ - dataset:
6
+ config: default
7
+ name: MTEB CmedqaRetrieval (default)
8
+ revision: cd540c506dae1cf9e9a59c3e06f42030d54e7301
9
+ split: dev
10
+ type: C-MTEB/CmedqaRetrieval
11
+ metrics:
12
+ - type: map_at_1
13
+ value: 33.391999999999996
14
+ - type: map_at_10
15
+ value: 48.715
16
+ - type: map_at_100
17
+ value: 50.381
18
+ - type: map_at_1000
19
+ value: 50.456
20
+ - type: map_at_3
21
+ value: 43.708999999999996
22
+ - type: map_at_5
23
+ value: 46.405
24
+ - type: mrr_at_1
25
+ value: 48.612
26
+ - type: mrr_at_10
27
+ value: 58.67099999999999
28
+ - type: mrr_at_100
29
+ value: 59.38
30
+ - type: mrr_at_1000
31
+ value: 59.396
32
+ - type: mrr_at_3
33
+ value: 55.906
34
+ - type: mrr_at_5
35
+ value: 57.421
36
+ - type: ndcg_at_1
37
+ value: 48.612
38
+ - type: ndcg_at_10
39
+ value: 56.581
40
+ - type: ndcg_at_100
41
+ value: 62.422999999999995
42
+ - type: ndcg_at_1000
43
+ value: 63.476
44
+ - type: ndcg_at_3
45
+ value: 50.271
46
+ - type: ndcg_at_5
47
+ value: 52.79899999999999
48
+ - type: precision_at_1
49
+ value: 48.612
50
+ - type: precision_at_10
51
+ value: 11.995000000000001
52
+ - type: precision_at_100
53
+ value: 1.696
54
+ - type: precision_at_1000
55
+ value: 0.185
56
+ - type: precision_at_3
57
+ value: 27.465
58
+ - type: precision_at_5
59
+ value: 19.675
60
+ - type: recall_at_1
61
+ value: 33.391999999999996
62
+ - type: recall_at_10
63
+ value: 69.87100000000001
64
+ - type: recall_at_100
65
+ value: 93.078
66
+ - type: recall_at_1000
67
+ value: 99.55199999999999
68
+ - type: recall_at_3
69
+ value: 50.939
70
+ - type: recall_at_5
71
+ value: 58.714
72
+ - type: main_score
73
+ value: 56.581
74
+ task:
75
+ type: Retrieval
76
+ - dataset:
77
+ config: default
78
+ name: MTEB CovidRetrieval (default)
79
+ revision: 1271c7809071a13532e05f25fb53511ffce77117
80
+ split: dev
81
+ type: C-MTEB/CovidRetrieval
82
+ metrics:
83
+ - type: map_at_1
84
+ value: 71.918
85
+ - type: map_at_10
86
+ value: 80.609
87
+ - type: map_at_100
88
+ value: 80.796
89
+ - type: map_at_1000
90
+ value: 80.798
91
+ - type: map_at_3
92
+ value: 79.224
93
+ - type: map_at_5
94
+ value: 79.96
95
+ - type: mrr_at_1
96
+ value: 72.076
97
+ - type: mrr_at_10
98
+ value: 80.61399999999999
99
+ - type: mrr_at_100
100
+ value: 80.801
101
+ - type: mrr_at_1000
102
+ value: 80.803
103
+ - type: mrr_at_3
104
+ value: 79.276
105
+ - type: mrr_at_5
106
+ value: 80.025
107
+ - type: ndcg_at_1
108
+ value: 72.076
109
+ - type: ndcg_at_10
110
+ value: 84.286
111
+ - type: ndcg_at_100
112
+ value: 85.14500000000001
113
+ - type: ndcg_at_1000
114
+ value: 85.21
115
+ - type: ndcg_at_3
116
+ value: 81.45400000000001
117
+ - type: ndcg_at_5
118
+ value: 82.781
119
+ - type: precision_at_1
120
+ value: 72.076
121
+ - type: precision_at_10
122
+ value: 9.663
123
+ - type: precision_at_100
124
+ value: 1.005
125
+ - type: precision_at_1000
126
+ value: 0.101
127
+ - type: precision_at_3
128
+ value: 29.398999999999997
129
+ - type: precision_at_5
130
+ value: 18.335
131
+ - type: recall_at_1
132
+ value: 71.918
133
+ - type: recall_at_10
134
+ value: 95.574
135
+ - type: recall_at_100
136
+ value: 99.473
137
+ - type: recall_at_1000
138
+ value: 100.0
139
+ - type: recall_at_3
140
+ value: 87.82900000000001
141
+ - type: recall_at_5
142
+ value: 90.991
143
+ - type: main_score
144
+ value: 84.286
145
+ task:
146
+ type: Retrieval
147
+ - dataset:
148
+ config: default
149
+ name: MTEB DuRetrieval (default)
150
+ revision: a1a333e290fe30b10f3f56498e3a0d911a693ced
151
+ split: dev
152
+ type: C-MTEB/DuRetrieval
153
+ metrics:
154
+ - type: map_at_1
155
+ value: 25.019999999999996
156
+ - type: map_at_10
157
+ value: 77.744
158
+ - type: map_at_100
159
+ value: 80.562
160
+ - type: map_at_1000
161
+ value: 80.60300000000001
162
+ - type: map_at_3
163
+ value: 52.642999999999994
164
+ - type: map_at_5
165
+ value: 67.179
166
+ - type: mrr_at_1
167
+ value: 86.5
168
+ - type: mrr_at_10
169
+ value: 91.024
170
+ - type: mrr_at_100
171
+ value: 91.09
172
+ - type: mrr_at_1000
173
+ value: 91.093
174
+ - type: mrr_at_3
175
+ value: 90.558
176
+ - type: mrr_at_5
177
+ value: 90.913
178
+ - type: ndcg_at_1
179
+ value: 86.5
180
+ - type: ndcg_at_10
181
+ value: 85.651
182
+ - type: ndcg_at_100
183
+ value: 88.504
184
+ - type: ndcg_at_1000
185
+ value: 88.887
186
+ - type: ndcg_at_3
187
+ value: 82.707
188
+ - type: ndcg_at_5
189
+ value: 82.596
190
+ - type: precision_at_1
191
+ value: 86.5
192
+ - type: precision_at_10
193
+ value: 41.595
194
+ - type: precision_at_100
195
+ value: 4.7940000000000005
196
+ - type: precision_at_1000
197
+ value: 0.48900000000000005
198
+ - type: precision_at_3
199
+ value: 74.233
200
+ - type: precision_at_5
201
+ value: 63.68000000000001
202
+ - type: recall_at_1
203
+ value: 25.019999999999996
204
+ - type: recall_at_10
205
+ value: 88.114
206
+ - type: recall_at_100
207
+ value: 97.442
208
+ - type: recall_at_1000
209
+ value: 99.39099999999999
210
+ - type: recall_at_3
211
+ value: 55.397
212
+ - type: recall_at_5
213
+ value: 73.095
214
+ - type: main_score
215
+ value: 85.651
216
+ task:
217
+ type: Retrieval
218
+ - dataset:
219
+ config: default
220
+ name: MTEB EcomRetrieval (default)
221
+ revision: 687de13dc7294d6fd9be10c6945f9e8fec8166b9
222
+ split: dev
223
+ type: C-MTEB/EcomRetrieval
224
+ metrics:
225
+ - type: map_at_1
226
+ value: 55.60000000000001
227
+ - type: map_at_10
228
+ value: 67.891
229
+ - type: map_at_100
230
+ value: 68.28699999999999
231
+ - type: map_at_1000
232
+ value: 68.28699999999999
233
+ - type: map_at_3
234
+ value: 64.86699999999999
235
+ - type: map_at_5
236
+ value: 66.652
237
+ - type: mrr_at_1
238
+ value: 55.60000000000001
239
+ - type: mrr_at_10
240
+ value: 67.891
241
+ - type: mrr_at_100
242
+ value: 68.28699999999999
243
+ - type: mrr_at_1000
244
+ value: 68.28699999999999
245
+ - type: mrr_at_3
246
+ value: 64.86699999999999
247
+ - type: mrr_at_5
248
+ value: 66.652
249
+ - type: ndcg_at_1
250
+ value: 55.60000000000001
251
+ - type: ndcg_at_10
252
+ value: 74.01100000000001
253
+ - type: ndcg_at_100
254
+ value: 75.602
255
+ - type: ndcg_at_1000
256
+ value: 75.602
257
+ - type: ndcg_at_3
258
+ value: 67.833
259
+ - type: ndcg_at_5
260
+ value: 71.005
261
+ - type: precision_at_1
262
+ value: 55.60000000000001
263
+ - type: precision_at_10
264
+ value: 9.33
265
+ - type: precision_at_100
266
+ value: 1.0
267
+ - type: precision_at_1000
268
+ value: 0.1
269
+ - type: precision_at_3
270
+ value: 25.467000000000002
271
+ - type: precision_at_5
272
+ value: 16.8
273
+ - type: recall_at_1
274
+ value: 55.60000000000001
275
+ - type: recall_at_10
276
+ value: 93.30000000000001
277
+ - type: recall_at_100
278
+ value: 100.0
279
+ - type: recall_at_1000
280
+ value: 100.0
281
+ - type: recall_at_3
282
+ value: 76.4
283
+ - type: recall_at_5
284
+ value: 84.0
285
+ - type: main_score
286
+ value: 74.01100000000001
287
+ task:
288
+ type: Retrieval
289
+ - dataset:
290
+ config: default
291
+ name: MTEB MMarcoRetrieval (default)
292
+ revision: 539bbde593d947e2a124ba72651aafc09eb33fc2
293
+ split: dev
294
+ type: C-MTEB/MMarcoRetrieval
295
+ metrics:
296
+ - type: map_at_1
297
+ value: 66.24799999999999
298
+ - type: map_at_10
299
+ value: 75.356
300
+ - type: map_at_100
301
+ value: 75.653
302
+ - type: map_at_1000
303
+ value: 75.664
304
+ - type: map_at_3
305
+ value: 73.515
306
+ - type: map_at_5
307
+ value: 74.67099999999999
308
+ - type: mrr_at_1
309
+ value: 68.496
310
+ - type: mrr_at_10
311
+ value: 75.91499999999999
312
+ - type: mrr_at_100
313
+ value: 76.17399999999999
314
+ - type: mrr_at_1000
315
+ value: 76.184
316
+ - type: mrr_at_3
317
+ value: 74.315
318
+ - type: mrr_at_5
319
+ value: 75.313
320
+ - type: ndcg_at_1
321
+ value: 68.496
322
+ - type: ndcg_at_10
323
+ value: 79.065
324
+ - type: ndcg_at_100
325
+ value: 80.417
326
+ - type: ndcg_at_1000
327
+ value: 80.72399999999999
328
+ - type: ndcg_at_3
329
+ value: 75.551
330
+ - type: ndcg_at_5
331
+ value: 77.505
332
+ - type: precision_at_1
333
+ value: 68.496
334
+ - type: precision_at_10
335
+ value: 9.563
336
+ - type: precision_at_100
337
+ value: 1.024
338
+ - type: precision_at_1000
339
+ value: 0.105
340
+ - type: precision_at_3
341
+ value: 28.391
342
+ - type: precision_at_5
343
+ value: 18.086
344
+ - type: recall_at_1
345
+ value: 66.24799999999999
346
+ - type: recall_at_10
347
+ value: 89.97
348
+ - type: recall_at_100
349
+ value: 96.13199999999999
350
+ - type: recall_at_1000
351
+ value: 98.551
352
+ - type: recall_at_3
353
+ value: 80.624
354
+ - type: recall_at_5
355
+ value: 85.271
356
+ - type: main_score
357
+ value: 79.065
358
+ task:
359
+ type: Retrieval
360
+ - dataset:
361
+ config: default
362
+ name: MTEB MedicalRetrieval (default)
363
+ revision: 2039188fb5800a9803ba5048df7b76e6fb151fc6
364
+ split: dev
365
+ type: C-MTEB/MedicalRetrieval
366
+ metrics:
367
+ - type: map_at_1
368
+ value: 61.8
369
+ - type: map_at_10
370
+ value: 71.101
371
+ - type: map_at_100
372
+ value: 71.576
373
+ - type: map_at_1000
374
+ value: 71.583
375
+ - type: map_at_3
376
+ value: 68.867
377
+ - type: map_at_5
378
+ value: 70.272
379
+ - type: mrr_at_1
380
+ value: 61.9
381
+ - type: mrr_at_10
382
+ value: 71.158
383
+ - type: mrr_at_100
384
+ value: 71.625
385
+ - type: mrr_at_1000
386
+ value: 71.631
387
+ - type: mrr_at_3
388
+ value: 68.917
389
+ - type: mrr_at_5
390
+ value: 70.317
391
+ - type: ndcg_at_1
392
+ value: 61.8
393
+ - type: ndcg_at_10
394
+ value: 75.624
395
+ - type: ndcg_at_100
396
+ value: 77.702
397
+ - type: ndcg_at_1000
398
+ value: 77.836
399
+ - type: ndcg_at_3
400
+ value: 71.114
401
+ - type: ndcg_at_5
402
+ value: 73.636
403
+ - type: precision_at_1
404
+ value: 61.8
405
+ - type: precision_at_10
406
+ value: 8.98
407
+ - type: precision_at_100
408
+ value: 0.9900000000000001
409
+ - type: precision_at_1000
410
+ value: 0.1
411
+ - type: precision_at_3
412
+ value: 25.867
413
+ - type: precision_at_5
414
+ value: 16.74
415
+ - type: recall_at_1
416
+ value: 61.8
417
+ - type: recall_at_10
418
+ value: 89.8
419
+ - type: recall_at_100
420
+ value: 99.0
421
+ - type: recall_at_1000
422
+ value: 100.0
423
+ - type: recall_at_3
424
+ value: 77.60000000000001
425
+ - type: recall_at_5
426
+ value: 83.7
427
+ - type: main_score
428
+ value: 75.624
429
+ task:
430
+ type: Retrieval
431
+ - dataset:
432
+ config: default
433
+ name: MTEB T2Retrieval (default)
434
+ revision: 8731a845f1bf500a4f111cf1070785c793d10e64
435
+ split: dev
436
+ type: C-MTEB/T2Retrieval
437
+ metrics:
438
+ - type: map_at_1
439
+ value: 27.173000000000002
440
+ - type: map_at_10
441
+ value: 76.454
442
+ - type: map_at_100
443
+ value: 80.021
444
+ - type: map_at_1000
445
+ value: 80.092
446
+ - type: map_at_3
447
+ value: 53.876999999999995
448
+ - type: map_at_5
449
+ value: 66.122
450
+ - type: mrr_at_1
451
+ value: 89.519
452
+ - type: mrr_at_10
453
+ value: 92.091
454
+ - type: mrr_at_100
455
+ value: 92.179
456
+ - type: mrr_at_1000
457
+ value: 92.183
458
+ - type: mrr_at_3
459
+ value: 91.655
460
+ - type: mrr_at_5
461
+ value: 91.94
462
+ - type: ndcg_at_1
463
+ value: 89.519
464
+ - type: ndcg_at_10
465
+ value: 84.043
466
+ - type: ndcg_at_100
467
+ value: 87.60900000000001
468
+ - type: ndcg_at_1000
469
+ value: 88.32799999999999
470
+ - type: ndcg_at_3
471
+ value: 85.623
472
+ - type: ndcg_at_5
473
+ value: 84.111
474
+ - type: precision_at_1
475
+ value: 89.519
476
+ - type: precision_at_10
477
+ value: 41.760000000000005
478
+ - type: precision_at_100
479
+ value: 4.982
480
+ - type: precision_at_1000
481
+ value: 0.515
482
+ - type: precision_at_3
483
+ value: 74.944
484
+ - type: precision_at_5
485
+ value: 62.705999999999996
486
+ - type: recall_at_1
487
+ value: 27.173000000000002
488
+ - type: recall_at_10
489
+ value: 82.878
490
+ - type: recall_at_100
491
+ value: 94.527
492
+ - type: recall_at_1000
493
+ value: 98.24199999999999
494
+ - type: recall_at_3
495
+ value: 55.589
496
+ - type: recall_at_5
497
+ value: 69.476
498
+ - type: main_score
499
+ value: 84.043
500
+ task:
501
+ type: Retrieval
502
+ - dataset:
503
+ config: default
504
+ name: MTEB VideoRetrieval (default)
505
+ revision: 58c2597a5943a2ba48f4668c3b90d796283c5639
506
+ split: dev
507
+ type: C-MTEB/VideoRetrieval
508
+ metrics:
509
+ - type: map_at_1
510
+ value: 70.1
511
+ - type: map_at_10
512
+ value: 79.62
513
+ - type: map_at_100
514
+ value: 79.804
515
+ - type: map_at_1000
516
+ value: 79.804
517
+ - type: map_at_3
518
+ value: 77.81700000000001
519
+ - type: map_at_5
520
+ value: 79.037
521
+ - type: mrr_at_1
522
+ value: 70.1
523
+ - type: mrr_at_10
524
+ value: 79.62
525
+ - type: mrr_at_100
526
+ value: 79.804
527
+ - type: mrr_at_1000
528
+ value: 79.804
529
+ - type: mrr_at_3
530
+ value: 77.81700000000001
531
+ - type: mrr_at_5
532
+ value: 79.037
533
+ - type: ndcg_at_1
534
+ value: 70.1
535
+ - type: ndcg_at_10
536
+ value: 83.83500000000001
537
+ - type: ndcg_at_100
538
+ value: 84.584
539
+ - type: ndcg_at_1000
540
+ value: 84.584
541
+ - type: ndcg_at_3
542
+ value: 80.282
543
+ - type: ndcg_at_5
544
+ value: 82.472
545
+ - type: precision_at_1
546
+ value: 70.1
547
+ - type: precision_at_10
548
+ value: 9.68
549
+ - type: precision_at_100
550
+ value: 1.0
551
+ - type: precision_at_1000
552
+ value: 0.1
553
+ - type: precision_at_3
554
+ value: 29.133
555
+ - type: precision_at_5
556
+ value: 18.54
557
+ - type: recall_at_1
558
+ value: 70.1
559
+ - type: recall_at_10
560
+ value: 96.8
561
+ - type: recall_at_100
562
+ value: 100.0
563
+ - type: recall_at_1000
564
+ value: 100.0
565
+ - type: recall_at_3
566
+ value: 87.4
567
+ - type: recall_at_5
568
+ value: 92.7
569
+ - type: main_score
570
+ value: 83.83500000000001
571
+ task:
572
+ type: Retrieval
573
+ tags:
574
+ - mteb
575
  ---
576
 
577
  # Chuxin-Embedding