README.md

metadata

model-index:
  - name: NV-Retriever-v1
    results:
      - dataset:
          config: default
          name: MTEB ArguAna
          revision: c22ab2a51041ffd869aaddef7af8d8215647e41a
          split: test
          type: mteb/arguana
        metrics:
          - type: main_score
            value: 68.277
          - type: map_at_1
            value: 44.666
          - type: map_at_10
            value: 60.3
          - type: map_at_100
            value: 60.692
          - type: map_at_1000
            value: 60.693
          - type: map_at_20
            value: 60.645
          - type: map_at_3
            value: 56.472
          - type: map_at_5
            value: 58.78
          - type: mrr_at_1
            value: 45.092460881934564
          - type: mrr_at_10
            value: 60.493378717063074
          - type: mrr_at_100
            value: 60.87988588545791
          - type: mrr_at_1000
            value: 60.88044591502747
          - type: mrr_at_20
            value: 60.83224958805471
          - type: mrr_at_3
            value: 56.53153153153162
          - type: mrr_at_5
            value: 58.942626837363854
          - type: nauc_map_at_1000_diff1
            value: 14.137909741937149
          - type: nauc_map_at_1000_max
            value: -13.946656236190021
          - type: nauc_map_at_1000_std
            value: -27.431659737602732
          - type: nauc_map_at_100_diff1
            value: 14.136483238553824
          - type: nauc_map_at_100_max
            value: -13.946721068575075
          - type: nauc_map_at_100_std
            value: -27.43462339510713
          - type: nauc_map_at_10_diff1
            value: 13.961240252441984
          - type: nauc_map_at_10_max
            value: -13.804526866049605
          - type: nauc_map_at_10_std
            value: -27.35573153559941
          - type: nauc_map_at_1_diff1
            value: 16.257792463128126
          - type: nauc_map_at_1_max
            value: -16.164790771610072
          - type: nauc_map_at_1_std
            value: -27.84021734986689
          - type: nauc_map_at_20_diff1
            value: 14.106499894575682
          - type: nauc_map_at_20_max
            value: -13.930699708027205
          - type: nauc_map_at_20_std
            value: -27.47446428876476
          - type: nauc_map_at_3_diff1
            value: 15.018611065750246
          - type: nauc_map_at_3_max
            value: -12.659774043658842
          - type: nauc_map_at_3_std
            value: -27.186079034885598
          - type: nauc_map_at_5_diff1
            value: 14.199306816408377
          - type: nauc_map_at_5_max
            value: -13.261282961741303
          - type: nauc_map_at_5_std
            value: -26.71739573072423
          - type: nauc_mrr_at_1000_diff1
            value: 12.629073492081275
          - type: nauc_mrr_at_1000_max
            value: -14.666344334069448
          - type: nauc_mrr_at_1000_std
            value: -27.30760238816266
          - type: nauc_mrr_at_100_diff1
            value: 12.627677268171094
          - type: nauc_mrr_at_100_max
            value: -14.66639461039424
          - type: nauc_mrr_at_100_std
            value: -27.310569102264846
          - type: nauc_mrr_at_10_diff1
            value: 12.482407364331927
          - type: nauc_mrr_at_10_max
            value: -14.509649052862667
          - type: nauc_mrr_at_10_std
            value: -27.246235066954423
          - type: nauc_mrr_at_1_diff1
            value: 15.084265144497373
          - type: nauc_mrr_at_1_max
            value: -16.312295398834625
          - type: nauc_mrr_at_1_std
            value: -27.686736137340894
          - type: nauc_mrr_at_20_diff1
            value: 12.600281810712003
          - type: nauc_mrr_at_20_max
            value: -14.649133303237166
          - type: nauc_mrr_at_20_std
            value: -27.350630544847004
          - type: nauc_mrr_at_3_diff1
            value: 13.081208137779557
          - type: nauc_mrr_at_3_max
            value: -13.91769455651833
          - type: nauc_mrr_at_3_std
            value: -27.42237181201488
          - type: nauc_mrr_at_5_diff1
            value: 12.697412153053486
          - type: nauc_mrr_at_5_max
            value: -14.046815225580204
          - type: nauc_mrr_at_5_std
            value: -26.69417403787157
          - type: nauc_ndcg_at_1000_diff1
            value: 13.984706619459738
          - type: nauc_ndcg_at_1000_max
            value: -13.48207980711916
          - type: nauc_ndcg_at_1000_std
            value: -27.16935912553381
          - type: nauc_ndcg_at_100_diff1
            value: 13.951491624929446
          - type: nauc_ndcg_at_100_max
            value: -13.483812067015261
          - type: nauc_ndcg_at_100_std
            value: -27.238639718923814
          - type: nauc_ndcg_at_10_diff1
            value: 13.16429886726646
          - type: nauc_ndcg_at_10_max
            value: -12.816570276390305
          - type: nauc_ndcg_at_10_std
            value: -27.13129457560619
          - type: nauc_ndcg_at_1_diff1
            value: 16.257792463128126
          - type: nauc_ndcg_at_1_max
            value: -16.164790771610072
          - type: nauc_ndcg_at_1_std
            value: -27.84021734986689
          - type: nauc_ndcg_at_20_diff1
            value: 13.767660163849325
          - type: nauc_ndcg_at_20_max
            value: -13.330392545127982
          - type: nauc_ndcg_at_20_std
            value: -27.655874185287637
          - type: nauc_ndcg_at_3_diff1
            value: 15.379454570465107
          - type: nauc_ndcg_at_3_max
            value: -10.682369832384417
          - type: nauc_ndcg_at_3_std
            value: -26.61546503103021
          - type: nauc_ndcg_at_5_diff1
            value: 13.857194107241847
          - type: nauc_ndcg_at_5_max
            value: -11.585582001386438
          - type: nauc_ndcg_at_5_std
            value: -25.60318972329879
          - type: nauc_precision_at_1000_diff1
            value: 25.196544697410012
          - type: nauc_precision_at_1000_max
            value: 20.85546049013785
          - type: nauc_precision_at_1000_std
            value: 56.11900085120013
          - type: nauc_precision_at_100_diff1
            value: 11.605921153386918
          - type: nauc_precision_at_100_max
            value: 14.521201087528956
          - type: nauc_precision_at_100_std
            value: 17.78762614096395
          - type: nauc_precision_at_10_diff1
            value: 2.9073450747110328
          - type: nauc_precision_at_10_max
            value: -1.7706065742373982
          - type: nauc_precision_at_10_std
            value: -25.127721917434958
          - type: nauc_precision_at_1_diff1
            value: 16.257792463128126
          - type: nauc_precision_at_1_max
            value: -16.164790771610072
          - type: nauc_precision_at_1_std
            value: -27.84021734986689
          - type: nauc_precision_at_20_diff1
            value: 4.945029151806525
          - type: nauc_precision_at_20_max
            value: 1.299254371223885
          - type: nauc_precision_at_20_std
            value: -42.34878406902393
          - type: nauc_precision_at_3_diff1
            value: 17.02535492673917
          - type: nauc_precision_at_3_max
            value: -3.160620615377462
          - type: nauc_precision_at_3_std
            value: -24.392959569235646
          - type: nauc_precision_at_5_diff1
            value: 12.283704585525927
          - type: nauc_precision_at_5_max
            value: -2.860819740357931
          - type: nauc_precision_at_5_std
            value: -19.497494992596568
          - type: nauc_recall_at_1000_diff1
            value: 25.196544697407973
          - type: nauc_recall_at_1000_max
            value: 20.855460490135933
          - type: nauc_recall_at_1000_std
            value: 56.119000851196496
          - type: nauc_recall_at_100_diff1
            value: 11.60592115338627
          - type: nauc_recall_at_100_max
            value: 14.5212010875248
          - type: nauc_recall_at_100_std
            value: 17.787626140957425
          - type: nauc_recall_at_10_diff1
            value: 2.9073450747112304
          - type: nauc_recall_at_10_max
            value: -1.7706065742371515
          - type: nauc_recall_at_10_std
            value: -25.12772191743481
          - type: nauc_recall_at_1_diff1
            value: 16.257792463128126
          - type: nauc_recall_at_1_max
            value: -16.164790771610072
          - type: nauc_recall_at_1_std
            value: -27.84021734986689
          - type: nauc_recall_at_20_diff1
            value: 4.9450291518064935
          - type: nauc_recall_at_20_max
            value: 1.2992543712237186
          - type: nauc_recall_at_20_std
            value: -42.34878406902303
          - type: nauc_recall_at_3_diff1
            value: 17.025354926739237
          - type: nauc_recall_at_3_max
            value: -3.1606206153775016
          - type: nauc_recall_at_3_std
            value: -24.39295956923558
          - type: nauc_recall_at_5_diff1
            value: 12.283704585525939
          - type: nauc_recall_at_5_max
            value: -2.8608197403578512
          - type: nauc_recall_at_5_std
            value: -19.497494992596575
          - type: ndcg_at_1
            value: 44.666
          - type: ndcg_at_10
            value: 68.277
          - type: ndcg_at_100
            value: 69.78
          - type: ndcg_at_1000
            value: 69.78999999999999
          - type: ndcg_at_20
            value: 69.464
          - type: ndcg_at_3
            value: 60.462
          - type: ndcg_at_5
            value: 64.651
          - type: precision_at_1
            value: 44.666
          - type: precision_at_10
            value: 9.339
          - type: precision_at_100
            value: 0.996
          - type: precision_at_1000
            value: 0.1
          - type: precision_at_20
            value: 4.897
          - type: precision_at_3
            value: 24.016000000000002
          - type: precision_at_5
            value: 16.458000000000002
          - type: recall_at_1
            value: 44.666
          - type: recall_at_10
            value: 93.38499999999999
          - type: recall_at_100
            value: 99.57300000000001
          - type: recall_at_1000
            value: 99.644
          - type: recall_at_20
            value: 97.937
          - type: recall_at_3
            value: 72.048
          - type: recall_at_5
            value: 82.28999999999999
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackAndroidRetrieval
          revision: f46a197baaae43b4f621051089b82a364682dfeb
          split: test
          type: mteb/cqadupstack-android
        metrics:
          - type: main_score
            value: 57.025000000000006
          - type: map_at_1
            value: 35.67
          - type: map_at_10
            value: 49.816
          - type: map_at_100
            value: 51.465
          - type: map_at_1000
            value: 51.559
          - type: map_at_20
            value: 50.843
          - type: map_at_3
            value: 45.462
          - type: map_at_5
            value: 47.789
          - type: mrr_at_1
            value: 44.77825464949928
          - type: mrr_at_10
            value: 55.787576356245886
          - type: mrr_at_100
            value: 56.4488799265231
          - type: mrr_at_1000
            value: 56.47353697784773
          - type: mrr_at_20
            value: 56.21107253216036
          - type: mrr_at_3
            value: 52.885073915116834
          - type: mrr_at_5
            value: 54.58035288507389
          - type: nauc_map_at_1000_diff1
            value: 50.45823101819382
          - type: nauc_map_at_1000_max
            value: 36.49053295534483
          - type: nauc_map_at_1000_std
            value: -18.526304321886187
          - type: nauc_map_at_100_diff1
            value: 50.4260834410578
          - type: nauc_map_at_100_max
            value: 36.5085073099934
          - type: nauc_map_at_100_std
            value: -18.46644794935817
          - type: nauc_map_at_10_diff1
            value: 50.89883450942742
          - type: nauc_map_at_10_max
            value: 36.04067774200049
          - type: nauc_map_at_10_std
            value: -20.056347095828695
          - type: nauc_map_at_1_diff1
            value: 56.834567406767775
          - type: nauc_map_at_1_max
            value: 32.806861016490686
          - type: nauc_map_at_1_std
            value: -17.50758527738866
          - type: nauc_map_at_20_diff1
            value: 50.5042164434519
          - type: nauc_map_at_20_max
            value: 36.50186920758872
          - type: nauc_map_at_20_std
            value: -18.739559098645316
          - type: nauc_map_at_3_diff1
            value: 51.47192911647498
          - type: nauc_map_at_3_max
            value: 35.30704707609017
          - type: nauc_map_at_3_std
            value: -20.29632792705977
          - type: nauc_map_at_5_diff1
            value: 51.12306422908822
          - type: nauc_map_at_5_max
            value: 35.89975376917192
          - type: nauc_map_at_5_std
            value: -19.828384476366086
          - type: nauc_mrr_at_1000_diff1
            value: 48.849919708933356
          - type: nauc_mrr_at_1000_max
            value: 37.551368642516984
          - type: nauc_mrr_at_1000_std
            value: -17.829333495571873
          - type: nauc_mrr_at_100_diff1
            value: 48.84124005822968
          - type: nauc_mrr_at_100_max
            value: 37.55507214788527
          - type: nauc_mrr_at_100_std
            value: -17.829902708031735
          - type: nauc_mrr_at_10_diff1
            value: 48.75998469903627
          - type: nauc_mrr_at_10_max
            value: 37.38578492482243
          - type: nauc_mrr_at_10_std
            value: -18.49027309110136
          - type: nauc_mrr_at_1_diff1
            value: 52.82147548271261
          - type: nauc_mrr_at_1_max
            value: 38.52107406488729
          - type: nauc_mrr_at_1_std
            value: -15.557810119211657
          - type: nauc_mrr_at_20_diff1
            value: 48.786516207985585
          - type: nauc_mrr_at_20_max
            value: 37.53134866494839
          - type: nauc_mrr_at_20_std
            value: -17.78055242023104
          - type: nauc_mrr_at_3_diff1
            value: 48.72848733815437
          - type: nauc_mrr_at_3_max
            value: 37.62564116429598
          - type: nauc_mrr_at_3_std
            value: -18.63098278761354
          - type: nauc_mrr_at_5_diff1
            value: 48.67198763487669
          - type: nauc_mrr_at_5_max
            value: 37.46200111234106
          - type: nauc_mrr_at_5_std
            value: -18.592288612712576
          - type: nauc_ndcg_at_1000_diff1
            value: 48.75201809702225
          - type: nauc_ndcg_at_1000_max
            value: 37.04967809462886
          - type: nauc_ndcg_at_1000_std
            value: -16.948540945875216
          - type: nauc_ndcg_at_100_diff1
            value: 48.213857924243804
          - type: nauc_ndcg_at_100_max
            value: 36.99860703887876
          - type: nauc_ndcg_at_100_std
            value: -16.420746045271017
          - type: nauc_ndcg_at_10_diff1
            value: 48.7590345342662
          - type: nauc_ndcg_at_10_max
            value: 36.087304891668495
          - type: nauc_ndcg_at_10_std
            value: -20.677784655001727
          - type: nauc_ndcg_at_1_diff1
            value: 52.82147548271261
          - type: nauc_ndcg_at_1_max
            value: 38.52107406488729
          - type: nauc_ndcg_at_1_std
            value: -15.557810119211657
          - type: nauc_ndcg_at_20_diff1
            value: 48.119759046742004
          - type: nauc_ndcg_at_20_max
            value: 36.91858601052183
          - type: nauc_ndcg_at_20_std
            value: -17.315588991460316
          - type: nauc_ndcg_at_3_diff1
            value: 48.35879771694856
          - type: nauc_ndcg_at_3_max
            value: 36.59333419427929
          - type: nauc_ndcg_at_3_std
            value: -19.646763729930917
          - type: nauc_ndcg_at_5_diff1
            value: 48.73702053100838
          - type: nauc_ndcg_at_5_max
            value: 36.2032422359128
          - type: nauc_ndcg_at_5_std
            value: -19.81761218645642
          - type: nauc_precision_at_1000_diff1
            value: -19.23879401783259
          - type: nauc_precision_at_1000_max
            value: -10.334669548312661
          - type: nauc_precision_at_1000_std
            value: 1.8528999887213935
          - type: nauc_precision_at_100_diff1
            value: -17.061064047641576
          - type: nauc_precision_at_100_max
            value: -2.2318557604173557
          - type: nauc_precision_at_100_std
            value: 9.453864069155783
          - type: nauc_precision_at_10_diff1
            value: -0.0250981142012463
          - type: nauc_precision_at_10_max
            value: 15.000297351883034
          - type: nauc_precision_at_10_std
            value: -1.6209044879293661
          - type: nauc_precision_at_1_diff1
            value: 52.82147548271261
          - type: nauc_precision_at_1_max
            value: 38.52107406488729
          - type: nauc_precision_at_1_std
            value: -15.557810119211657
          - type: nauc_precision_at_20_diff1
            value: -9.566950286920978
          - type: nauc_precision_at_20_max
            value: 9.865702753901365
          - type: nauc_precision_at_20_std
            value: 8.87854086185741
          - type: nauc_precision_at_3_diff1
            value: 19.978926078471915
          - type: nauc_precision_at_3_max
            value: 29.135402513527524
          - type: nauc_precision_at_3_std
            value: -12.410877361712942
          - type: nauc_precision_at_5_diff1
            value: 11.602459698883452
          - type: nauc_precision_at_5_max
            value: 24.44724344216036
          - type: nauc_precision_at_5_std
            value: -6.23012846505485
          - type: nauc_recall_at_1000_diff1
            value: 30.5620107082901
          - type: nauc_recall_at_1000_max
            value: 57.90393858174957
          - type: nauc_recall_at_1000_std
            value: 50.27827169570347
          - type: nauc_recall_at_100_diff1
            value: 30.37443399479563
          - type: nauc_recall_at_100_max
            value: 37.75874353752331
          - type: nauc_recall_at_100_std
            value: 10.331635217724585
          - type: nauc_recall_at_10_diff1
            value: 42.50804834678793
          - type: nauc_recall_at_10_max
            value: 32.01676571227172
          - type: nauc_recall_at_10_std
            value: -24.707266416874376
          - type: nauc_recall_at_1_diff1
            value: 56.834567406767775
          - type: nauc_recall_at_1_max
            value: 32.806861016490686
          - type: nauc_recall_at_1_std
            value: -17.50758527738866
          - type: nauc_recall_at_20_diff1
            value: 38.7222771840029
          - type: nauc_recall_at_20_max
            value: 35.62991559107865
          - type: nauc_recall_at_20_std
            value: -8.672399835082256
          - type: nauc_recall_at_3_diff1
            value: 44.63989156943874
          - type: nauc_recall_at_3_max
            value: 32.924250725683954
          - type: nauc_recall_at_3_std
            value: -22.031517542434386
          - type: nauc_recall_at_5_diff1
            value: 43.52398344993421
          - type: nauc_recall_at_5_max
            value: 32.68140834172185
          - type: nauc_recall_at_5_std
            value: -22.07867437121263
          - type: ndcg_at_1
            value: 44.778
          - type: ndcg_at_10
            value: 57.025000000000006
          - type: ndcg_at_100
            value: 62.007
          - type: ndcg_at_1000
            value: 63.11
          - type: ndcg_at_20
            value: 59.301
          - type: ndcg_at_3
            value: 51.162
          - type: ndcg_at_5
            value: 53.684
          - type: precision_at_1
            value: 44.778
          - type: precision_at_10
            value: 11.173
          - type: precision_at_100
            value: 1.7080000000000002
          - type: precision_at_1000
            value: 0.20600000000000002
          - type: precision_at_20
            value: 6.651999999999999
          - type: precision_at_3
            value: 25.130999999999997
          - type: precision_at_5
            value: 18.026
          - type: recall_at_1
            value: 35.67
          - type: recall_at_10
            value: 71.006
          - type: recall_at_100
            value: 91.24
          - type: recall_at_1000
            value: 97.68599999999999
          - type: recall_at_20
            value: 78.869
          - type: recall_at_3
            value: 53.616
          - type: recall_at_5
            value: 61.046
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackEnglishRetrieval
          revision: ad9991cb51e31e31e430383c75ffb2885547b5f0
          split: test
          type: mteb/cqadupstack-english
        metrics:
          - type: main_score
            value: 56.93
          - type: map_at_1
            value: 37.869
          - type: map_at_10
            value: 50.651999999999994
          - type: map_at_100
            value: 52.099
          - type: map_at_1000
            value: 52.229000000000006
          - type: map_at_20
            value: 51.471000000000004
          - type: map_at_3
            value: 46.900999999999996
          - type: map_at_5
            value: 49.163000000000004
          - type: mrr_at_1
            value: 48.152866242038215
          - type: mrr_at_10
            value: 57.048781720756324
          - type: mrr_at_100
            value: 57.61447046748723
          - type: mrr_at_1000
            value: 57.64904742638159
          - type: mrr_at_20
            value: 57.39780918212383
          - type: mrr_at_3
            value: 54.80891719745229
          - type: mrr_at_5
            value: 56.28343949044594
          - type: nauc_map_at_1000_diff1
            value: 58.85279432139136
          - type: nauc_map_at_1000_max
            value: 44.27751637558559
          - type: nauc_map_at_1000_std
            value: -15.750083199667806
          - type: nauc_map_at_100_diff1
            value: 58.86033676691407
          - type: nauc_map_at_100_max
            value: 44.19456055171921
          - type: nauc_map_at_100_std
            value: -15.866235670948466
          - type: nauc_map_at_10_diff1
            value: 59.15850189168124
          - type: nauc_map_at_10_max
            value: 43.11472836391707
          - type: nauc_map_at_10_std
            value: -17.744478993375527
          - type: nauc_map_at_1_diff1
            value: 64.04942461321761
          - type: nauc_map_at_1_max
            value: 36.02760504360551
          - type: nauc_map_at_1_std
            value: -20.916663614576407
          - type: nauc_map_at_20_diff1
            value: 58.98751913649348
          - type: nauc_map_at_20_max
            value: 43.747358339703325
          - type: nauc_map_at_20_std
            value: -16.73926017048612
          - type: nauc_map_at_3_diff1
            value: 60.545139674280094
          - type: nauc_map_at_3_max
            value: 41.30484092754499
          - type: nauc_map_at_3_std
            value: -20.449249818528614
          - type: nauc_map_at_5_diff1
            value: 59.60326322666997
          - type: nauc_map_at_5_max
            value: 42.108701221797
          - type: nauc_map_at_5_std
            value: -18.957986608087435
          - type: nauc_mrr_at_1000_diff1
            value: 56.30127401697153
          - type: nauc_mrr_at_1000_max
            value: 47.08483234515321
          - type: nauc_mrr_at_1000_std
            value: -10.314335018294779
          - type: nauc_mrr_at_100_diff1
            value: 56.28727998516319
          - type: nauc_mrr_at_100_max
            value: 47.08137119553827
          - type: nauc_mrr_at_100_std
            value: -10.295734439040498
          - type: nauc_mrr_at_10_diff1
            value: 56.25229630851168
          - type: nauc_mrr_at_10_max
            value: 47.149329681676
          - type: nauc_mrr_at_10_std
            value: -10.598837356654567
          - type: nauc_mrr_at_1_diff1
            value: 59.098651501966394
          - type: nauc_mrr_at_1_max
            value: 46.60615627466452
          - type: nauc_mrr_at_1_std
            value: -10.475650807142516
          - type: nauc_mrr_at_20_diff1
            value: 56.2453798649222
          - type: nauc_mrr_at_20_max
            value: 47.09346599217677
          - type: nauc_mrr_at_20_std
            value: -10.386425082322834
          - type: nauc_mrr_at_3_diff1
            value: 56.75733035936052
          - type: nauc_mrr_at_3_max
            value: 46.94088551304416
          - type: nauc_mrr_at_3_std
            value: -11.483866905681051
          - type: nauc_mrr_at_5_diff1
            value: 56.40006056789708
          - type: nauc_mrr_at_5_max
            value: 46.808130364381846
          - type: nauc_mrr_at_5_std
            value: -11.050122560712222
          - type: nauc_ndcg_at_1000_diff1
            value: 56.60974899528984
          - type: nauc_ndcg_at_1000_max
            value: 46.20688890501171
          - type: nauc_ndcg_at_1000_std
            value: -11.14222381973439
          - type: nauc_ndcg_at_100_diff1
            value: 56.677945515470675
          - type: nauc_ndcg_at_100_max
            value: 46.001596072553404
          - type: nauc_ndcg_at_100_std
            value: -11.229044974791337
          - type: nauc_ndcg_at_10_diff1
            value: 57.1066442501231
          - type: nauc_ndcg_at_10_max
            value: 45.542982262967776
          - type: nauc_ndcg_at_10_std
            value: -14.273638238311195
          - type: nauc_ndcg_at_1_diff1
            value: 59.098651501966394
          - type: nauc_ndcg_at_1_max
            value: 46.60615627466452
          - type: nauc_ndcg_at_1_std
            value: -10.475650807142516
          - type: nauc_ndcg_at_20_diff1
            value: 56.851307181340694
          - type: nauc_ndcg_at_20_max
            value: 45.84417755460993
          - type: nauc_ndcg_at_20_std
            value: -12.926633494308371
          - type: nauc_ndcg_at_3_diff1
            value: 57.423753276241754
          - type: nauc_ndcg_at_3_max
            value: 45.1658528352273
          - type: nauc_ndcg_at_3_std
            value: -15.041500407672178
          - type: nauc_ndcg_at_5_diff1
            value: 57.366735747016584
          - type: nauc_ndcg_at_5_max
            value: 44.754486357586316
          - type: nauc_ndcg_at_5_std
            value: -15.100632526050441
          - type: nauc_precision_at_1000_diff1
            value: -23.32973690238293
          - type: nauc_precision_at_1000_max
            value: 9.122165441089374
          - type: nauc_precision_at_1000_std
            value: 32.082444098667565
          - type: nauc_precision_at_100_diff1
            value: -16.218615616263428
          - type: nauc_precision_at_100_max
            value: 19.44437302773441
          - type: nauc_precision_at_100_std
            value: 35.248811470691166
          - type: nauc_precision_at_10_diff1
            value: 1.0766468144861965
          - type: nauc_precision_at_10_max
            value: 30.491892916282236
          - type: nauc_precision_at_10_std
            value: 18.538876410079585
          - type: nauc_precision_at_1_diff1
            value: 59.098651501966394
          - type: nauc_precision_at_1_max
            value: 46.60615627466452
          - type: nauc_precision_at_1_std
            value: -10.475650807142516
          - type: nauc_precision_at_20_diff1
            value: -6.769874545877082
          - type: nauc_precision_at_20_max
            value: 26.352774891191004
          - type: nauc_precision_at_20_std
            value: 26.150734923942952
          - type: nauc_precision_at_3_diff1
            value: 23.74601942735032
          - type: nauc_precision_at_3_max
            value: 39.71043044078846
          - type: nauc_precision_at_3_std
            value: 3.161463247727185
          - type: nauc_precision_at_5_diff1
            value: 11.589849872978208
          - type: nauc_precision_at_5_max
            value: 34.355473407777296
          - type: nauc_precision_at_5_std
            value: 10.0662074493734
          - type: nauc_recall_at_1000_diff1
            value: 44.20612579552725
          - type: nauc_recall_at_1000_max
            value: 54.50563586814392
          - type: nauc_recall_at_1000_std
            value: 29.37098358130919
          - type: nauc_recall_at_100_diff1
            value: 46.991905821496225
          - type: nauc_recall_at_100_max
            value: 45.677355517440446
          - type: nauc_recall_at_100_std
            value: 8.193115293674246
          - type: nauc_recall_at_10_diff1
            value: 51.021956806545575
          - type: nauc_recall_at_10_max
            value: 42.39780880270869
          - type: nauc_recall_at_10_std
            value: -14.372872090525025
          - type: nauc_recall_at_1_diff1
            value: 64.04942461321761
          - type: nauc_recall_at_1_max
            value: 36.02760504360551
          - type: nauc_recall_at_1_std
            value: -20.916663614576407
          - type: nauc_recall_at_20_diff1
            value: 49.330317036362736
          - type: nauc_recall_at_20_max
            value: 43.82370541895915
          - type: nauc_recall_at_20_std
            value: -7.676142813819095
          - type: nauc_recall_at_3_diff1
            value: 56.15563158128648
          - type: nauc_recall_at_3_max
            value: 39.776800175069496
          - type: nauc_recall_at_3_std
            value: -21.67535047518367
          - type: nauc_recall_at_5_diff1
            value: 53.55725212243435
          - type: nauc_recall_at_5_max
            value: 39.639229625237746
          - type: nauc_recall_at_5_std
            value: -18.537472489671433
          - type: ndcg_at_1
            value: 48.153
          - type: ndcg_at_10
            value: 56.93
          - type: ndcg_at_100
            value: 61.041999999999994
          - type: ndcg_at_1000
            value: 62.71600000000001
          - type: ndcg_at_20
            value: 58.626999999999995
          - type: ndcg_at_3
            value: 52.437999999999995
          - type: ndcg_at_5
            value: 54.774
          - type: precision_at_1
            value: 48.153
          - type: precision_at_10
            value: 10.93
          - type: precision_at_100
            value: 1.669
          - type: precision_at_1000
            value: 0.213
          - type: precision_at_20
            value: 6.382000000000001
          - type: precision_at_3
            value: 25.796000000000003
          - type: precision_at_5
            value: 18.407999999999998
          - type: recall_at_1
            value: 37.869
          - type: recall_at_10
            value: 67.514
          - type: recall_at_100
            value: 84.454
          - type: recall_at_1000
            value: 94.356
          - type: recall_at_20
            value: 73.558
          - type: recall_at_3
            value: 53.559
          - type: recall_at_5
            value: 60.475
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackGamingRetrieval
          revision: 4885aa143210c98657558c04aaf3dc47cfb54340
          split: test
          type: mteb/cqadupstack-gaming
        metrics:
          - type: main_score
            value: 67.253
          - type: map_at_1
            value: 46.905
          - type: map_at_10
            value: 61.332
          - type: map_at_100
            value: 62.304
          - type: map_at_1000
            value: 62.334
          - type: map_at_20
            value: 61.964
          - type: map_at_3
            value: 58.042
          - type: map_at_5
            value: 59.882000000000005
          - type: mrr_at_1
            value: 53.47962382445141
          - type: mrr_at_10
            value: 64.39956212370015
          - type: mrr_at_100
            value: 64.95557189125634
          - type: mrr_at_1000
            value: 64.96848596592983
          - type: mrr_at_20
            value: 64.77428822572568
          - type: mrr_at_3
            value: 62.309299895506896
          - type: mrr_at_5
            value: 63.54440961337527
          - type: nauc_map_at_1000_diff1
            value: 56.74686837364893
          - type: nauc_map_at_1000_max
            value: 37.37480368876817
          - type: nauc_map_at_1000_std
            value: -10.049421617657124
          - type: nauc_map_at_100_diff1
            value: 56.72313143831275
          - type: nauc_map_at_100_max
            value: 37.35797555204418
          - type: nauc_map_at_100_std
            value: -10.049812301974452
          - type: nauc_map_at_10_diff1
            value: 56.68397120600094
          - type: nauc_map_at_10_max
            value: 36.59842978269273
          - type: nauc_map_at_10_std
            value: -11.174804244499098
          - type: nauc_map_at_1_diff1
            value: 61.94214953873164
          - type: nauc_map_at_1_max
            value: 28.119092174242382
          - type: nauc_map_at_1_std
            value: -14.419629681905278
          - type: nauc_map_at_20_diff1
            value: 56.66822667045707
          - type: nauc_map_at_20_max
            value: 37.19179210659321
          - type: nauc_map_at_20_std
            value: -10.36424574922098
          - type: nauc_map_at_3_diff1
            value: 56.786004222951966
          - type: nauc_map_at_3_max
            value: 34.409125163057354
          - type: nauc_map_at_3_std
            value: -12.308681065089702
          - type: nauc_map_at_5_diff1
            value: 56.837122717249855
          - type: nauc_map_at_5_max
            value: 35.70069180549282
          - type: nauc_map_at_5_std
            value: -12.19154238352126
          - type: nauc_mrr_at_1000_diff1
            value: 57.03608286201278
          - type: nauc_mrr_at_1000_max
            value: 39.15777651816965
          - type: nauc_mrr_at_1000_std
            value: -8.45524348928121
          - type: nauc_mrr_at_100_diff1
            value: 57.03051889095766
          - type: nauc_mrr_at_100_max
            value: 39.168900323859
          - type: nauc_mrr_at_100_std
            value: -8.439862972545644
          - type: nauc_mrr_at_10_diff1
            value: 56.848642658414775
          - type: nauc_mrr_at_10_max
            value: 39.11801407771557
          - type: nauc_mrr_at_10_std
            value: -8.678625365653245
          - type: nauc_mrr_at_1_diff1
            value: 61.1124527741601
          - type: nauc_mrr_at_1_max
            value: 36.080048505155865
          - type: nauc_mrr_at_1_std
            value: -10.584194474752584
          - type: nauc_mrr_at_20_diff1
            value: 56.878714270983146
          - type: nauc_mrr_at_20_max
            value: 39.16569382719707
          - type: nauc_mrr_at_20_std
            value: -8.447245465078893
          - type: nauc_mrr_at_3_diff1
            value: 56.87172734333986
          - type: nauc_mrr_at_3_max
            value: 39.07882270376788
          - type: nauc_mrr_at_3_std
            value: -9.069457598400062
          - type: nauc_mrr_at_5_diff1
            value: 56.82487051170517
          - type: nauc_mrr_at_5_max
            value: 39.030878651662796
          - type: nauc_mrr_at_5_std
            value: -9.076518259406917
          - type: nauc_ndcg_at_1000_diff1
            value: 56.082240909091695
          - type: nauc_ndcg_at_1000_max
            value: 39.699264232007025
          - type: nauc_ndcg_at_1000_std
            value: -7.502941002933741
          - type: nauc_ndcg_at_100_diff1
            value: 55.887513398861955
          - type: nauc_ndcg_at_100_max
            value: 39.847450141736395
          - type: nauc_ndcg_at_100_std
            value: -7.146894645593031
          - type: nauc_ndcg_at_10_diff1
            value: 55.15467572394677
          - type: nauc_ndcg_at_10_max
            value: 38.97265748975791
          - type: nauc_ndcg_at_10_std
            value: -9.4670794339538
          - type: nauc_ndcg_at_1_diff1
            value: 61.1124527741601
          - type: nauc_ndcg_at_1_max
            value: 36.080048505155865
          - type: nauc_ndcg_at_1_std
            value: -10.584194474752584
          - type: nauc_ndcg_at_20_diff1
            value: 55.15513104937557
          - type: nauc_ndcg_at_20_max
            value: 39.66296704562037
          - type: nauc_ndcg_at_20_std
            value: -7.847800655967109
          - type: nauc_ndcg_at_3_diff1
            value: 54.96185776120714
          - type: nauc_ndcg_at_3_max
            value: 37.00790660301803
          - type: nauc_ndcg_at_3_std
            value: -10.547349631779593
          - type: nauc_ndcg_at_5_diff1
            value: 55.292986134183764
          - type: nauc_ndcg_at_5_max
            value: 38.12541620211435
          - type: nauc_ndcg_at_5_std
            value: -10.961954651898877
          - type: nauc_precision_at_1000_diff1
            value: -17.737775083152922
          - type: nauc_precision_at_1000_max
            value: 21.575992446429407
          - type: nauc_precision_at_1000_std
            value: 30.76555260404715
          - type: nauc_precision_at_100_diff1
            value: -17.3761536797116
          - type: nauc_precision_at_100_max
            value: 23.455151994000513
          - type: nauc_precision_at_100_std
            value: 30.66476060812044
          - type: nauc_precision_at_10_diff1
            value: 0.37712699076668355
          - type: nauc_precision_at_10_max
            value: 31.298133911984248
          - type: nauc_precision_at_10_std
            value: 16.134374567323214
          - type: nauc_precision_at_1_diff1
            value: 61.1124527741601
          - type: nauc_precision_at_1_max
            value: 36.080048505155865
          - type: nauc_precision_at_1_std
            value: -10.584194474752584
          - type: nauc_precision_at_20_diff1
            value: -7.697609516072893
          - type: nauc_precision_at_20_max
            value: 30.392978129152638
          - type: nauc_precision_at_20_std
            value: 25.297979676649902
          - type: nauc_precision_at_3_diff1
            value: 21.920115701694172
          - type: nauc_precision_at_3_max
            value: 35.916002988740644
          - type: nauc_precision_at_3_std
            value: 3.192816307982428
          - type: nauc_precision_at_5_diff1
            value: 12.416994377124743
          - type: nauc_precision_at_5_max
            value: 34.60793433800759
          - type: nauc_precision_at_5_std
            value: 7.681539417199799
          - type: nauc_recall_at_1000_diff1
            value: 45.05841406616179
          - type: nauc_recall_at_1000_max
            value: 84.01729859779441
          - type: nauc_recall_at_1000_std
            value: 70.81952441677544
          - type: nauc_recall_at_100_diff1
            value: 47.82912442332592
          - type: nauc_recall_at_100_max
            value: 61.538854248032905
          - type: nauc_recall_at_100_std
            value: 31.507749555394742
          - type: nauc_recall_at_10_diff1
            value: 46.23707108341979
          - type: nauc_recall_at_10_max
            value: 40.14549188124033
          - type: nauc_recall_at_10_std
            value: -8.418378388855976
          - type: nauc_recall_at_1_diff1
            value: 61.94214953873164
          - type: nauc_recall_at_1_max
            value: 28.119092174242382
          - type: nauc_recall_at_1_std
            value: -14.419629681905278
          - type: nauc_recall_at_20_diff1
            value: 43.5874302201068
          - type: nauc_recall_at_20_max
            value: 46.94504592203577
          - type: nauc_recall_at_20_std
            value: 3.913410811827146
          - type: nauc_recall_at_3_diff1
            value: 49.63064701945406
          - type: nauc_recall_at_3_max
            value: 35.29572226414386
          - type: nauc_recall_at_3_std
            value: -12.297827741460027
          - type: nauc_recall_at_5_diff1
            value: 48.601651302714224
          - type: nauc_recall_at_5_max
            value: 37.38710560640659
          - type: nauc_recall_at_5_std
            value: -13.458409202400507
          - type: ndcg_at_1
            value: 53.480000000000004
          - type: ndcg_at_10
            value: 67.253
          - type: ndcg_at_100
            value: 70.648
          - type: ndcg_at_1000
            value: 71.139
          - type: ndcg_at_20
            value: 68.905
          - type: ndcg_at_3
            value: 62.178
          - type: ndcg_at_5
            value: 64.64800000000001
          - type: precision_at_1
            value: 53.480000000000004
          - type: precision_at_10
            value: 10.696
          - type: precision_at_100
            value: 1.325
          - type: precision_at_1000
            value: 0.13899999999999998
          - type: precision_at_20
            value: 5.884
          - type: precision_at_3
            value: 27.794999999999998
          - type: precision_at_5
            value: 18.708
          - type: recall_at_1
            value: 46.905
          - type: recall_at_10
            value: 81.234
          - type: recall_at_100
            value: 95.489
          - type: recall_at_1000
            value: 98.729
          - type: recall_at_20
            value: 87.29400000000001
          - type: recall_at_3
            value: 67.869
          - type: recall_at_5
            value: 73.896
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackGisRetrieval
          revision: 5003b3064772da1887988e05400cf3806fe491f2
          split: test
          type: mteb/cqadupstack-gis
        metrics:
          - type: main_score
            value: 46.397
          - type: map_at_1
            value: 30.613
          - type: map_at_10
            value: 40.581
          - type: map_at_100
            value: 41.660000000000004
          - type: map_at_1000
            value: 41.721000000000004
          - type: map_at_20
            value: 41.211999999999996
          - type: map_at_3
            value: 37.32
          - type: map_at_5
            value: 39.114
          - type: mrr_at_1
            value: 33.220338983050844
          - type: mrr_at_10
            value: 42.83718948973182
          - type: mrr_at_100
            value: 43.71836325492362
          - type: mrr_at_1000
            value: 43.76175841571598
          - type: mrr_at_20
            value: 43.384811953015166
          - type: mrr_at_3
            value: 39.830508474576256
          - type: mrr_at_5
            value: 41.54802259887001
          - type: nauc_map_at_1000_diff1
            value: 42.6225958477453
          - type: nauc_map_at_1000_max
            value: 28.013356866974238
          - type: nauc_map_at_1000_std
            value: -9.409667321411026
          - type: nauc_map_at_100_diff1
            value: 42.610412175224766
          - type: nauc_map_at_100_max
            value: 28.002610966435736
          - type: nauc_map_at_100_std
            value: -9.411570910136719
          - type: nauc_map_at_10_diff1
            value: 42.63151134672704
          - type: nauc_map_at_10_max
            value: 28.001496131016022
          - type: nauc_map_at_10_std
            value: -9.67772644457909
          - type: nauc_map_at_1_diff1
            value: 46.31023790327735
          - type: nauc_map_at_1_max
            value: 24.2900776546879
          - type: nauc_map_at_1_std
            value: -11.905089868017578
          - type: nauc_map_at_20_diff1
            value: 42.6522287088466
          - type: nauc_map_at_20_max
            value: 27.975313282087043
          - type: nauc_map_at_20_std
            value: -9.550553164224084
          - type: nauc_map_at_3_diff1
            value: 43.272779420270226
          - type: nauc_map_at_3_max
            value: 26.92288244998244
          - type: nauc_map_at_3_std
            value: -10.575038389958834
          - type: nauc_map_at_5_diff1
            value: 42.58131102442881
          - type: nauc_map_at_5_max
            value: 27.04453513629861
          - type: nauc_map_at_5_std
            value: -10.317573458025175
          - type: nauc_mrr_at_1000_diff1
            value: 41.126210961719636
          - type: nauc_mrr_at_1000_max
            value: 28.513261505932054
          - type: nauc_mrr_at_1000_std
            value: -8.546982260677629
          - type: nauc_mrr_at_100_diff1
            value: 41.110923675787234
          - type: nauc_mrr_at_100_max
            value: 28.52042510810816
          - type: nauc_mrr_at_100_std
            value: -8.534554512496843
          - type: nauc_mrr_at_10_diff1
            value: 41.07534061242193
          - type: nauc_mrr_at_10_max
            value: 28.44682429205697
          - type: nauc_mrr_at_10_std
            value: -8.6819795408583
          - type: nauc_mrr_at_1_diff1
            value: 44.40023434506226
          - type: nauc_mrr_at_1_max
            value: 25.9478208158475
          - type: nauc_mrr_at_1_std
            value: -10.872665260136657
          - type: nauc_mrr_at_20_diff1
            value: 41.146798233387074
          - type: nauc_mrr_at_20_max
            value: 28.517336935279054
          - type: nauc_mrr_at_20_std
            value: -8.580094403841978
          - type: nauc_mrr_at_3_diff1
            value: 41.60309522639159
          - type: nauc_mrr_at_3_max
            value: 28.379418612638734
          - type: nauc_mrr_at_3_std
            value: -9.263458517583244
          - type: nauc_mrr_at_5_diff1
            value: 40.99565866982568
          - type: nauc_mrr_at_5_max
            value: 27.90866498875212
          - type: nauc_mrr_at_5_std
            value: -8.941725041767588
          - type: nauc_ndcg_at_1000_diff1
            value: 41.11051620257291
          - type: nauc_ndcg_at_1000_max
            value: 29.70811129532719
          - type: nauc_ndcg_at_1000_std
            value: -7.127215646258767
          - type: nauc_ndcg_at_100_diff1
            value: 40.63555558695194
          - type: nauc_ndcg_at_100_max
            value: 29.701486964402413
          - type: nauc_ndcg_at_100_std
            value: -6.577078704400861
          - type: nauc_ndcg_at_10_diff1
            value: 40.87142841339465
          - type: nauc_ndcg_at_10_max
            value: 29.704589449676533
          - type: nauc_ndcg_at_10_std
            value: -7.674397553684968
          - type: nauc_ndcg_at_1_diff1
            value: 44.40023434506226
          - type: nauc_ndcg_at_1_max
            value: 25.9478208158475
          - type: nauc_ndcg_at_1_std
            value: -10.872665260136657
          - type: nauc_ndcg_at_20_diff1
            value: 41.06323938303467
          - type: nauc_ndcg_at_20_max
            value: 29.883715521818203
          - type: nauc_ndcg_at_20_std
            value: -7.155761930055846
          - type: nauc_ndcg_at_3_diff1
            value: 41.935479029537156
          - type: nauc_ndcg_at_3_max
            value: 28.171952324901135
          - type: nauc_ndcg_at_3_std
            value: -9.737703474161384
          - type: nauc_ndcg_at_5_diff1
            value: 40.69403623214395
          - type: nauc_ndcg_at_5_max
            value: 27.702311421182756
          - type: nauc_ndcg_at_5_std
            value: -9.060968201824112
          - type: nauc_precision_at_1000_diff1
            value: -8.885096064850758
          - type: nauc_precision_at_1000_max
            value: 14.053447868468186
          - type: nauc_precision_at_1000_std
            value: 12.07987711511724
          - type: nauc_precision_at_100_diff1
            value: 2.3188506683364287
          - type: nauc_precision_at_100_max
            value: 22.080025207013655
          - type: nauc_precision_at_100_std
            value: 14.172840329817307
          - type: nauc_precision_at_10_diff1
            value: 24.9332547479345
          - type: nauc_precision_at_10_max
            value: 34.6422733091986
          - type: nauc_precision_at_10_std
            value: 1.9970789498947206
          - type: nauc_precision_at_1_diff1
            value: 44.40023434506226
          - type: nauc_precision_at_1_max
            value: 25.9478208158475
          - type: nauc_precision_at_1_std
            value: -10.872665260136657
          - type: nauc_precision_at_20_diff1
            value: 20.640050910422755
          - type: nauc_precision_at_20_max
            value: 32.260405497760615
          - type: nauc_precision_at_20_std
            value: 6.854997919374335
          - type: nauc_precision_at_3_diff1
            value: 33.29459667683485
          - type: nauc_precision_at_3_max
            value: 32.151627242504325
          - type: nauc_precision_at_3_std
            value: -5.8202369823669855
          - type: nauc_precision_at_5_diff1
            value: 28.763772683866794
          - type: nauc_precision_at_5_max
            value: 31.392059038257553
          - type: nauc_precision_at_5_std
            value: -3.9737244392531172
          - type: nauc_recall_at_1000_diff1
            value: 26.491178998164894
          - type: nauc_recall_at_1000_max
            value: 53.78324098258691
          - type: nauc_recall_at_1000_std
            value: 22.795807409776284
          - type: nauc_recall_at_100_diff1
            value: 27.100846383184855
          - type: nauc_recall_at_100_max
            value: 36.26211685620019
          - type: nauc_recall_at_100_std
            value: 12.001840836651729
          - type: nauc_recall_at_10_diff1
            value: 35.281252536584226
          - type: nauc_recall_at_10_max
            value: 34.13064097658273
          - type: nauc_recall_at_10_std
            value: -1.238221844846595
          - type: nauc_recall_at_1_diff1
            value: 46.31023790327735
          - type: nauc_recall_at_1_max
            value: 24.2900776546879
          - type: nauc_recall_at_1_std
            value: -11.905089868017578
          - type: nauc_recall_at_20_diff1
            value: 35.29612485423622
          - type: nauc_recall_at_20_max
            value: 36.059880890712606
          - type: nauc_recall_at_20_std
            value: 2.0708009945980916
          - type: nauc_recall_at_3_diff1
            value: 39.33916378398866
          - type: nauc_recall_at_3_max
            value: 28.825178871677544
          - type: nauc_recall_at_3_std
            value: -8.391711028859733
          - type: nauc_recall_at_5_diff1
            value: 35.394135184248086
          - type: nauc_recall_at_5_max
            value: 27.370010171655295
          - type: nauc_recall_at_5_std
            value: -6.342877659046013
          - type: ndcg_at_1
            value: 33.22
          - type: ndcg_at_10
            value: 46.397
          - type: ndcg_at_100
            value: 51.510999999999996
          - type: ndcg_at_1000
            value: 52.941
          - type: ndcg_at_20
            value: 48.614000000000004
          - type: ndcg_at_3
            value: 40.066
          - type: ndcg_at_5
            value: 43.086
          - type: precision_at_1
            value: 33.22
          - type: precision_at_10
            value: 7.153
          - type: precision_at_100
            value: 1.028
          - type: precision_at_1000
            value: 0.11800000000000001
          - type: precision_at_20
            value: 4.1129999999999995
          - type: precision_at_3
            value: 16.949
          - type: precision_at_5
            value: 11.932
          - type: recall_at_1
            value: 30.613
          - type: recall_at_10
            value: 62.248000000000005
          - type: recall_at_100
            value: 85.311
          - type: recall_at_1000
            value: 95.88799999999999
          - type: recall_at_20
            value: 70.729
          - type: recall_at_3
            value: 45.104
          - type: recall_at_5
            value: 52.370000000000005
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackMathematicaRetrieval
          revision: 90fceea13679c63fe563ded68f3b6f06e50061de
          split: test
          type: mteb/cqadupstack-mathematica
        metrics:
          - type: main_score
            value: 39.528999999999996
          - type: map_at_1
            value: 22.289
          - type: map_at_10
            value: 33.159
          - type: map_at_100
            value: 34.544999999999995
          - type: map_at_1000
            value: 34.657
          - type: map_at_20
            value: 33.946
          - type: map_at_3
            value: 29.877
          - type: map_at_5
            value: 31.789
          - type: mrr_at_1
            value: 27.860696517412936
          - type: mrr_at_10
            value: 38.592454394693185
          - type: mrr_at_100
            value: 39.532435897754596
          - type: mrr_at_1000
            value: 39.58977434786168
          - type: mrr_at_20
            value: 39.18675071024776
          - type: mrr_at_3
            value: 35.96600331674959
          - type: mrr_at_5
            value: 37.526948590381416
          - type: nauc_map_at_1000_diff1
            value: 33.700166326733495
          - type: nauc_map_at_1000_max
            value: 20.881755159195087
          - type: nauc_map_at_1000_std
            value: -3.3430462158114675
          - type: nauc_map_at_100_diff1
            value: 33.692093684241065
          - type: nauc_map_at_100_max
            value: 20.906418728277437
          - type: nauc_map_at_100_std
            value: -3.3316697944388443
          - type: nauc_map_at_10_diff1
            value: 33.42287630575565
          - type: nauc_map_at_10_max
            value: 20.50001954371251
          - type: nauc_map_at_10_std
            value: -4.08460043500711
          - type: nauc_map_at_1_diff1
            value: 37.87404744244711
          - type: nauc_map_at_1_max
            value: 19.670953538008504
          - type: nauc_map_at_1_std
            value: -6.429774614333435
          - type: nauc_map_at_20_diff1
            value: 33.60771917466459
          - type: nauc_map_at_20_max
            value: 20.708044731830018
          - type: nauc_map_at_20_std
            value: -3.6069971679953143
          - type: nauc_map_at_3_diff1
            value: 33.65349486102774
          - type: nauc_map_at_3_max
            value: 19.627398723335993
          - type: nauc_map_at_3_std
            value: -4.306026212618319
          - type: nauc_map_at_5_diff1
            value: 33.471450513985964
          - type: nauc_map_at_5_max
            value: 19.948552824819032
          - type: nauc_map_at_5_std
            value: -4.923599608990918
          - type: nauc_mrr_at_1000_diff1
            value: 32.662151329963095
          - type: nauc_mrr_at_1000_max
            value: 22.537786156087673
          - type: nauc_mrr_at_1000_std
            value: -2.7960608938625215
          - type: nauc_mrr_at_100_diff1
            value: 32.65867171998483
          - type: nauc_mrr_at_100_max
            value: 22.547865954292774
          - type: nauc_mrr_at_100_std
            value: -2.801012467040567
          - type: nauc_mrr_at_10_diff1
            value: 32.544025707175926
          - type: nauc_mrr_at_10_max
            value: 22.602412903085646
          - type: nauc_mrr_at_10_std
            value: -3.0158656805804602
          - type: nauc_mrr_at_1_diff1
            value: 36.968863725891985
          - type: nauc_mrr_at_1_max
            value: 22.042028260738334
          - type: nauc_mrr_at_1_std
            value: -4.81746524838004
          - type: nauc_mrr_at_20_diff1
            value: 32.6425264960166
          - type: nauc_mrr_at_20_max
            value: 22.513542321494686
          - type: nauc_mrr_at_20_std
            value: -2.8764217789260575
          - type: nauc_mrr_at_3_diff1
            value: 32.50201126992818
          - type: nauc_mrr_at_3_max
            value: 22.128017930298302
          - type: nauc_mrr_at_3_std
            value: -3.023665576028868
          - type: nauc_mrr_at_5_diff1
            value: 32.56418157013767
          - type: nauc_mrr_at_5_max
            value: 22.05870005229312
          - type: nauc_mrr_at_5_std
            value: -3.5021924901272863
          - type: nauc_ndcg_at_1000_diff1
            value: 32.74240275632584
          - type: nauc_ndcg_at_1000_max
            value: 22.404494093544148
          - type: nauc_ndcg_at_1000_std
            value: -0.5292268805090566
          - type: nauc_ndcg_at_100_diff1
            value: 32.39837105476146
          - type: nauc_ndcg_at_100_max
            value: 22.79204625219021
          - type: nauc_ndcg_at_100_std
            value: -0.3490651737152355
          - type: nauc_ndcg_at_10_diff1
            value: 31.932581950709647
          - type: nauc_ndcg_at_10_max
            value: 21.779867741726864
          - type: nauc_ndcg_at_10_std
            value: -2.6923178974285857
          - type: nauc_ndcg_at_1_diff1
            value: 36.968863725891985
          - type: nauc_ndcg_at_1_max
            value: 22.042028260738334
          - type: nauc_ndcg_at_1_std
            value: -4.81746524838004
          - type: nauc_ndcg_at_20_diff1
            value: 32.463586670511226
          - type: nauc_ndcg_at_20_max
            value: 22.140858428394843
          - type: nauc_ndcg_at_20_std
            value: -1.4367590351530557
          - type: nauc_ndcg_at_3_diff1
            value: 32.446170362942084
          - type: nauc_ndcg_at_3_max
            value: 20.60928390930364
          - type: nauc_ndcg_at_3_std
            value: -3.468700146234719
          - type: nauc_ndcg_at_5_diff1
            value: 32.162455412182865
          - type: nauc_ndcg_at_5_max
            value: 20.725999446060232
          - type: nauc_ndcg_at_5_std
            value: -4.274903425807673
          - type: nauc_precision_at_1000_diff1
            value: -1.7949376725223287
          - type: nauc_precision_at_1000_max
            value: 4.138926678307252
          - type: nauc_precision_at_1000_std
            value: 5.718976977950761
          - type: nauc_precision_at_100_diff1
            value: 6.815844234312567
          - type: nauc_precision_at_100_max
            value: 15.267630374047453
          - type: nauc_precision_at_100_std
            value: 10.648732358170012
          - type: nauc_precision_at_10_diff1
            value: 18.776246678630283
          - type: nauc_precision_at_10_max
            value: 20.677245431024357
          - type: nauc_precision_at_10_std
            value: 1.6530753958695428
          - type: nauc_precision_at_1_diff1
            value: 36.968863725891985
          - type: nauc_precision_at_1_max
            value: 22.042028260738334
          - type: nauc_precision_at_1_std
            value: -4.81746524838004
          - type: nauc_precision_at_20_diff1
            value: 16.901118214014854
          - type: nauc_precision_at_20_max
            value: 20.321433804879973
          - type: nauc_precision_at_20_std
            value: 6.464565628780512
          - type: nauc_precision_at_3_diff1
            value: 25.438322928150715
          - type: nauc_precision_at_3_max
            value: 21.513381450535192
          - type: nauc_precision_at_3_std
            value: -1.0164220255846312
          - type: nauc_precision_at_5_diff1
            value: 22.374520350110284
          - type: nauc_precision_at_5_max
            value: 20.541307175039307
          - type: nauc_precision_at_5_std
            value: -2.6340396442123537
          - type: nauc_recall_at_1000_diff1
            value: 24.96791522787828
          - type: nauc_recall_at_1000_max
            value: 28.234314683043806
          - type: nauc_recall_at_1000_std
            value: 40.696299617721635
          - type: nauc_recall_at_100_diff1
            value: 23.613948951560566
          - type: nauc_recall_at_100_max
            value: 25.980432165003002
          - type: nauc_recall_at_100_std
            value: 13.815393892614894
          - type: nauc_recall_at_10_diff1
            value: 26.08578893691453
          - type: nauc_recall_at_10_max
            value: 21.68887563256401
          - type: nauc_recall_at_10_std
            value: 0.3183582141083137
          - type: nauc_recall_at_1_diff1
            value: 37.87404744244711
          - type: nauc_recall_at_1_max
            value: 19.670953538008504
          - type: nauc_recall_at_1_std
            value: -6.429774614333435
          - type: nauc_recall_at_20_diff1
            value: 26.962834137152473
          - type: nauc_recall_at_20_max
            value: 22.164116014019815
          - type: nauc_recall_at_20_std
            value: 4.67553525902973
          - type: nauc_recall_at_3_diff1
            value: 28.282766004526692
          - type: nauc_recall_at_3_max
            value: 19.21433271344623
          - type: nauc_recall_at_3_std
            value: -1.7579654801836264
          - type: nauc_recall_at_5_diff1
            value: 27.31884901762613
          - type: nauc_recall_at_5_max
            value: 19.089489857779846
          - type: nauc_recall_at_5_std
            value: -3.8031906054652667
          - type: ndcg_at_1
            value: 27.861000000000004
          - type: ndcg_at_10
            value: 39.528999999999996
          - type: ndcg_at_100
            value: 45.424
          - type: ndcg_at_1000
            value: 47.682
          - type: ndcg_at_20
            value: 41.967
          - type: ndcg_at_3
            value: 34.083999999999996
          - type: ndcg_at_5
            value: 36.773
          - type: precision_at_1
            value: 27.861000000000004
          - type: precision_at_10
            value: 7.338
          - type: precision_at_100
            value: 1.172
          - type: precision_at_1000
            value: 0.147
          - type: precision_at_20
            value: 4.415
          - type: precision_at_3
            value: 16.833000000000002
          - type: precision_at_5
            value: 12.113999999999999
          - type: recall_at_1
            value: 22.289
          - type: recall_at_10
            value: 53.559
          - type: recall_at_100
            value: 78.521
          - type: recall_at_1000
            value: 94.13
          - type: recall_at_20
            value: 61.986
          - type: recall_at_3
            value: 38.269999999999996
          - type: recall_at_5
            value: 45.336
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackPhysicsRetrieval
          revision: 79531abbd1fb92d06c6d6315a0cbbbf5bb247ea4
          split: test
          type: mteb/cqadupstack-physics
        metrics:
          - type: main_score
            value: 54.004
          - type: map_at_1
            value: 33.586
          - type: map_at_10
            value: 47.342
          - type: map_at_100
            value: 48.823
          - type: map_at_1000
            value: 48.919000000000004
          - type: map_at_20
            value: 48.22
          - type: map_at_3
            value: 43.614999999999995
          - type: map_at_5
            value: 45.749
          - type: mrr_at_1
            value: 41.48219441770934
          - type: mrr_at_10
            value: 52.86203156270527
          - type: mrr_at_100
            value: 53.707246266591255
          - type: mrr_at_1000
            value: 53.73489176472194
          - type: mrr_at_20
            value: 53.44504144846516
          - type: mrr_at_3
            value: 50.56143727943533
          - type: mrr_at_5
            value: 51.96663458453635
          - type: nauc_map_at_1000_diff1
            value: 50.16735144466837
          - type: nauc_map_at_1000_max
            value: 30.130457323041902
          - type: nauc_map_at_1000_std
            value: -18.910770726198383
          - type: nauc_map_at_100_diff1
            value: 50.170273630833286
          - type: nauc_map_at_100_max
            value: 30.137603210111934
          - type: nauc_map_at_100_std
            value: -18.93078710897879
          - type: nauc_map_at_10_diff1
            value: 49.995799867485076
          - type: nauc_map_at_10_max
            value: 29.626149915961854
          - type: nauc_map_at_10_std
            value: -19.70118715989913
          - type: nauc_map_at_1_diff1
            value: 56.10337790434511
          - type: nauc_map_at_1_max
            value: 26.249897485765477
          - type: nauc_map_at_1_std
            value: -20.159842923954475
          - type: nauc_map_at_20_diff1
            value: 50.026410103063576
          - type: nauc_map_at_20_max
            value: 29.770173596928444
          - type: nauc_map_at_20_std
            value: -19.398108689295622
          - type: nauc_map_at_3_diff1
            value: 50.12369021949809
          - type: nauc_map_at_3_max
            value: 27.918094022890692
          - type: nauc_map_at_3_std
            value: -20.816408880461136
          - type: nauc_map_at_5_diff1
            value: 49.88266421157269
          - type: nauc_map_at_5_max
            value: 28.803327575103616
          - type: nauc_map_at_5_std
            value: -20.412325693429622
          - type: nauc_mrr_at_1000_diff1
            value: 50.08675690045023
          - type: nauc_mrr_at_1000_max
            value: 33.51316969904977
          - type: nauc_mrr_at_1000_std
            value: -16.325548962557693
          - type: nauc_mrr_at_100_diff1
            value: 50.084570223694804
          - type: nauc_mrr_at_100_max
            value: 33.53170304618603
          - type: nauc_mrr_at_100_std
            value: -16.315669293904236
          - type: nauc_mrr_at_10_diff1
            value: 50.104359262926614
          - type: nauc_mrr_at_10_max
            value: 33.454171357296374
          - type: nauc_mrr_at_10_std
            value: -16.672238640691564
          - type: nauc_mrr_at_1_diff1
            value: 54.46283195658263
          - type: nauc_mrr_at_1_max
            value: 33.5006771800345
          - type: nauc_mrr_at_1_std
            value: -15.72197238923995
          - type: nauc_mrr_at_20_diff1
            value: 50.04428019672954
          - type: nauc_mrr_at_20_max
            value: 33.43915921871757
          - type: nauc_mrr_at_20_std
            value: -16.47775099091468
          - type: nauc_mrr_at_3_diff1
            value: 49.29563277160461
          - type: nauc_mrr_at_3_max
            value: 32.609171651470724
          - type: nauc_mrr_at_3_std
            value: -16.8176459078524
          - type: nauc_mrr_at_5_diff1
            value: 49.59993245767094
          - type: nauc_mrr_at_5_max
            value: 33.145357294405365
          - type: nauc_mrr_at_5_std
            value: -16.886783105921864
          - type: nauc_ndcg_at_1000_diff1
            value: 49.84200528661306
          - type: nauc_ndcg_at_1000_max
            value: 32.7463038531318
          - type: nauc_ndcg_at_1000_std
            value: -16.229179922128097
          - type: nauc_ndcg_at_100_diff1
            value: 49.78798184218895
          - type: nauc_ndcg_at_100_max
            value: 33.19106180162596
          - type: nauc_ndcg_at_100_std
            value: -15.964597177057572
          - type: nauc_ndcg_at_10_diff1
            value: 49.10239998219158
          - type: nauc_ndcg_at_10_max
            value: 31.18073711193898
          - type: nauc_ndcg_at_10_std
            value: -19.103888016157107
          - type: nauc_ndcg_at_1_diff1
            value: 54.46283195658263
          - type: nauc_ndcg_at_1_max
            value: 33.5006771800345
          - type: nauc_ndcg_at_1_std
            value: -15.72197238923995
          - type: nauc_ndcg_at_20_diff1
            value: 49.12986473579085
          - type: nauc_ndcg_at_20_max
            value: 31.555721190821874
          - type: nauc_ndcg_at_20_std
            value: -18.03991726456339
          - type: nauc_ndcg_at_3_diff1
            value: 48.06266636428524
          - type: nauc_ndcg_at_3_max
            value: 29.800215619456498
          - type: nauc_ndcg_at_3_std
            value: -19.534322783334527
          - type: nauc_ndcg_at_5_diff1
            value: 48.15095160139167
          - type: nauc_ndcg_at_5_max
            value: 30.208802143718682
          - type: nauc_ndcg_at_5_std
            value: -19.9192266388754
          - type: nauc_precision_at_1000_diff1
            value: -14.22147314326395
          - type: nauc_precision_at_1000_max
            value: 4.578027927831382
          - type: nauc_precision_at_1000_std
            value: 17.42650517281872
          - type: nauc_precision_at_100_diff1
            value: -6.889359682595786
          - type: nauc_precision_at_100_max
            value: 13.816120144295166
          - type: nauc_precision_at_100_std
            value: 19.169326264844834
          - type: nauc_precision_at_10_diff1
            value: 11.630213989568256
          - type: nauc_precision_at_10_max
            value: 25.18561447388641
          - type: nauc_precision_at_10_std
            value: 3.5091485378988714
          - type: nauc_precision_at_1_diff1
            value: 54.46283195658263
          - type: nauc_precision_at_1_max
            value: 33.5006771800345
          - type: nauc_precision_at_1_std
            value: -15.72197238923995
          - type: nauc_precision_at_20_diff1
            value: 3.5727333022082184
          - type: nauc_precision_at_20_max
            value: 20.959966668076714
          - type: nauc_precision_at_20_std
            value: 11.024682685903581
          - type: nauc_precision_at_3_diff1
            value: 27.22306777334495
          - type: nauc_precision_at_3_max
            value: 30.39888856674192
          - type: nauc_precision_at_3_std
            value: -7.583643149291899
          - type: nauc_precision_at_5_diff1
            value: 18.788243224115185
          - type: nauc_precision_at_5_max
            value: 28.14592563430115
          - type: nauc_precision_at_5_std
            value: -3.10270506824694
          - type: nauc_recall_at_1000_diff1
            value: 62.4411056243426
          - type: nauc_recall_at_1000_max
            value: 69.22941585002123
          - type: nauc_recall_at_1000_std
            value: 36.11911276552335
          - type: nauc_recall_at_100_diff1
            value: 44.59026422323201
          - type: nauc_recall_at_100_max
            value: 47.97129128154523
          - type: nauc_recall_at_100_std
            value: 4.778892937753897
          - type: nauc_recall_at_10_diff1
            value: 43.25042694366798
          - type: nauc_recall_at_10_max
            value: 30.67002821157203
          - type: nauc_recall_at_10_std
            value: -18.821325601418703
          - type: nauc_recall_at_1_diff1
            value: 56.10337790434511
          - type: nauc_recall_at_1_max
            value: 26.249897485765477
          - type: nauc_recall_at_1_std
            value: -20.159842923954475
          - type: nauc_recall_at_20_diff1
            value: 41.53741723146757
          - type: nauc_recall_at_20_max
            value: 30.852977167860324
          - type: nauc_recall_at_20_std
            value: -14.824694384045237
          - type: nauc_recall_at_3_diff1
            value: 42.251002622079916
          - type: nauc_recall_at_3_max
            value: 25.083846761725724
          - type: nauc_recall_at_3_std
            value: -22.239786875574765
          - type: nauc_recall_at_5_diff1
            value: 41.146094656121385
          - type: nauc_recall_at_5_max
            value: 27.189625490714608
          - type: nauc_recall_at_5_std
            value: -22.001469364479068
          - type: ndcg_at_1
            value: 41.482
          - type: ndcg_at_10
            value: 54.004
          - type: ndcg_at_100
            value: 59.455000000000005
          - type: ndcg_at_1000
            value: 60.831999999999994
          - type: ndcg_at_20
            value: 56.484
          - type: ndcg_at_3
            value: 48.802
          - type: ndcg_at_5
            value: 51.43600000000001
          - type: precision_at_1
            value: 41.482
          - type: precision_at_10
            value: 9.99
          - type: precision_at_100
            value: 1.4989999999999999
          - type: precision_at_1000
            value: 0.178
          - type: precision_at_20
            value: 5.861000000000001
          - type: precision_at_3
            value: 23.709
          - type: precision_at_5
            value: 16.843
          - type: recall_at_1
            value: 33.586
          - type: recall_at_10
            value: 67.754
          - type: recall_at_100
            value: 89.689
          - type: recall_at_1000
            value: 98.212
          - type: recall_at_20
            value: 76.253
          - type: recall_at_3
            value: 53.181
          - type: recall_at_5
            value: 60.122
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackProgrammersRetrieval
          revision: 6184bc1440d2dbc7612be22b50686b8826d22b32
          split: test
          type: mteb/cqadupstack-programmers
        metrics:
          - type: main_score
            value: 50.547
          - type: map_at_1
            value: 30.547
          - type: map_at_10
            value: 43.595
          - type: map_at_100
            value: 45.044000000000004
          - type: map_at_1000
            value: 45.143
          - type: map_at_20
            value: 44.46
          - type: map_at_3
            value: 39.512
          - type: map_at_5
            value: 41.655
          - type: mrr_at_1
            value: 38.242009132420094
          - type: mrr_at_10
            value: 49.150811770674785
          - type: mrr_at_100
            value: 49.95736920255132
          - type: mrr_at_1000
            value: 49.991323278325005
          - type: mrr_at_20
            value: 49.64605069442795
          - type: mrr_at_3
            value: 46.19482496194824
          - type: mrr_at_5
            value: 47.74162861491625
          - type: nauc_map_at_1000_diff1
            value: 40.52349853300547
          - type: nauc_map_at_1000_max
            value: 31.561296386270925
          - type: nauc_map_at_1000_std
            value: -5.03343890785704
          - type: nauc_map_at_100_diff1
            value: 40.48825194476996
          - type: nauc_map_at_100_max
            value: 31.553405159588717
          - type: nauc_map_at_100_std
            value: -5.042866610979561
          - type: nauc_map_at_10_diff1
            value: 40.39926831942659
          - type: nauc_map_at_10_max
            value: 30.946628618728266
          - type: nauc_map_at_10_std
            value: -5.776518335664868
          - type: nauc_map_at_1_diff1
            value: 44.73341103510332
          - type: nauc_map_at_1_max
            value: 24.72510025576844
          - type: nauc_map_at_1_std
            value: -11.010252578512175
          - type: nauc_map_at_20_diff1
            value: 40.44256461277349
          - type: nauc_map_at_20_max
            value: 31.466590802666467
          - type: nauc_map_at_20_std
            value: -5.113421418562381
          - type: nauc_map_at_3_diff1
            value: 41.38809172163691
          - type: nauc_map_at_3_max
            value: 29.48868065104881
          - type: nauc_map_at_3_std
            value: -8.459559994349043
          - type: nauc_map_at_5_diff1
            value: 40.50417748715188
          - type: nauc_map_at_5_max
            value: 30.375034537551333
          - type: nauc_map_at_5_std
            value: -6.829586305389068
          - type: nauc_mrr_at_1000_diff1
            value: 38.13147562273569
          - type: nauc_mrr_at_1000_max
            value: 33.4729877260649
          - type: nauc_mrr_at_1000_std
            value: -2.115383391956632
          - type: nauc_mrr_at_100_diff1
            value: 38.12352986074086
          - type: nauc_mrr_at_100_max
            value: 33.47904382055151
          - type: nauc_mrr_at_100_std
            value: -2.0980380463248816
          - type: nauc_mrr_at_10_diff1
            value: 37.879793238833486
          - type: nauc_mrr_at_10_max
            value: 33.24190962300982
          - type: nauc_mrr_at_10_std
            value: -2.197979308633544
          - type: nauc_mrr_at_1_diff1
            value: 40.89812140583222
          - type: nauc_mrr_at_1_max
            value: 30.547640253413395
          - type: nauc_mrr_at_1_std
            value: -4.319528874623733
          - type: nauc_mrr_at_20_diff1
            value: 38.08114567265545
          - type: nauc_mrr_at_20_max
            value: 33.5751626334935
          - type: nauc_mrr_at_20_std
            value: -2.0190711781853805
          - type: nauc_mrr_at_3_diff1
            value: 38.36593445752741
          - type: nauc_mrr_at_3_max
            value: 33.5606672994442
          - type: nauc_mrr_at_3_std
            value: -3.313496883242172
          - type: nauc_mrr_at_5_diff1
            value: 37.67325286264018
          - type: nauc_mrr_at_5_max
            value: 33.36028645933453
          - type: nauc_mrr_at_5_std
            value: -2.5553616249884756
          - type: nauc_ndcg_at_1000_diff1
            value: 39.15178707833506
          - type: nauc_ndcg_at_1000_max
            value: 33.25615613608456
          - type: nauc_ndcg_at_1000_std
            value: -2.1792655266044645
          - type: nauc_ndcg_at_100_diff1
            value: 38.9781153280577
          - type: nauc_ndcg_at_100_max
            value: 33.59332040478102
          - type: nauc_ndcg_at_100_std
            value: -1.6261785471415764
          - type: nauc_ndcg_at_10_diff1
            value: 38.497420832277975
          - type: nauc_ndcg_at_10_max
            value: 32.53253337236221
          - type: nauc_ndcg_at_10_std
            value: -2.997611061467513
          - type: nauc_ndcg_at_1_diff1
            value: 40.89812140583222
          - type: nauc_ndcg_at_1_max
            value: 30.547640253413395
          - type: nauc_ndcg_at_1_std
            value: -4.319528874623733
          - type: nauc_ndcg_at_20_diff1
            value: 38.81727541423619
          - type: nauc_ndcg_at_20_max
            value: 33.83499432459841
          - type: nauc_ndcg_at_20_std
            value: -1.4541145324463343
          - type: nauc_ndcg_at_3_diff1
            value: 39.21372121259748
          - type: nauc_ndcg_at_3_max
            value: 32.21240027184339
          - type: nauc_ndcg_at_3_std
            value: -5.818515242107007
          - type: nauc_ndcg_at_5_diff1
            value: 38.36581068852509
          - type: nauc_ndcg_at_5_max
            value: 32.31265492516815
          - type: nauc_ndcg_at_5_std
            value: -4.347865800300811
          - type: nauc_precision_at_1000_diff1
            value: -2.9404408066555487
          - type: nauc_precision_at_1000_max
            value: 11.959727087923113
          - type: nauc_precision_at_1000_std
            value: 19.807537724237182
          - type: nauc_precision_at_100_diff1
            value: -1.8903473485508044
          - type: nauc_precision_at_100_max
            value: 17.859451192772262
          - type: nauc_precision_at_100_std
            value: 20.978283478932195
          - type: nauc_precision_at_10_diff1
            value: 7.827166236013994
          - type: nauc_precision_at_10_max
            value: 27.639518058609987
          - type: nauc_precision_at_10_std
            value: 16.2656199079196
          - type: nauc_precision_at_1_diff1
            value: 40.89812140583222
          - type: nauc_precision_at_1_max
            value: 30.547640253413395
          - type: nauc_precision_at_1_std
            value: -4.319528874623733
          - type: nauc_precision_at_20_diff1
            value: 3.0739728724420488
          - type: nauc_precision_at_20_max
            value: 24.28491071974094
          - type: nauc_precision_at_20_std
            value: 19.64404584038665
          - type: nauc_precision_at_3_diff1
            value: 23.38851433425848
          - type: nauc_precision_at_3_max
            value: 34.046714722976056
          - type: nauc_precision_at_3_std
            value: 4.085453450220984
          - type: nauc_precision_at_5_diff1
            value: 14.827066677039587
          - type: nauc_precision_at_5_max
            value: 31.844657859314747
          - type: nauc_precision_at_5_std
            value: 11.233146291519418
          - type: nauc_recall_at_1000_diff1
            value: 40.585961683508714
          - type: nauc_recall_at_1000_max
            value: 48.857695287563935
          - type: nauc_recall_at_1000_std
            value: 43.20362271394189
          - type: nauc_recall_at_100_diff1
            value: 32.24127663397077
          - type: nauc_recall_at_100_max
            value: 38.836350075837004
          - type: nauc_recall_at_100_std
            value: 17.622027048501153
          - type: nauc_recall_at_10_diff1
            value: 31.30410560798441
          - type: nauc_recall_at_10_max
            value: 30.93697991799787
          - type: nauc_recall_at_10_std
            value: 1.5177200901024983
          - type: nauc_recall_at_1_diff1
            value: 44.73341103510332
          - type: nauc_recall_at_1_max
            value: 24.72510025576844
          - type: nauc_recall_at_1_std
            value: -11.010252578512175
          - type: nauc_recall_at_20_diff1
            value: 31.93561881507333
          - type: nauc_recall_at_20_max
            value: 36.879629985707076
          - type: nauc_recall_at_20_std
            value: 9.68448188578646
          - type: nauc_recall_at_3_diff1
            value: 36.243457137883894
          - type: nauc_recall_at_3_max
            value: 30.46545172710201
          - type: nauc_recall_at_3_std
            value: -7.391349871928162
          - type: nauc_recall_at_5_diff1
            value: 32.999190531912554
          - type: nauc_recall_at_5_max
            value: 30.87264732206836
          - type: nauc_recall_at_5_std
            value: -3.3937930443165434
          - type: ndcg_at_1
            value: 38.242
          - type: ndcg_at_10
            value: 50.547
          - type: ndcg_at_100
            value: 55.994
          - type: ndcg_at_1000
            value: 57.538
          - type: ndcg_at_20
            value: 52.954
          - type: ndcg_at_3
            value: 44.283
          - type: ndcg_at_5
            value: 46.86
          - type: precision_at_1
            value: 38.242
          - type: precision_at_10
            value: 9.498
          - type: precision_at_100
            value: 1.424
          - type: precision_at_1000
            value: 0.174
          - type: precision_at_20
            value: 5.628
          - type: precision_at_3
            value: 21.271
          - type: precision_at_5
            value: 15.342
          - type: recall_at_1
            value: 30.547
          - type: recall_at_10
            value: 65.42999999999999
          - type: recall_at_100
            value: 87.92
          - type: recall_at_1000
            value: 97.68599999999999
          - type: recall_at_20
            value: 73.685
          - type: recall_at_3
            value: 47.979
          - type: recall_at_5
            value: 54.69199999999999
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackStatsRetrieval
          revision: 65ac3a16b8e91f9cee4c9828cc7c335575432a2a
          split: test
          type: mteb/cqadupstack-stats
        metrics:
          - type: main_score
            value: 42.379
          - type: map_at_1
            value: 28.076
          - type: map_at_10
            value: 37.187
          - type: map_at_100
            value: 38.163000000000004
          - type: map_at_1000
            value: 38.262
          - type: map_at_20
            value: 37.649
          - type: map_at_3
            value: 34.361000000000004
          - type: map_at_5
            value: 36.024
          - type: mrr_at_1
            value: 31.13496932515337
          - type: mrr_at_10
            value: 39.87084915765898
          - type: mrr_at_100
            value: 40.63847645369495
          - type: mrr_at_1000
            value: 40.70451576754048
          - type: mrr_at_20
            value: 40.25268368368429
          - type: mrr_at_3
            value: 37.37218813905932
          - type: mrr_at_5
            value: 38.698875255623726
          - type: nauc_map_at_1000_diff1
            value: 53.23968282874812
          - type: nauc_map_at_1000_max
            value: 33.785923443457136
          - type: nauc_map_at_1000_std
            value: -7.1706965835194145
          - type: nauc_map_at_100_diff1
            value: 53.23488336800868
          - type: nauc_map_at_100_max
            value: 33.78610121008569
          - type: nauc_map_at_100_std
            value: -7.15094162130079
          - type: nauc_map_at_10_diff1
            value: 53.52788129491361
          - type: nauc_map_at_10_max
            value: 33.55616013388991
          - type: nauc_map_at_10_std
            value: -7.6857282749978
          - type: nauc_map_at_1_diff1
            value: 59.34174527256049
          - type: nauc_map_at_1_max
            value: 32.58063146059831
          - type: nauc_map_at_1_std
            value: -9.540287370085819
          - type: nauc_map_at_20_diff1
            value: 53.16586961282429
          - type: nauc_map_at_20_max
            value: 33.69272685105737
          - type: nauc_map_at_20_std
            value: -7.380323341082431
          - type: nauc_map_at_3_diff1
            value: 55.28137765707177
          - type: nauc_map_at_3_max
            value: 33.45378492437827
          - type: nauc_map_at_3_std
            value: -8.18647355512435
          - type: nauc_map_at_5_diff1
            value: 53.8836295908436
          - type: nauc_map_at_5_max
            value: 33.822344952119785
          - type: nauc_map_at_5_std
            value: -7.64537861608003
          - type: nauc_mrr_at_1000_diff1
            value: 51.841157711545215
          - type: nauc_mrr_at_1000_max
            value: 34.9249740423282
          - type: nauc_mrr_at_1000_std
            value: -5.797330608658271
          - type: nauc_mrr_at_100_diff1
            value: 51.82520112610312
          - type: nauc_mrr_at_100_max
            value: 34.9362444083548
          - type: nauc_mrr_at_100_std
            value: -5.7681632136177585
          - type: nauc_mrr_at_10_diff1
            value: 51.81624637385308
          - type: nauc_mrr_at_10_max
            value: 34.837632307043705
          - type: nauc_mrr_at_10_std
            value: -6.09995049270317
          - type: nauc_mrr_at_1_diff1
            value: 58.37854579448285
          - type: nauc_mrr_at_1_max
            value: 34.672901734986844
          - type: nauc_mrr_at_1_std
            value: -7.066787533024501
          - type: nauc_mrr_at_20_diff1
            value: 51.65185881732499
          - type: nauc_mrr_at_20_max
            value: 34.925636736880925
          - type: nauc_mrr_at_20_std
            value: -5.827364722186311
          - type: nauc_mrr_at_3_diff1
            value: 53.51689033144754
          - type: nauc_mrr_at_3_max
            value: 34.75062118986762
          - type: nauc_mrr_at_3_std
            value: -6.580474412596013
          - type: nauc_mrr_at_5_diff1
            value: 52.291499624036355
          - type: nauc_mrr_at_5_max
            value: 35.066619088016196
          - type: nauc_mrr_at_5_std
            value: -6.1986345561829195
          - type: nauc_ndcg_at_1000_diff1
            value: 50.51376093038994
          - type: nauc_ndcg_at_1000_max
            value: 34.725822070535685
          - type: nauc_ndcg_at_1000_std
            value: -4.434746308735319
          - type: nauc_ndcg_at_100_diff1
            value: 49.81860985607077
          - type: nauc_ndcg_at_100_max
            value: 34.692760290424815
          - type: nauc_ndcg_at_100_std
            value: -3.835522029514012
          - type: nauc_ndcg_at_10_diff1
            value: 50.3513048763106
          - type: nauc_ndcg_at_10_max
            value: 33.72184194935727
          - type: nauc_ndcg_at_10_std
            value: -6.798983244879382
          - type: nauc_ndcg_at_1_diff1
            value: 58.37854579448285
          - type: nauc_ndcg_at_1_max
            value: 34.672901734986844
          - type: nauc_ndcg_at_1_std
            value: -7.066787533024501
          - type: nauc_ndcg_at_20_diff1
            value: 49.29162167829859
          - type: nauc_ndcg_at_20_max
            value: 34.16877295196376
          - type: nauc_ndcg_at_20_std
            value: -5.597014358860604
          - type: nauc_ndcg_at_3_diff1
            value: 53.10834468009104
          - type: nauc_ndcg_at_3_max
            value: 34.33773588752504
          - type: nauc_ndcg_at_3_std
            value: -7.243624483216034
          - type: nauc_ndcg_at_5_diff1
            value: 51.104845457630354
          - type: nauc_ndcg_at_5_max
            value: 34.38674960727082
          - type: nauc_ndcg_at_5_std
            value: -6.949153425119295
          - type: nauc_precision_at_1000_diff1
            value: -9.296436979607215
          - type: nauc_precision_at_1000_max
            value: 6.4385608601441255
          - type: nauc_precision_at_1000_std
            value: 9.323328514309525
          - type: nauc_precision_at_100_diff1
            value: 1.6478610402380616
          - type: nauc_precision_at_100_max
            value: 18.351794901313585
          - type: nauc_precision_at_100_std
            value: 14.665874744283974
          - type: nauc_precision_at_10_diff1
            value: 25.534183841642637
          - type: nauc_precision_at_10_max
            value: 29.40076026042332
          - type: nauc_precision_at_10_std
            value: 2.9872193044238453
          - type: nauc_precision_at_1_diff1
            value: 58.37854579448285
          - type: nauc_precision_at_1_max
            value: 34.672901734986844
          - type: nauc_precision_at_1_std
            value: -7.066787533024501
          - type: nauc_precision_at_20_diff1
            value: 15.647544367678556
          - type: nauc_precision_at_20_max
            value: 27.05732589353733
          - type: nauc_precision_at_20_std
            value: 7.191923029484484
          - type: nauc_precision_at_3_diff1
            value: 43.617914587502476
          - type: nauc_precision_at_3_max
            value: 34.43947964259185
          - type: nauc_precision_at_3_std
            value: -2.2997019515698853
          - type: nauc_precision_at_5_diff1
            value: 33.45902372451529
          - type: nauc_precision_at_5_max
            value: 33.345179920600174
          - type: nauc_precision_at_5_std
            value: 0.6402432222388739
          - type: nauc_recall_at_1000_diff1
            value: 29.85614248165102
          - type: nauc_recall_at_1000_max
            value: 43.12189214089366
          - type: nauc_recall_at_1000_std
            value: 38.028489124610644
          - type: nauc_recall_at_100_diff1
            value: 33.1910221741884
          - type: nauc_recall_at_100_max
            value: 36.878036476663056
          - type: nauc_recall_at_100_std
            value: 17.505589309024437
          - type: nauc_recall_at_10_diff1
            value: 40.89508005321193
          - type: nauc_recall_at_10_max
            value: 31.718075561656622
          - type: nauc_recall_at_10_std
            value: -5.5201680473345105
          - type: nauc_recall_at_1_diff1
            value: 59.34174527256049
          - type: nauc_recall_at_1_max
            value: 32.58063146059831
          - type: nauc_recall_at_1_std
            value: -9.540287370085819
          - type: nauc_recall_at_20_diff1
            value: 35.66013790544511
          - type: nauc_recall_at_20_max
            value: 32.86639975082532
          - type: nauc_recall_at_20_std
            value: -0.7884329140983038
          - type: nauc_recall_at_3_diff1
            value: 49.19221784465332
          - type: nauc_recall_at_3_max
            value: 33.023935837910756
          - type: nauc_recall_at_3_std
            value: -7.019711964409782
          - type: nauc_recall_at_5_diff1
            value: 44.67980008380877
          - type: nauc_recall_at_5_max
            value: 33.64495915667608
          - type: nauc_recall_at_5_std
            value: -6.146102608248518
          - type: ndcg_at_1
            value: 31.135
          - type: ndcg_at_10
            value: 42.379
          - type: ndcg_at_100
            value: 47.296
          - type: ndcg_at_1000
            value: 49.403999999999996
          - type: ndcg_at_20
            value: 43.93
          - type: ndcg_at_3
            value: 37.196
          - type: ndcg_at_5
            value: 39.75
          - type: precision_at_1
            value: 31.135
          - type: precision_at_10
            value: 6.81
          - type: precision_at_100
            value: 1.014
          - type: precision_at_1000
            value: 0.127
          - type: precision_at_20
            value: 3.834
          - type: precision_at_3
            value: 16.002
          - type: precision_at_5
            value: 11.411
          - type: recall_at_1
            value: 28.076
          - type: recall_at_10
            value: 55.509
          - type: recall_at_100
            value: 78.396
          - type: recall_at_1000
            value: 93.124
          - type: recall_at_20
            value: 61.326
          - type: recall_at_3
            value: 41.399
          - type: recall_at_5
            value: 47.567
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackTexRetrieval
          revision: 46989137a86843e03a6195de44b09deda022eec7
          split: test
          type: mteb/cqadupstack-tex
        metrics:
          - type: main_score
            value: 37.114999999999995
          - type: map_at_1
            value: 22.032
          - type: map_at_10
            value: 31.392999999999997
          - type: map_at_100
            value: 32.681
          - type: map_at_1000
            value: 32.803
          - type: map_at_20
            value: 32.092999999999996
          - type: map_at_3
            value: 28.33
          - type: map_at_5
            value: 29.988999999999997
          - type: mrr_at_1
            value: 26.944253269098418
          - type: mrr_at_10
            value: 35.76442827647241
          - type: mrr_at_100
            value: 36.70928542668393
          - type: mrr_at_1000
            value: 36.770222872867485
          - type: mrr_at_20
            value: 36.28598608599559
          - type: mrr_at_3
            value: 33.167010782289594
          - type: mrr_at_5
            value: 34.620899288827864
          - type: nauc_map_at_1000_diff1
            value: 38.09265419483922
          - type: nauc_map_at_1000_max
            value: 25.105090914997024
          - type: nauc_map_at_1000_std
            value: 1.0700959987729692
          - type: nauc_map_at_100_diff1
            value: 38.063239842931246
          - type: nauc_map_at_100_max
            value: 25.071823053158475
          - type: nauc_map_at_100_std
            value: 1.0427996382419578
          - type: nauc_map_at_10_diff1
            value: 38.063314345359736
          - type: nauc_map_at_10_max
            value: 24.90358356796509
          - type: nauc_map_at_10_std
            value: 0.48891415762356544
          - type: nauc_map_at_1_diff1
            value: 44.192488964031135
          - type: nauc_map_at_1_max
            value: 23.101395238489264
          - type: nauc_map_at_1_std
            value: -0.44274744959708606
          - type: nauc_map_at_20_diff1
            value: 38.02737709746376
          - type: nauc_map_at_20_max
            value: 25.015577711149145
          - type: nauc_map_at_20_std
            value: 0.7752620565795433
          - type: nauc_map_at_3_diff1
            value: 38.79059906518923
          - type: nauc_map_at_3_max
            value: 24.278973778653658
          - type: nauc_map_at_3_std
            value: -0.06600853085223404
          - type: nauc_map_at_5_diff1
            value: 38.38811885476713
          - type: nauc_map_at_5_max
            value: 24.906014694358767
          - type: nauc_map_at_5_std
            value: 0.503696622267735
          - type: nauc_mrr_at_1000_diff1
            value: 38.43851052537515
          - type: nauc_mrr_at_1000_max
            value: 26.08088413681578
          - type: nauc_mrr_at_1000_std
            value: 2.260435008633633
          - type: nauc_mrr_at_100_diff1
            value: 38.42446503025336
          - type: nauc_mrr_at_100_max
            value: 26.06653535777771
          - type: nauc_mrr_at_100_std
            value: 2.2508085472342567
          - type: nauc_mrr_at_10_diff1
            value: 38.42491058346722
          - type: nauc_mrr_at_10_max
            value: 26.046875548569524
          - type: nauc_mrr_at_10_std
            value: 1.991934209812353
          - type: nauc_mrr_at_1_diff1
            value: 44.125116470111806
          - type: nauc_mrr_at_1_max
            value: 25.502414026989822
          - type: nauc_mrr_at_1_std
            value: 1.0717390948764505
          - type: nauc_mrr_at_20_diff1
            value: 38.355654581557275
          - type: nauc_mrr_at_20_max
            value: 26.052337555999888
          - type: nauc_mrr_at_20_std
            value: 2.0892219127514107
          - type: nauc_mrr_at_3_diff1
            value: 39.001757864272676
          - type: nauc_mrr_at_3_max
            value: 25.98003648378764
          - type: nauc_mrr_at_3_std
            value: 1.6394764040482228
          - type: nauc_mrr_at_5_diff1
            value: 38.71163053840094
          - type: nauc_mrr_at_5_max
            value: 26.20780413201001
          - type: nauc_mrr_at_5_std
            value: 2.021661434346652
          - type: nauc_ndcg_at_1000_diff1
            value: 36.31450458217211
          - type: nauc_ndcg_at_1000_max
            value: 26.149308380875073
          - type: nauc_ndcg_at_1000_std
            value: 3.905862488970823
          - type: nauc_ndcg_at_100_diff1
            value: 35.963790362714164
          - type: nauc_ndcg_at_100_max
            value: 25.739750793393007
          - type: nauc_ndcg_at_100_std
            value: 3.7112777105604406
          - type: nauc_ndcg_at_10_diff1
            value: 35.99336074029864
          - type: nauc_ndcg_at_10_max
            value: 25.55200053240736
          - type: nauc_ndcg_at_10_std
            value: 1.5588036488952475
          - type: nauc_ndcg_at_1_diff1
            value: 44.125116470111806
          - type: nauc_ndcg_at_1_max
            value: 25.502414026989822
          - type: nauc_ndcg_at_1_std
            value: 1.0717390948764505
          - type: nauc_ndcg_at_20_diff1
            value: 35.73590736885051
          - type: nauc_ndcg_at_20_max
            value: 25.70046947040548
          - type: nauc_ndcg_at_20_std
            value: 2.271321757997752
          - type: nauc_ndcg_at_3_diff1
            value: 37.32573641209906
          - type: nauc_ndcg_at_3_max
            value: 25.1167909777267
          - type: nauc_ndcg_at_3_std
            value: 0.7212992566129185
          - type: nauc_ndcg_at_5_diff1
            value: 36.712049675888636
          - type: nauc_ndcg_at_5_max
            value: 25.792607516706372
          - type: nauc_ndcg_at_5_std
            value: 1.578770099119
          - type: nauc_precision_at_1000_diff1
            value: 3.6736780338116977
          - type: nauc_precision_at_1000_max
            value: 11.81314408533315
          - type: nauc_precision_at_1000_std
            value: 10.2436841196851
          - type: nauc_precision_at_100_diff1
            value: 8.417413354516071
          - type: nauc_precision_at_100_max
            value: 16.205114523661024
          - type: nauc_precision_at_100_std
            value: 13.594635835595328
          - type: nauc_precision_at_10_diff1
            value: 19.048008342402845
          - type: nauc_precision_at_10_max
            value: 23.350651852456103
          - type: nauc_precision_at_10_std
            value: 5.976335419523274
          - type: nauc_precision_at_1_diff1
            value: 44.125116470111806
          - type: nauc_precision_at_1_max
            value: 25.502414026989822
          - type: nauc_precision_at_1_std
            value: 1.0717390948764505
          - type: nauc_precision_at_20_diff1
            value: 15.474925061953678
          - type: nauc_precision_at_20_max
            value: 21.546991193902272
          - type: nauc_precision_at_20_std
            value: 8.905930860583391
          - type: nauc_precision_at_3_diff1
            value: 28.986321566644303
          - type: nauc_precision_at_3_max
            value: 26.69485123311458
          - type: nauc_precision_at_3_std
            value: 3.4263045093511537
          - type: nauc_precision_at_5_diff1
            value: 24.709408636594915
          - type: nauc_precision_at_5_max
            value: 26.67143866400471
          - type: nauc_precision_at_5_std
            value: 5.19041364886639
          - type: nauc_recall_at_1000_diff1
            value: 20.00674566428088
          - type: nauc_recall_at_1000_max
            value: 34.777585777551536
          - type: nauc_recall_at_1000_std
            value: 36.77107209206558
          - type: nauc_recall_at_100_diff1
            value: 24.285256665242304
          - type: nauc_recall_at_100_max
            value: 23.801866644708262
          - type: nauc_recall_at_100_std
            value: 15.064509694858854
          - type: nauc_recall_at_10_diff1
            value: 27.36808052999267
          - type: nauc_recall_at_10_max
            value: 24.053807252852636
          - type: nauc_recall_at_10_std
            value: 2.597884142562802
          - type: nauc_recall_at_1_diff1
            value: 44.192488964031135
          - type: nauc_recall_at_1_max
            value: 23.101395238489264
          - type: nauc_recall_at_1_std
            value: -0.44274744959708606
          - type: nauc_recall_at_20_diff1
            value: 25.65995095802745
          - type: nauc_recall_at_20_max
            value: 24.31913892777212
          - type: nauc_recall_at_20_std
            value: 5.048151975361747
          - type: nauc_recall_at_3_diff1
            value: 32.07015707209654
          - type: nauc_recall_at_3_max
            value: 23.698394784703815
          - type: nauc_recall_at_3_std
            value: 0.4539034711477527
          - type: nauc_recall_at_5_diff1
            value: 30.186485460653582
          - type: nauc_recall_at_5_max
            value: 25.00467869253249
          - type: nauc_recall_at_5_std
            value: 2.598872826683705
          - type: ndcg_at_1
            value: 26.944000000000003
          - type: ndcg_at_10
            value: 37.114999999999995
          - type: ndcg_at_100
            value: 42.846000000000004
          - type: ndcg_at_1000
            value: 45.228
          - type: ndcg_at_20
            value: 39.26
          - type: ndcg_at_3
            value: 31.891000000000002
          - type: ndcg_at_5
            value: 34.261
          - type: precision_at_1
            value: 26.944000000000003
          - type: precision_at_10
            value: 6.8790000000000004
          - type: precision_at_100
            value: 1.138
          - type: precision_at_1000
            value: 0.154
          - type: precision_at_20
            value: 4.092
          - type: precision_at_3
            value: 15.244
          - type: precision_at_5
            value: 11.004999999999999
          - type: recall_at_1
            value: 22.032
          - type: recall_at_10
            value: 49.830999999999996
          - type: recall_at_100
            value: 75.318
          - type: recall_at_1000
            value: 91.526
          - type: recall_at_20
            value: 57.684999999999995
          - type: recall_at_3
            value: 35.144999999999996
          - type: recall_at_5
            value: 41.377
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackRetrieval
          split: test
          type: mteb/cqadupstack
        metrics:
          - type: main_score
            value: 49.35933333333333
          - type: map_at_1
            value: 31.5475
          - type: map_at_10
            value: 43.166916666666665
          - type: map_at_100
            value: 44.506083333333336
          - type: map_at_1000
            value: 44.60875
          - type: map_at_20
            value: 43.926166666666674
          - type: map_at_3
            value: 39.7375
          - type: map_at_5
            value: 41.63241666666667
          - type: mrr_at_1
            value: 37.58487329336356
          - type: mrr_at_10
            value: 47.57339949857069
          - type: mrr_at_100
            value: 48.37962696919692
          - type: mrr_at_1000
            value: 48.42044074093141
          - type: mrr_at_20
            value: 48.05694412330748
          - type: mrr_at_3
            value: 45.01312222327854
          - type: mrr_at_5
            value: 46.45963570299018
          - type: nauc_map_at_1000_diff1
            value: 47.559431895551796
          - type: nauc_map_at_1000_max
            value: 32.22624317021025
          - type: nauc_map_at_1000_std
            value: -9.215659016819911
          - type: nauc_map_at_100_diff1
            value: 47.5522725421024
          - type: nauc_map_at_100_max
            value: 32.23227770404454
          - type: nauc_map_at_100_std
            value: -9.257263949623699
          - type: nauc_map_at_10_diff1
            value: 47.62525599466672
          - type: nauc_map_at_10_max
            value: 31.810691404066432
          - type: nauc_map_at_10_std
            value: -10.159455545932724
          - type: nauc_map_at_1_diff1
            value: 52.959829481566764
          - type: nauc_map_at_1_max
            value: 28.644143760250785
          - type: nauc_map_at_1_std
            value: -11.72163597077123
          - type: nauc_map_at_20_diff1
            value: 47.56050095649268
          - type: nauc_map_at_20_max
            value: 32.08395945370071
          - type: nauc_map_at_20_std
            value: -9.628010776060316
          - type: nauc_map_at_3_diff1
            value: 48.51453660580493
          - type: nauc_map_at_3_max
            value: 30.898488535624786
          - type: nauc_map_at_3_std
            value: -11.15241799050688
          - type: nauc_map_at_5_diff1
            value: 47.85361615288319
          - type: nauc_map_at_5_max
            value: 31.396160977070693
          - type: nauc_map_at_5_std
            value: -10.669927060581687
          - type: nauc_mrr_at_1000_diff1
            value: 46.5756551519747
          - type: nauc_mrr_at_1000_max
            value: 33.613205491060505
          - type: nauc_mrr_at_1000_std
            value: -7.511388196842074
          - type: nauc_mrr_at_100_diff1
            value: 46.56493524451518
          - type: nauc_mrr_at_100_max
            value: 33.61311557843383
          - type: nauc_mrr_at_100_std
            value: -7.503137722678137
          - type: nauc_mrr_at_10_diff1
            value: 46.48587625246975
          - type: nauc_mrr_at_10_max
            value: 33.56104741766235
          - type: nauc_mrr_at_10_std
            value: -7.798262408773109
          - type: nauc_mrr_at_1_diff1
            value: 50.92937737651317
          - type: nauc_mrr_at_1_max
            value: 32.9507362296752
          - type: nauc_mrr_at_1_std
            value: -8.423238646208265
          - type: nauc_mrr_at_20_diff1
            value: 46.50275775113446
          - type: nauc_mrr_at_20_max
            value: 33.58865514759019
          - type: nauc_mrr_at_20_std
            value: -7.570114941791467
          - type: nauc_mrr_at_3_diff1
            value: 46.89503971128471
          - type: nauc_mrr_at_3_max
            value: 33.496560503226625
          - type: nauc_mrr_at_3_std
            value: -8.210558822386304
          - type: nauc_mrr_at_5_diff1
            value: 46.52472719918368
          - type: nauc_mrr_at_5_max
            value: 33.47000614361767
          - type: nauc_mrr_at_5_std
            value: -8.047294277050185
          - type: nauc_ndcg_at_1000_diff1
            value: 45.952224716482064
          - type: nauc_ndcg_at_1000_max
            value: 33.55951998008019
          - type: nauc_ndcg_at_1000_std
            value: -6.526593883643845
          - type: nauc_ndcg_at_100_diff1
            value: 45.6076817241719
          - type: nauc_ndcg_at_100_max
            value: 33.56351746928194
          - type: nauc_ndcg_at_100_std
            value: -6.2577955941610375
          - type: nauc_ndcg_at_10_diff1
            value: 45.49263554465489
          - type: nauc_ndcg_at_10_max
            value: 32.64126996617623
          - type: nauc_ndcg_at_10_std
            value: -8.742955252041423
          - type: nauc_ndcg_at_1_diff1
            value: 50.92937737651317
          - type: nauc_ndcg_at_1_max
            value: 32.9507362296752
          - type: nauc_ndcg_at_1_std
            value: -8.423238646208265
          - type: nauc_ndcg_at_20_diff1
            value: 45.4342115120439
          - type: nauc_ndcg_at_20_max
            value: 33.104622212270726
          - type: nauc_ndcg_at_20_std
            value: -7.483803415235951
          - type: nauc_ndcg_at_3_diff1
            value: 46.31897453421016
          - type: nauc_ndcg_at_3_max
            value: 32.28721923806247
          - type: nauc_ndcg_at_3_std
            value: -9.54172365718084
          - type: nauc_ndcg_at_5_diff1
            value: 45.70298606925981
          - type: nauc_ndcg_at_5_max
            value: 32.261906390761105
          - type: nauc_ndcg_at_5_std
            value: -9.399257100607874
          - type: nauc_precision_at_1000_diff1
            value: -11.364874438217843
          - type: nauc_precision_at_1000_max
            value: 4.301890425063193
          - type: nauc_precision_at_1000_std
            value: 15.855742716005356
          - type: nauc_precision_at_100_diff1
            value: -4.982324099155143
          - type: nauc_precision_at_100_max
            value: 13.642061594719774
          - type: nauc_precision_at_100_std
            value: 18.81929325056801
          - type: nauc_precision_at_10_diff1
            value: 12.638394408088926
          - type: nauc_precision_at_10_max
            value: 25.306846945633808
          - type: nauc_precision_at_10_std
            value: 6.594949743766334
          - type: nauc_precision_at_1_diff1
            value: 50.92937737651317
          - type: nauc_precision_at_1_max
            value: 32.9507362296752
          - type: nauc_precision_at_1_std
            value: -8.423238646208265
          - type: nauc_precision_at_20_diff1
            value: 6.16872699781517
          - type: nauc_precision_at_20_max
            value: 22.181315927006374
          - type: nauc_precision_at_20_std
            value: 12.56367756338886
          - type: nauc_precision_at_3_diff1
            value: 28.83807305490845
          - type: nauc_precision_at_3_max
            value: 31.389218193103215
          - type: nauc_precision_at_3_std
            value: -1.896026766564083
          - type: nauc_precision_at_5_diff1
            value: 20.77453603262145
          - type: nauc_precision_at_5_max
            value: 28.91019461637974
          - type: nauc_precision_at_5_std
            value: 1.6398138794154224
          - type: nauc_recall_at_1000_diff1
            value: 32.58030229927583
          - type: nauc_recall_at_1000_max
            value: 51.575385962899944
          - type: nauc_recall_at_1000_std
            value: 42.279175457257395
          - type: nauc_recall_at_100_diff1
            value: 33.0346354270252
          - type: nauc_recall_at_100_max
            value: 37.59086973079201
          - type: nauc_recall_at_100_std
            value: 14.114518949779974
          - type: nauc_recall_at_10_diff1
            value: 37.76688949788438
          - type: nauc_recall_at_10_max
            value: 30.957649538205224
          - type: nauc_recall_at_10_std
            value: -7.51989142903617
          - type: nauc_recall_at_1_diff1
            value: 52.959829481566764
          - type: nauc_recall_at_1_max
            value: 28.644143760250785
          - type: nauc_recall_at_1_std
            value: -11.72163597077123
          - type: nauc_recall_at_20_diff1
            value: 36.1678225571237
          - type: nauc_recall_at_20_max
            value: 32.77154289601683
          - type: nauc_recall_at_20_std
            value: -1.4627763691409723
          - type: nauc_recall_at_3_diff1
            value: 42.36573375194426
          - type: nauc_recall_at_3_max
            value: 29.836155630039997
          - type: nauc_recall_at_3_std
            value: -10.921190546010779
          - type: nauc_recall_at_5_diff1
            value: 39.78782895608393
          - type: nauc_recall_at_5_max
            value: 29.974729083162995
          - type: nauc_recall_at_5_std
            value: -9.914213193369637
          - type: ndcg_at_1
            value: 37.584833333333336
          - type: ndcg_at_10
            value: 49.35933333333333
          - type: ndcg_at_100
            value: 54.516083333333334
          - type: ndcg_at_1000
            value: 56.13400000000001
          - type: ndcg_at_20
            value: 51.47983333333334
          - type: ndcg_at_3
            value: 43.94075
          - type: ndcg_at_5
            value: 46.43991666666667
          - type: precision_at_1
            value: 37.584833333333336
          - type: precision_at_10
            value: 8.754333333333332
          - type: precision_at_100
            value: 1.3438333333333334
          - type: precision_at_1000
            value: 0.16591666666666666
          - type: precision_at_20
            value: 5.135833333333332
          - type: precision_at_3
            value: 20.47383333333333
          - type: precision_at_5
            value: 14.480333333333334
          - type: recall_at_1
            value: 31.5475
          - type: recall_at_10
            value: 62.99808333333332
          - type: recall_at_100
            value: 85.16766666666666
          - type: recall_at_1000
            value: 95.88949999999998
          - type: recall_at_20
            value: 70.61158333333333
          - type: recall_at_3
            value: 47.78208333333333
          - type: recall_at_5
            value: 54.30466666666667
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackUnixRetrieval
          revision: 6c6430d3a6d36f8d2a829195bc5dc94d7e063e53
          split: test
          type: mteb/cqadupstack-unix
        metrics:
          - type: main_score
            value: 51.409000000000006
          - type: map_at_1
            value: 33.44
          - type: map_at_10
            value: 45.242
          - type: map_at_100
            value: 46.457
          - type: map_at_1000
            value: 46.539
          - type: map_at_20
            value: 45.928999999999995
          - type: map_at_3
            value: 41.736000000000004
          - type: map_at_5
            value: 43.717
          - type: mrr_at_1
            value: 39.17910447761194
          - type: mrr_at_10
            value: 49.54868514570004
          - type: mrr_at_100
            value: 50.31474300711142
          - type: mrr_at_1000
            value: 50.35763716395954
          - type: mrr_at_20
            value: 49.99823659223059
          - type: mrr_at_3
            value: 46.8128109452736
          - type: mrr_at_5
            value: 48.45926616915417
          - type: nauc_map_at_1000_diff1
            value: 50.87257673340992
          - type: nauc_map_at_1000_max
            value: 40.34609374301027
          - type: nauc_map_at_1000_std
            value: -7.379981243726618
          - type: nauc_map_at_100_diff1
            value: 50.854157949159365
          - type: nauc_map_at_100_max
            value: 40.34032556006189
          - type: nauc_map_at_100_std
            value: -7.399964737756573
          - type: nauc_map_at_10_diff1
            value: 50.686246859628525
          - type: nauc_map_at_10_max
            value: 39.908128766187275
          - type: nauc_map_at_10_std
            value: -7.7328502513278625
          - type: nauc_map_at_1_diff1
            value: 55.57814128760479
          - type: nauc_map_at_1_max
            value: 38.478658985510826
          - type: nauc_map_at_1_std
            value: -6.372508238481584
          - type: nauc_map_at_20_diff1
            value: 50.772989231947626
          - type: nauc_map_at_20_max
            value: 40.23956514712802
          - type: nauc_map_at_20_std
            value: -7.514568627968219
          - type: nauc_map_at_3_diff1
            value: 52.014664217088544
          - type: nauc_map_at_3_max
            value: 39.734083375309915
          - type: nauc_map_at_3_std
            value: -7.926554803796402
          - type: nauc_map_at_5_diff1
            value: 51.01483620986479
          - type: nauc_map_at_5_max
            value: 39.45610862159722
          - type: nauc_map_at_5_std
            value: -8.27731392985267
          - type: nauc_mrr_at_1000_diff1
            value: 51.00481391598901
          - type: nauc_mrr_at_1000_max
            value: 42.212066475020265
          - type: nauc_mrr_at_1000_std
            value: -6.370874800186104
          - type: nauc_mrr_at_100_diff1
            value: 50.990520232150246
          - type: nauc_mrr_at_100_max
            value: 42.19016027339401
          - type: nauc_mrr_at_100_std
            value: -6.3827695296657145
          - type: nauc_mrr_at_10_diff1
            value: 50.744688903224954
          - type: nauc_mrr_at_10_max
            value: 42.11767789677446
          - type: nauc_mrr_at_10_std
            value: -6.497082850925394
          - type: nauc_mrr_at_1_diff1
            value: 55.54795613882778
          - type: nauc_mrr_at_1_max
            value: 43.333268044897565
          - type: nauc_mrr_at_1_std
            value: -5.456284327113586
          - type: nauc_mrr_at_20_diff1
            value: 50.8946692657115
          - type: nauc_mrr_at_20_max
            value: 42.131007988181466
          - type: nauc_mrr_at_20_std
            value: -6.474403898884448
          - type: nauc_mrr_at_3_diff1
            value: 51.41122299252956
          - type: nauc_mrr_at_3_max
            value: 42.43303267211499
          - type: nauc_mrr_at_3_std
            value: -6.499097476761323
          - type: nauc_mrr_at_5_diff1
            value: 50.94067629188639
          - type: nauc_mrr_at_5_max
            value: 41.914612395133574
          - type: nauc_mrr_at_5_std
            value: -7.173024101198252
          - type: nauc_ndcg_at_1000_diff1
            value: 49.671254442063336
          - type: nauc_ndcg_at_1000_max
            value: 41.233236425229265
          - type: nauc_ndcg_at_1000_std
            value: -5.974613943524345
          - type: nauc_ndcg_at_100_diff1
            value: 49.27027768005878
          - type: nauc_ndcg_at_100_max
            value: 40.948430026662564
          - type: nauc_ndcg_at_100_std
            value: -6.144610616966986
          - type: nauc_ndcg_at_10_diff1
            value: 48.558081201050165
          - type: nauc_ndcg_at_10_max
            value: 39.83487109315805
          - type: nauc_ndcg_at_10_std
            value: -7.615747684830626
          - type: nauc_ndcg_at_1_diff1
            value: 55.54795613882778
          - type: nauc_ndcg_at_1_max
            value: 43.333268044897565
          - type: nauc_ndcg_at_1_std
            value: -5.456284327113586
          - type: nauc_ndcg_at_20_diff1
            value: 48.892103792460844
          - type: nauc_ndcg_at_20_max
            value: 40.56965396855626
          - type: nauc_ndcg_at_20_std
            value: -7.033583531769024
          - type: nauc_ndcg_at_3_diff1
            value: 49.89643618093189
          - type: nauc_ndcg_at_3_max
            value: 40.22963794071276
          - type: nauc_ndcg_at_3_std
            value: -7.855589248597761
          - type: nauc_ndcg_at_5_diff1
            value: 48.921894655198365
          - type: nauc_ndcg_at_5_max
            value: 39.14662005574934
          - type: nauc_ndcg_at_5_std
            value: -8.845551763577872
          - type: nauc_precision_at_1000_diff1
            value: -14.518585158460978
          - type: nauc_precision_at_1000_max
            value: -1.7667784893915466
          - type: nauc_precision_at_1000_std
            value: 4.097998545067049
          - type: nauc_precision_at_100_diff1
            value: -4.950584630399553
          - type: nauc_precision_at_100_max
            value: 11.512730083218312
          - type: nauc_precision_at_100_std
            value: 6.330359665958284
          - type: nauc_precision_at_10_diff1
            value: 13.399849359324334
          - type: nauc_precision_at_10_max
            value: 26.855775987033937
          - type: nauc_precision_at_10_std
            value: -2.2873353847128644
          - type: nauc_precision_at_1_diff1
            value: 55.54795613882778
          - type: nauc_precision_at_1_max
            value: 43.333268044897565
          - type: nauc_precision_at_1_std
            value: -5.456284327113586
          - type: nauc_precision_at_20_diff1
            value: 7.679011471251583
          - type: nauc_precision_at_20_max
            value: 23.467700358632555
          - type: nauc_precision_at_20_std
            value: 1.1981871681272394
          - type: nauc_precision_at_3_diff1
            value: 32.921575397699506
          - type: nauc_precision_at_3_max
            value: 37.04097281242502
          - type: nauc_precision_at_3_std
            value: -5.360800309380987
          - type: nauc_precision_at_5_diff1
            value: 23.223401114141097
          - type: nauc_precision_at_5_max
            value: 31.530032692944605
          - type: nauc_precision_at_5_std
            value: -5.865853042470798
          - type: nauc_recall_at_1000_diff1
            value: 32.0155855987812
          - type: nauc_recall_at_1000_max
            value: 62.44988003291033
          - type: nauc_recall_at_1000_std
            value: 53.82320454819172
          - type: nauc_recall_at_100_diff1
            value: 36.65083199031551
          - type: nauc_recall_at_100_max
            value: 37.69410771344005
          - type: nauc_recall_at_100_std
            value: 3.579296637477123
          - type: nauc_recall_at_10_diff1
            value: 38.70173468166519
          - type: nauc_recall_at_10_max
            value: 34.1784276048144
          - type: nauc_recall_at_10_std
            value: -8.086019685277327
          - type: nauc_recall_at_1_diff1
            value: 55.57814128760479
          - type: nauc_recall_at_1_max
            value: 38.478658985510826
          - type: nauc_recall_at_1_std
            value: -6.372508238481584
          - type: nauc_recall_at_20_diff1
            value: 38.79450347259083
          - type: nauc_recall_at_20_max
            value: 36.05352697027188
          - type: nauc_recall_at_20_std
            value: -6.093850431049945
          - type: nauc_recall_at_3_diff1
            value: 45.74158065265736
          - type: nauc_recall_at_3_max
            value: 36.63626821782645
          - type: nauc_recall_at_3_std
            value: -9.653958457056982
          - type: nauc_recall_at_5_diff1
            value: 41.65880696047371
          - type: nauc_recall_at_5_max
            value: 33.8382122882109
          - type: nauc_recall_at_5_std
            value: -11.20106963946605
          - type: ndcg_at_1
            value: 39.179
          - type: ndcg_at_10
            value: 51.409000000000006
          - type: ndcg_at_100
            value: 56.499
          - type: ndcg_at_1000
            value: 58.062000000000005
          - type: ndcg_at_20
            value: 53.454
          - type: ndcg_at_3
            value: 45.754
          - type: ndcg_at_5
            value: 48.463
          - type: precision_at_1
            value: 39.179
          - type: precision_at_10
            value: 8.806
          - type: precision_at_100
            value: 1.2550000000000001
          - type: precision_at_1000
            value: 0.149
          - type: precision_at_20
            value: 5.009
          - type: precision_at_3
            value: 21.144
          - type: precision_at_5
            value: 14.832
          - type: recall_at_1
            value: 33.44
          - type: recall_at_10
            value: 65.496
          - type: recall_at_100
            value: 87.182
          - type: recall_at_1000
            value: 97.357
          - type: recall_at_20
            value: 72.697
          - type: recall_at_3
            value: 49.924
          - type: recall_at_5
            value: 56.95
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackWebmastersRetrieval
          revision: 160c094312a0e1facb97e55eeddb698c0abe3571
          split: test
          type: mteb/cqadupstack-webmasters
        metrics:
          - type: main_score
            value: 48.375
          - type: map_at_1
            value: 30.793
          - type: map_at_10
            value: 41.662
          - type: map_at_100
            value: 43.66
          - type: map_at_1000
            value: 43.878
          - type: map_at_20
            value: 42.667
          - type: map_at_3
            value: 38.458999999999996
          - type: map_at_5
            value: 39.97
          - type: mrr_at_1
            value: 37.15415019762846
          - type: mrr_at_10
            value: 46.61584792019573
          - type: mrr_at_100
            value: 47.583978313689805
          - type: mrr_at_1000
            value: 47.61436921649715
          - type: mrr_at_20
            value: 47.16104598393294
          - type: mrr_at_3
            value: 44.23583662714098
          - type: mrr_at_5
            value: 45.29314888010541
          - type: nauc_map_at_1000_diff1
            value: 50.738532964091355
          - type: nauc_map_at_1000_max
            value: 33.1761869184962
          - type: nauc_map_at_1000_std
            value: -11.88545399582968
          - type: nauc_map_at_100_diff1
            value: 50.820635857587945
          - type: nauc_map_at_100_max
            value: 33.37659274306262
          - type: nauc_map_at_100_std
            value: -12.261098317018648
          - type: nauc_map_at_10_diff1
            value: 51.34955861172913
          - type: nauc_map_at_10_max
            value: 33.07036272698984
          - type: nauc_map_at_10_std
            value: -13.958268441726652
          - type: nauc_map_at_1_diff1
            value: 58.14264885967374
          - type: nauc_map_at_1_max
            value: 31.098191422332405
          - type: nauc_map_at_1_std
            value: -16.55201181770837
          - type: nauc_map_at_20_diff1
            value: 51.138925497848945
          - type: nauc_map_at_20_max
            value: 33.294483331998656
          - type: nauc_map_at_20_std
            value: -13.386238751309648
          - type: nauc_map_at_3_diff1
            value: 53.11933171962268
          - type: nauc_map_at_3_max
            value: 33.174584991640856
          - type: nauc_map_at_3_std
            value: -15.227875860055217
          - type: nauc_map_at_5_diff1
            value: 51.91013458222077
          - type: nauc_map_at_5_max
            value: 33.432034239350386
          - type: nauc_map_at_5_std
            value: -14.493952556516101
          - type: nauc_mrr_at_1000_diff1
            value: 49.46380145346334
          - type: nauc_mrr_at_1000_max
            value: 32.79378116341429
          - type: nauc_mrr_at_1000_std
            value: -10.714169233380185
          - type: nauc_mrr_at_100_diff1
            value: 49.45394564674785
          - type: nauc_mrr_at_100_max
            value: 32.7943550676381
          - type: nauc_mrr_at_100_std
            value: -10.696490620685783
          - type: nauc_mrr_at_10_diff1
            value: 49.500335538737914
          - type: nauc_mrr_at_10_max
            value: 32.77023244114561
          - type: nauc_mrr_at_10_std
            value: -11.104541089359515
          - type: nauc_mrr_at_1_diff1
            value: 52.76130402864484
          - type: nauc_mrr_at_1_max
            value: 31.114589410052044
          - type: nauc_mrr_at_1_std
            value: -12.937210710275965
          - type: nauc_mrr_at_20_diff1
            value: 49.414643398815365
          - type: nauc_mrr_at_20_max
            value: 32.763780752203516
          - type: nauc_mrr_at_20_std
            value: -10.804422561377299
          - type: nauc_mrr_at_3_diff1
            value: 50.01492870108368
          - type: nauc_mrr_at_3_max
            value: 32.72937861591098
          - type: nauc_mrr_at_3_std
            value: -11.940075063628994
          - type: nauc_mrr_at_5_diff1
            value: 49.48188504874961
          - type: nauc_mrr_at_5_max
            value: 33.16403773206102
          - type: nauc_mrr_at_5_std
            value: -11.21411630948482
          - type: nauc_ndcg_at_1000_diff1
            value: 48.54198944308599
          - type: nauc_ndcg_at_1000_max
            value: 33.76118694493479
          - type: nauc_ndcg_at_1000_std
            value: -8.65402138092725
          - type: nauc_ndcg_at_100_diff1
            value: 48.108850696506025
          - type: nauc_ndcg_at_100_max
            value: 33.84243712166641
          - type: nauc_ndcg_at_100_std
            value: -8.254554667297844
          - type: nauc_ndcg_at_10_diff1
            value: 47.89236428952843
          - type: nauc_ndcg_at_10_max
            value: 31.812029093395473
          - type: nauc_ndcg_at_10_std
            value: -11.127378110447985
          - type: nauc_ndcg_at_1_diff1
            value: 52.76130402864484
          - type: nauc_ndcg_at_1_max
            value: 31.114589410052044
          - type: nauc_ndcg_at_1_std
            value: -12.937210710275965
          - type: nauc_ndcg_at_20_diff1
            value: 47.905767671630315
          - type: nauc_ndcg_at_20_max
            value: 32.49208823548766
          - type: nauc_ndcg_at_20_std
            value: -10.250570357659894
          - type: nauc_ndcg_at_3_diff1
            value: 49.59377768692143
          - type: nauc_ndcg_at_3_max
            value: 33.13546546596274
          - type: nauc_ndcg_at_3_std
            value: -12.19125595753908
          - type: nauc_ndcg_at_5_diff1
            value: 48.35844341475799
          - type: nauc_ndcg_at_5_max
            value: 33.13927657899762
          - type: nauc_ndcg_at_5_std
            value: -11.300005449965582
          - type: nauc_precision_at_1000_diff1
            value: -16.480026591870523
          - type: nauc_precision_at_1000_max
            value: -15.181621988935524
          - type: nauc_precision_at_1000_std
            value: 34.719339551334855
          - type: nauc_precision_at_100_diff1
            value: -16.56707264200106
          - type: nauc_precision_at_100_max
            value: -6.877547823040516
          - type: nauc_precision_at_100_std
            value: 31.758215821939384
          - type: nauc_precision_at_10_diff1
            value: 4.772949413625673
          - type: nauc_precision_at_10_max
            value: 14.48563506451036
          - type: nauc_precision_at_10_std
            value: 12.151171571697414
          - type: nauc_precision_at_1_diff1
            value: 52.76130402864484
          - type: nauc_precision_at_1_max
            value: 31.114589410052044
          - type: nauc_precision_at_1_std
            value: -12.937210710275965
          - type: nauc_precision_at_20_diff1
            value: -5.247617701441084
          - type: nauc_precision_at_20_max
            value: 7.8524153059071065
          - type: nauc_precision_at_20_std
            value: 20.475057466275427
          - type: nauc_precision_at_3_diff1
            value: 29.307240726725464
          - type: nauc_precision_at_3_max
            value: 30.53776235029683
          - type: nauc_precision_at_3_std
            value: -1.9867363754853145
          - type: nauc_precision_at_5_diff1
            value: 16.82602124982839
          - type: nauc_precision_at_5_max
            value: 24.967617984133213
          - type: nauc_precision_at_5_std
            value: 3.7688940286519914
          - type: nauc_recall_at_1000_diff1
            value: 19.911102783538993
          - type: nauc_recall_at_1000_max
            value: 43.55994274840259
          - type: nauc_recall_at_1000_std
            value: 44.61688663280485
          - type: nauc_recall_at_100_diff1
            value: 25.00639435271183
          - type: nauc_recall_at_100_max
            value: 34.51865414347991
          - type: nauc_recall_at_100_std
            value: 18.406464007769454
          - type: nauc_recall_at_10_diff1
            value: 38.62687941260691
          - type: nauc_recall_at_10_max
            value: 27.489917928538553
          - type: nauc_recall_at_10_std
            value: -10.35234915862916
          - type: nauc_recall_at_1_diff1
            value: 58.14264885967374
          - type: nauc_recall_at_1_max
            value: 31.098191422332405
          - type: nauc_recall_at_1_std
            value: -16.55201181770837
          - type: nauc_recall_at_20_diff1
            value: 35.11800106234923
          - type: nauc_recall_at_20_max
            value: 28.356707989534385
          - type: nauc_recall_at_20_std
            value: -5.782361862032475
          - type: nauc_recall_at_3_diff1
            value: 47.010690556838405
          - type: nauc_recall_at_3_max
            value: 30.960698559313798
          - type: nauc_recall_at_3_std
            value: -14.716248620617172
          - type: nauc_recall_at_5_diff1
            value: 42.9526068288436
          - type: nauc_recall_at_5_max
            value: 31.419778612165533
          - type: nauc_recall_at_5_std
            value: -11.818424254829178
          - type: ndcg_at_1
            value: 37.153999999999996
          - type: ndcg_at_10
            value: 48.375
          - type: ndcg_at_100
            value: 54.657
          - type: ndcg_at_1000
            value: 56.208000000000006
          - type: ndcg_at_20
            value: 50.771
          - type: ndcg_at_3
            value: 43.315
          - type: ndcg_at_5
            value: 45.129000000000005
          - type: precision_at_1
            value: 37.153999999999996
          - type: precision_at_10
            value: 9.328
          - type: precision_at_100
            value: 1.9029999999999998
          - type: precision_at_1000
            value: 0.258
          - type: precision_at_20
            value: 5.998
          - type: precision_at_3
            value: 20.224
          - type: precision_at_5
            value: 14.347999999999999
          - type: recall_at_1
            value: 30.793
          - type: recall_at_10
            value: 60.999
          - type: recall_at_100
            value: 88.24499999999999
          - type: recall_at_1000
            value: 97.773
          - type: recall_at_20
            value: 69.702
          - type: recall_at_3
            value: 46.255
          - type: recall_at_5
            value: 51.245
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB CQADupstackWordpressRetrieval
          revision: 4ffe81d471b1924886b33c7567bfb200e9eec5c4
          split: test
          type: mteb/cqadupstack-wordpress
        metrics:
          - type: main_score
            value: 41.349000000000004
          - type: map_at_1
            value: 26.75
          - type: map_at_10
            value: 36.042
          - type: map_at_100
            value: 37.172
          - type: map_at_1000
            value: 37.261
          - type: map_at_20
            value: 36.66
          - type: map_at_3
            value: 33.235
          - type: map_at_5
            value: 34.748000000000005
          - type: mrr_at_1
            value: 29.390018484288355
          - type: mrr_at_10
            value: 38.4025760643136
          - type: mrr_at_100
            value: 39.374703522095395
          - type: mrr_at_1000
            value: 39.42972569352847
          - type: mrr_at_20
            value: 38.93955238768051
          - type: mrr_at_3
            value: 36.013555144793614
          - type: mrr_at_5
            value: 37.2520024645718
          - type: nauc_map_at_1000_diff1
            value: 44.69823016014606
          - type: nauc_map_at_1000_max
            value: 25.57190426738162
          - type: nauc_map_at_1000_std
            value: -4.199140067047161
          - type: nauc_map_at_100_diff1
            value: 44.683770406187875
          - type: nauc_map_at_100_max
            value: 25.551408403995257
          - type: nauc_map_at_100_std
            value: -4.218572010835323
          - type: nauc_map_at_10_diff1
            value: 44.68530737786573
          - type: nauc_map_at_10_max
            value: 25.46193155573604
          - type: nauc_map_at_10_std
            value: -4.809871031910446
          - type: nauc_map_at_1_diff1
            value: 50.41571355104115
          - type: nauc_map_at_1_max
            value: 26.581260847509704
          - type: nauc_map_at_1_std
            value: -5.403238214693907
          - type: nauc_map_at_20_diff1
            value: 44.731965188076956
          - type: nauc_map_at_20_max
            value: 25.404018335678042
          - type: nauc_map_at_20_std
            value: -4.518115190513196
          - type: nauc_map_at_3_diff1
            value: 45.72733737454689
          - type: nauc_map_at_3_max
            value: 25.16236634356437
          - type: nauc_map_at_3_std
            value: -5.210810848188912
          - type: nauc_map_at_5_diff1
            value: 45.04362118675467
          - type: nauc_map_at_5_max
            value: 25.256832347187792
          - type: nauc_map_at_5_std
            value: -4.665177712989629
          - type: nauc_mrr_at_1000_diff1
            value: 43.96570681453743
          - type: nauc_mrr_at_1000_max
            value: 25.515577482173303
          - type: nauc_mrr_at_1000_std
            value: -3.1318312163116167
          - type: nauc_mrr_at_100_diff1
            value: 43.94835648436942
          - type: nauc_mrr_at_100_max
            value: 25.485710237620257
          - type: nauc_mrr_at_100_std
            value: -3.1262634160182587
          - type: nauc_mrr_at_10_diff1
            value: 43.87989114303318
          - type: nauc_mrr_at_10_max
            value: 25.561703958752073
          - type: nauc_mrr_at_10_std
            value: -3.5337096979285465
          - type: nauc_mrr_at_1_diff1
            value: 50.5769748938826
          - type: nauc_mrr_at_1_max
            value: 27.540216184434602
          - type: nauc_mrr_at_1_std
            value: -4.3410331054744455
          - type: nauc_mrr_at_20_diff1
            value: 43.89090600752474
          - type: nauc_mrr_at_20_max
            value: 25.35538914450936
          - type: nauc_mrr_at_20_std
            value: -3.256848712300088
          - type: nauc_mrr_at_3_diff1
            value: 44.67145787977651
          - type: nauc_mrr_at_3_max
            value: 25.743032202078233
          - type: nauc_mrr_at_3_std
            value: -3.543961143296222
          - type: nauc_mrr_at_5_diff1
            value: 44.1410906123774
          - type: nauc_mrr_at_5_max
            value: 25.512981453020377
          - type: nauc_mrr_at_5_std
            value: -3.3984260964459625
          - type: nauc_ndcg_at_1000_diff1
            value: 42.094467874822634
          - type: nauc_ndcg_at_1000_max
            value: 25.773789329652143
          - type: nauc_ndcg_at_1000_std
            value: -1.5030137154663146
          - type: nauc_ndcg_at_100_diff1
            value: 41.551311444176505
          - type: nauc_ndcg_at_100_max
            value: 25.41326272306838
          - type: nauc_ndcg_at_100_std
            value: -1.2565322587434289
          - type: nauc_ndcg_at_10_diff1
            value: 41.692329741760844
          - type: nauc_ndcg_at_10_max
            value: 24.973824605697946
          - type: nauc_ndcg_at_10_std
            value: -4.0454407772294445
          - type: nauc_ndcg_at_1_diff1
            value: 50.5769748938826
          - type: nauc_ndcg_at_1_max
            value: 27.540216184434602
          - type: nauc_ndcg_at_1_std
            value: -4.3410331054744455
          - type: nauc_ndcg_at_20_diff1
            value: 41.7849741522554
          - type: nauc_ndcg_at_20_max
            value: 24.483461844450098
          - type: nauc_ndcg_at_20_std
            value: -3.0192185885852267
          - type: nauc_ndcg_at_3_diff1
            value: 43.50095372671906
          - type: nauc_ndcg_at_3_max
            value: 25.0660548267931
          - type: nauc_ndcg_at_3_std
            value: -4.136658038209795
          - type: nauc_ndcg_at_5_diff1
            value: 42.56860328119003
          - type: nauc_ndcg_at_5_max
            value: 24.64471019866571
          - type: nauc_ndcg_at_5_std
            value: -3.7919812365370316
          - type: nauc_precision_at_1000_diff1
            value: -11.608868871826067
          - type: nauc_precision_at_1000_max
            value: -4.774237268127937
          - type: nauc_precision_at_1000_std
            value: 12.15076818010773
          - type: nauc_precision_at_100_diff1
            value: 1.9653391598989818
          - type: nauc_precision_at_100_max
            value: 14.82175127203874
          - type: nauc_precision_at_100_std
            value: 19.14581435930739
          - type: nauc_precision_at_10_diff1
            value: 24.310184596872997
          - type: nauc_precision_at_10_max
            value: 24.654364730313127
          - type: nauc_precision_at_10_std
            value: 3.834736733208166
          - type: nauc_precision_at_1_diff1
            value: 50.5769748938826
          - type: nauc_precision_at_1_max
            value: 27.540216184434602
          - type: nauc_precision_at_1_std
            value: -4.3410331054744455
          - type: nauc_precision_at_20_diff1
            value: 20.31741982412239
          - type: nauc_precision_at_20_max
            value: 21.813185907394
          - type: nauc_precision_at_20_std
            value: 8.67748469930042
          - type: nauc_precision_at_3_diff1
            value: 36.23426146022416
          - type: nauc_precision_at_3_max
            value: 25.085104352996147
          - type: nauc_precision_at_3_std
            value: -0.13994055865810526
          - type: nauc_precision_at_5_diff1
            value: 30.713670782259456
          - type: nauc_precision_at_5_max
            value: 25.073465240016198
          - type: nauc_precision_at_5_std
            value: 2.903773154373253
          - type: nauc_recall_at_1000_diff1
            value: 14.861338959184192
          - type: nauc_recall_at_1000_max
            value: 38.46379100413754
          - type: nauc_recall_at_1000_std
            value: 40.82683088866469
          - type: nauc_recall_at_100_diff1
            value: 24.540319510278348
          - type: nauc_recall_at_100_max
            value: 24.172628109630832
          - type: nauc_recall_at_100_std
            value: 16.567712965914602
          - type: nauc_recall_at_10_diff1
            value: 31.92224903523137
          - type: nauc_recall_at_10_max
            value: 22.064974975663127
          - type: nauc_recall_at_10_std
            value: -3.156058361445988
          - type: nauc_recall_at_1_diff1
            value: 50.41571355104115
          - type: nauc_recall_at_1_max
            value: 26.581260847509704
          - type: nauc_recall_at_1_std
            value: -5.403238214693907
          - type: nauc_recall_at_20_diff1
            value: 31.409257808669842
          - type: nauc_recall_at_20_max
            value: 19.307470123424853
          - type: nauc_recall_at_20_std
            value: 0.8921848838324672
          - type: nauc_recall_at_3_diff1
            value: 37.83159917842702
          - type: nauc_recall_at_3_max
            value: 22.128986921876365
          - type: nauc_recall_at_3_std
            value: -4.332761965568785
          - type: nauc_recall_at_5_diff1
            value: 35.43509187423654
          - type: nauc_recall_at_5_max
            value: 21.559603832786657
          - type: nauc_recall_at_5_std
            value: -2.7879479079841327
          - type: ndcg_at_1
            value: 29.39
          - type: ndcg_at_10
            value: 41.349000000000004
          - type: ndcg_at_100
            value: 46.814
          - type: ndcg_at_1000
            value: 48.748000000000005
          - type: ndcg_at_20
            value: 43.491
          - type: ndcg_at_3
            value: 36.120000000000005
          - type: ndcg_at_5
            value: 38.415
          - type: precision_at_1
            value: 29.39
          - type: precision_at_10
            value: 6.451
          - type: precision_at_100
            value: 0.991
          - type: precision_at_1000
            value: 0.128
          - type: precision_at_20
            value: 3.762
          - type: precision_at_3
            value: 15.588
          - type: precision_at_5
            value: 10.795
          - type: recall_at_1
            value: 26.75
          - type: recall_at_10
            value: 55.397
          - type: recall_at_100
            value: 80.247
          - type: recall_at_1000
            value: 94.207
          - type: recall_at_20
            value: 63.55499999999999
          - type: recall_at_3
            value: 41.083999999999996
          - type: recall_at_5
            value: 46.58
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB ClimateFEVER
          revision: 47f2ac6acb640fc46020b02a5b59fdda04d39380
          split: test
          type: mteb/climate-fever
        metrics:
          - type: main_score
            value: 43.469
          - type: map_at_1
            value: 19.506999999999998
          - type: map_at_10
            value: 33.016
          - type: map_at_100
            value: 35.36
          - type: map_at_1000
            value: 35.515
          - type: map_at_20
            value: 34.323
          - type: map_at_3
            value: 27.862
          - type: map_at_5
            value: 30.612000000000002
          - type: mrr_at_1
            value: 44.16938110749186
          - type: mrr_at_10
            value: 56.57685745307904
          - type: mrr_at_100
            value: 57.17414254225016
          - type: mrr_at_1000
            value: 57.189032189089495
          - type: mrr_at_20
            value: 56.97649801229595
          - type: mrr_at_3
            value: 53.84364820846914
          - type: mrr_at_5
            value: 55.55048859934868
          - type: nauc_map_at_1000_diff1
            value: 24.602536884273523
          - type: nauc_map_at_1000_max
            value: 39.26487354477874
          - type: nauc_map_at_1000_std
            value: 22.94302438231403
          - type: nauc_map_at_100_diff1
            value: 24.592347616537754
          - type: nauc_map_at_100_max
            value: 39.228370594048044
          - type: nauc_map_at_100_std
            value: 22.91028538467064
          - type: nauc_map_at_10_diff1
            value: 25.211737206439466
          - type: nauc_map_at_10_max
            value: 39.14645027724652
          - type: nauc_map_at_10_std
            value: 21.645361248764246
          - type: nauc_map_at_1_diff1
            value: 34.574022172223785
          - type: nauc_map_at_1_max
            value: 36.80960969907521
          - type: nauc_map_at_1_std
            value: 14.745037917509043
          - type: nauc_map_at_20_diff1
            value: 24.522877050053797
          - type: nauc_map_at_20_max
            value: 39.059341666216426
          - type: nauc_map_at_20_std
            value: 22.4609918713542
          - type: nauc_map_at_3_diff1
            value: 27.15813672283225
          - type: nauc_map_at_3_max
            value: 38.14947129547116
          - type: nauc_map_at_3_std
            value: 18.37694411131855
          - type: nauc_map_at_5_diff1
            value: 26.3963128622898
          - type: nauc_map_at_5_max
            value: 38.79462114513801
          - type: nauc_map_at_5_std
            value: 19.904846635683718
          - type: nauc_mrr_at_1000_diff1
            value: 24.390212975354274
          - type: nauc_mrr_at_1000_max
            value: 37.575264384207465
          - type: nauc_mrr_at_1000_std
            value: 22.607616532255875
          - type: nauc_mrr_at_100_diff1
            value: 24.38096540780017
          - type: nauc_mrr_at_100_max
            value: 37.585671997802656
          - type: nauc_mrr_at_100_std
            value: 22.625502455820666
          - type: nauc_mrr_at_10_diff1
            value: 24.240023464772193
          - type: nauc_mrr_at_10_max
            value: 37.624380443643524
          - type: nauc_mrr_at_10_std
            value: 22.694399526110466
          - type: nauc_mrr_at_1_diff1
            value: 28.020125669466562
          - type: nauc_mrr_at_1_max
            value: 34.02386180115898
          - type: nauc_mrr_at_1_std
            value: 17.835724317244686
          - type: nauc_mrr_at_20_diff1
            value: 24.333355652108292
          - type: nauc_mrr_at_20_max
            value: 37.57796475058575
          - type: nauc_mrr_at_20_std
            value: 22.704917335783062
          - type: nauc_mrr_at_3_diff1
            value: 24.9739147862957
          - type: nauc_mrr_at_3_max
            value: 37.960296534359685
          - type: nauc_mrr_at_3_std
            value: 21.93607347433575
          - type: nauc_mrr_at_5_diff1
            value: 24.320129475684165
          - type: nauc_mrr_at_5_max
            value: 37.58866607632526
          - type: nauc_mrr_at_5_std
            value: 22.31442317668481
          - type: nauc_ndcg_at_1000_diff1
            value: 21.893106953223356
          - type: nauc_ndcg_at_1000_max
            value: 40.38192211749562
          - type: nauc_ndcg_at_1000_std
            value: 27.943530727839622
          - type: nauc_ndcg_at_100_diff1
            value: 21.476881814995785
          - type: nauc_ndcg_at_100_max
            value: 39.91597694502497
          - type: nauc_ndcg_at_100_std
            value: 27.80086195626175
          - type: nauc_ndcg_at_10_diff1
            value: 22.788155104417537
          - type: nauc_ndcg_at_10_max
            value: 39.64018481724029
          - type: nauc_ndcg_at_10_std
            value: 24.608760819228856
          - type: nauc_ndcg_at_1_diff1
            value: 28.020125669466562
          - type: nauc_ndcg_at_1_max
            value: 34.02386180115898
          - type: nauc_ndcg_at_1_std
            value: 17.835724317244686
          - type: nauc_ndcg_at_20_diff1
            value: 21.435037904375516
          - type: nauc_ndcg_at_20_max
            value: 39.41545921639339
          - type: nauc_ndcg_at_20_std
            value: 26.302180505922152
          - type: nauc_ndcg_at_3_diff1
            value: 24.37753699681809
          - type: nauc_ndcg_at_3_max
            value: 37.92832349922249
          - type: nauc_ndcg_at_3_std
            value: 20.314267862236697
          - type: nauc_ndcg_at_5_diff1
            value: 24.489993763202634
          - type: nauc_ndcg_at_5_max
            value: 39.322948140029744
          - type: nauc_ndcg_at_5_std
            value: 22.069807417424485
          - type: nauc_precision_at_1000_diff1
            value: -16.048547778222588
          - type: nauc_precision_at_1000_max
            value: -3.205412586478899
          - type: nauc_precision_at_1000_std
            value: 14.433544284750797
          - type: nauc_precision_at_100_diff1
            value: -11.787991777545036
          - type: nauc_precision_at_100_max
            value: 6.850986771358883
          - type: nauc_precision_at_100_std
            value: 22.572974966148244
          - type: nauc_precision_at_10_diff1
            value: -0.5111959706315438
          - type: nauc_precision_at_10_max
            value: 22.560355393578128
          - type: nauc_precision_at_10_std
            value: 25.562322716450424
          - type: nauc_precision_at_1_diff1
            value: 28.020125669466562
          - type: nauc_precision_at_1_max
            value: 34.02386180115898
          - type: nauc_precision_at_1_std
            value: 17.835724317244686
          - type: nauc_precision_at_20_diff1
            value: -6.0772940189383275
          - type: nauc_precision_at_20_max
            value: 17.194360329332213
          - type: nauc_precision_at_20_std
            value: 26.551077839343566
          - type: nauc_precision_at_3_diff1
            value: 10.033294854519573
          - type: nauc_precision_at_3_max
            value: 31.72453436391336
          - type: nauc_precision_at_3_std
            value: 22.294966409945427
          - type: nauc_precision_at_5_diff1
            value: 6.237641122443952
          - type: nauc_precision_at_5_max
            value: 28.3251946189731
          - type: nauc_precision_at_5_std
            value: 23.742964477476097
          - type: nauc_recall_at_1000_diff1
            value: 7.066317014709414
          - type: nauc_recall_at_1000_max
            value: 41.26207890590803
          - type: nauc_recall_at_1000_std
            value: 48.082120972049324
          - type: nauc_recall_at_100_diff1
            value: 8.5605869633491
          - type: nauc_recall_at_100_max
            value: 34.21516017657153
          - type: nauc_recall_at_100_std
            value: 36.23370174719997
          - type: nauc_recall_at_10_diff1
            value: 15.894026727549823
          - type: nauc_recall_at_10_max
            value: 35.7217710490404
          - type: nauc_recall_at_10_std
            value: 25.411329590972702
          - type: nauc_recall_at_1_diff1
            value: 34.574022172223785
          - type: nauc_recall_at_1_max
            value: 36.80960969907521
          - type: nauc_recall_at_1_std
            value: 14.745037917509043
          - type: nauc_recall_at_20_diff1
            value: 11.044245946655797
          - type: nauc_recall_at_20_max
            value: 33.321827723279846
          - type: nauc_recall_at_20_std
            value: 28.839341482904228
          - type: nauc_recall_at_3_diff1
            value: 23.574156335947677
          - type: nauc_recall_at_3_max
            value: 38.36490056324833
          - type: nauc_recall_at_3_std
            value: 19.781669176069148
          - type: nauc_recall_at_5_diff1
            value: 20.375492803538272
          - type: nauc_recall_at_5_max
            value: 37.13169592173094
          - type: nauc_recall_at_5_std
            value: 21.698652331981503
          - type: ndcg_at_1
            value: 44.169000000000004
          - type: ndcg_at_10
            value: 43.469
          - type: ndcg_at_100
            value: 51.056000000000004
          - type: ndcg_at_1000
            value: 53.467
          - type: ndcg_at_20
            value: 46.601
          - type: ndcg_at_3
            value: 37.138
          - type: ndcg_at_5
            value: 39.286
          - type: precision_at_1
            value: 44.169000000000004
          - type: precision_at_10
            value: 13.316
          - type: precision_at_100
            value: 2.149
          - type: precision_at_1000
            value: 0.261
          - type: precision_at_20
            value: 8.01
          - type: precision_at_3
            value: 27.839000000000002
          - type: precision_at_5
            value: 20.846999999999998
          - type: recall_at_1
            value: 19.506999999999998
          - type: recall_at_10
            value: 49.242000000000004
          - type: recall_at_100
            value: 74.421
          - type: recall_at_1000
            value: 87.53699999999999
          - type: recall_at_20
            value: 57.992
          - type: recall_at_3
            value: 33.024
          - type: recall_at_5
            value: 40.178000000000004
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB DBPedia
          revision: c0f706b76e590d620bd6618b3ca8efdd34e2d659
          split: test
          type: mteb/dbpedia
        metrics:
          - type: main_score
            value: 50.815999999999995
          - type: map_at_1
            value: 10.4
          - type: map_at_10
            value: 24.509
          - type: map_at_100
            value: 35.888
          - type: map_at_1000
            value: 37.881
          - type: map_at_20
            value: 29.248
          - type: map_at_3
            value: 16.683
          - type: map_at_5
            value: 20.121
          - type: mrr_at_1
            value: 76.5
          - type: mrr_at_10
            value: 82.96865079365078
          - type: mrr_at_100
            value: 83.15565684386043
          - type: mrr_at_1000
            value: 83.16234347576268
          - type: mrr_at_20
            value: 83.10610208827119
          - type: mrr_at_3
            value: 81.875
          - type: mrr_at_5
            value: 82.53749999999998
          - type: nauc_map_at_1000_diff1
            value: 23.772111749199244
          - type: nauc_map_at_1000_max
            value: 30.20334223785286
          - type: nauc_map_at_1000_std
            value: 18.05771740348393
          - type: nauc_map_at_100_diff1
            value: 24.99922400559097
          - type: nauc_map_at_100_max
            value: 30.227680457273554
          - type: nauc_map_at_100_std
            value: 15.266796337809208
          - type: nauc_map_at_10_diff1
            value: 26.33907059260499
          - type: nauc_map_at_10_max
            value: 21.35352795885219
          - type: nauc_map_at_10_std
            value: -11.676283379701461
          - type: nauc_map_at_1_diff1
            value: 30.9428537478304
          - type: nauc_map_at_1_max
            value: 10.706776298253795
          - type: nauc_map_at_1_std
            value: -27.48789516952886
          - type: nauc_map_at_20_diff1
            value: 26.028744882022643
          - type: nauc_map_at_20_max
            value: 25.540897708997857
          - type: nauc_map_at_20_std
            value: -2.1138409738399333
          - type: nauc_map_at_3_diff1
            value: 28.569060478595414
          - type: nauc_map_at_3_max
            value: 16.03075218426638
          - type: nauc_map_at_3_std
            value: -23.289456267507518
          - type: nauc_map_at_5_diff1
            value: 27.77252783978944
          - type: nauc_map_at_5_max
            value: 17.558788618934244
          - type: nauc_map_at_5_std
            value: -19.879370566923726
          - type: nauc_mrr_at_1000_diff1
            value: 56.24197871190471
          - type: nauc_mrr_at_1000_max
            value: 65.80135088215289
          - type: nauc_mrr_at_1000_std
            value: 41.37855291304919
          - type: nauc_mrr_at_100_diff1
            value: 56.23288710496704
          - type: nauc_mrr_at_100_max
            value: 65.80061767216726
          - type: nauc_mrr_at_100_std
            value: 41.36772467988576
          - type: nauc_mrr_at_10_diff1
            value: 56.324447358144745
          - type: nauc_mrr_at_10_max
            value: 65.81370075569146
          - type: nauc_mrr_at_10_std
            value: 41.410460564882776
          - type: nauc_mrr_at_1_diff1
            value: 59.65250965250966
          - type: nauc_mrr_at_1_max
            value: 63.83691383691382
          - type: nauc_mrr_at_1_std
            value: 36.73343673343676
          - type: nauc_mrr_at_20_diff1
            value: 56.1707409830787
          - type: nauc_mrr_at_20_max
            value: 65.69720497776981
          - type: nauc_mrr_at_20_std
            value: 41.26487560092242
          - type: nauc_mrr_at_3_diff1
            value: 54.9129569183045
          - type: nauc_mrr_at_3_max
            value: 65.99486075421906
          - type: nauc_mrr_at_3_std
            value: 41.95372363821559
          - type: nauc_mrr_at_5_diff1
            value: 56.16135725971244
          - type: nauc_mrr_at_5_max
            value: 66.3010887352757
          - type: nauc_mrr_at_5_std
            value: 42.00610529557167
          - type: nauc_ndcg_at_1000_diff1
            value: 32.70929215628561
          - type: nauc_ndcg_at_1000_max
            value: 47.10806967197569
          - type: nauc_ndcg_at_1000_std
            value: 35.00425836800715
          - type: nauc_ndcg_at_100_diff1
            value: 35.06646341481841
          - type: nauc_ndcg_at_100_max
            value: 45.39744548573974
          - type: nauc_ndcg_at_100_std
            value: 27.047969181217844
          - type: nauc_ndcg_at_10_diff1
            value: 27.274830141666424
          - type: nauc_ndcg_at_10_max
            value: 42.504020954653996
          - type: nauc_ndcg_at_10_std
            value: 22.697762917174995
          - type: nauc_ndcg_at_1_diff1
            value: 50.08311936617783
          - type: nauc_ndcg_at_1_max
            value: 54.73568887554088
          - type: nauc_ndcg_at_1_std
            value: 26.170967864741694
          - type: nauc_ndcg_at_20_diff1
            value: 31.242689219374427
          - type: nauc_ndcg_at_20_max
            value: 42.541920517016614
          - type: nauc_ndcg_at_20_std
            value: 18.96423111373813
          - type: nauc_ndcg_at_3_diff1
            value: 28.826757289224155
          - type: nauc_ndcg_at_3_max
            value: 43.58945597798035
          - type: nauc_ndcg_at_3_std
            value: 24.087165156193166
          - type: nauc_ndcg_at_5_diff1
            value: 26.119279113418546
          - type: nauc_ndcg_at_5_max
            value: 40.679930238997535
          - type: nauc_ndcg_at_5_std
            value: 23.46459132364594
          - type: nauc_precision_at_1000_diff1
            value: -21.84770974908615
          - type: nauc_precision_at_1000_max
            value: -14.093701963931426
          - type: nauc_precision_at_1000_std
            value: 9.299725592056397
          - type: nauc_precision_at_100_diff1
            value: -10.260185699059837
          - type: nauc_precision_at_100_max
            value: 9.810522145982985
          - type: nauc_precision_at_100_std
            value: 44.20627482372792
          - type: nauc_precision_at_10_diff1
            value: -4.519747556705346
          - type: nauc_precision_at_10_max
            value: 22.419340914046078
          - type: nauc_precision_at_10_std
            value: 45.53510067051897
          - type: nauc_precision_at_1_diff1
            value: 59.65250965250966
          - type: nauc_precision_at_1_max
            value: 63.83691383691382
          - type: nauc_precision_at_1_std
            value: 36.73343673343676
          - type: nauc_precision_at_20_diff1
            value: -4.894217383220783
          - type: nauc_precision_at_20_max
            value: 20.026284106419716
          - type: nauc_precision_at_20_std
            value: 46.826549838338885
          - type: nauc_precision_at_3_diff1
            value: 8.255495021604343
          - type: nauc_precision_at_3_max
            value: 32.41871125305279
          - type: nauc_precision_at_3_std
            value: 39.37854593274469
          - type: nauc_precision_at_5_diff1
            value: 0.8399922914701591
          - type: nauc_precision_at_5_max
            value: 25.576701242406784
          - type: nauc_precision_at_5_std
            value: 41.43316549318606
          - type: nauc_recall_at_1000_diff1
            value: 26.933682703442607
          - type: nauc_recall_at_1000_max
            value: 41.242862989732615
          - type: nauc_recall_at_1000_std
            value: 47.718397116276726
          - type: nauc_recall_at_100_diff1
            value: 28.66794019735935
          - type: nauc_recall_at_100_max
            value: 33.70954178154391
          - type: nauc_recall_at_100_std
            value: 20.337812189448144
          - type: nauc_recall_at_10_diff1
            value: 23.98560937572333
          - type: nauc_recall_at_10_max
            value: 17.85589161042591
          - type: nauc_recall_at_10_std
            value: -15.460067168640327
          - type: nauc_recall_at_1_diff1
            value: 30.9428537478304
          - type: nauc_recall_at_1_max
            value: 10.706776298253795
          - type: nauc_recall_at_1_std
            value: -27.48789516952886
          - type: nauc_recall_at_20_diff1
            value: 24.528494602453677
          - type: nauc_recall_at_20_max
            value: 22.39686785999968
          - type: nauc_recall_at_20_std
            value: -6.8755605379050495
          - type: nauc_recall_at_3_diff1
            value: 24.352067402718824
          - type: nauc_recall_at_3_max
            value: 13.630657148502184
          - type: nauc_recall_at_3_std
            value: -24.752279121894848
          - type: nauc_recall_at_5_diff1
            value: 23.93262400173538
          - type: nauc_recall_at_5_max
            value: 14.158970487334082
          - type: nauc_recall_at_5_std
            value: -22.37672315523696
          - type: ndcg_at_1
            value: 64.75
          - type: ndcg_at_10
            value: 50.815999999999995
          - type: ndcg_at_100
            value: 55.981
          - type: ndcg_at_1000
            value: 62.857
          - type: ndcg_at_20
            value: 50.283
          - type: ndcg_at_3
            value: 56.232000000000006
          - type: ndcg_at_5
            value: 53.303999999999995
          - type: precision_at_1
            value: 76.5
          - type: precision_at_10
            value: 40.9
          - type: precision_at_100
            value: 13.01
          - type: precision_at_1000
            value: 2.496
          - type: precision_at_20
            value: 31.525
          - type: precision_at_3
            value: 59.667
          - type: precision_at_5
            value: 51.5
          - type: recall_at_1
            value: 10.4
          - type: recall_at_10
            value: 29.837000000000003
          - type: recall_at_100
            value: 62.495999999999995
          - type: recall_at_1000
            value: 84.179
          - type: recall_at_20
            value: 39.745000000000005
          - type: recall_at_3
            value: 17.772
          - type: recall_at_5
            value: 22.732
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB FEVER
          revision: bea83ef9e8fb933d90a2f1d5515737465d613e12
          split: test
          type: mteb/fever
        metrics:
          - type: main_score
            value: 93.147
          - type: map_at_1
            value: 84.123
          - type: map_at_10
            value: 90.793
          - type: map_at_100
            value: 91.00399999999999
          - type: map_at_1000
            value: 91.014
          - type: map_at_20
            value: 90.929
          - type: map_at_3
            value: 90.01
          - type: map_at_5
            value: 90.514
          - type: mrr_at_1
            value: 90.6090609060906
          - type: mrr_at_10
            value: 94.56931407426447
          - type: mrr_at_100
            value: 94.5981688826583
          - type: mrr_at_1000
            value: 94.59839036307305
          - type: mrr_at_20
            value: 94.58933347392538
          - type: mrr_at_3
            value: 94.39443944394432
          - type: mrr_at_5
            value: 94.52720272027192
          - type: nauc_map_at_1000_diff1
            value: 47.79099845895175
          - type: nauc_map_at_1000_max
            value: 27.497877436060126
          - type: nauc_map_at_1000_std
            value: -8.13339253954977
          - type: nauc_map_at_100_diff1
            value: 47.73289128218074
          - type: nauc_map_at_100_max
            value: 27.47233674805432
          - type: nauc_map_at_100_std
            value: -8.116906996417276
          - type: nauc_map_at_10_diff1
            value: 47.11991698822012
          - type: nauc_map_at_10_max
            value: 27.043478885296818
          - type: nauc_map_at_10_std
            value: -8.041555396807254
          - type: nauc_map_at_1_diff1
            value: 54.62356861092832
          - type: nauc_map_at_1_max
            value: 25.79991281991449
          - type: nauc_map_at_1_std
            value: -10.727885287362989
          - type: nauc_map_at_20_diff1
            value: 47.355948038923415
          - type: nauc_map_at_20_max
            value: 27.377496866209412
          - type: nauc_map_at_20_std
            value: -7.964383745017635
          - type: nauc_map_at_3_diff1
            value: 46.250567821995816
          - type: nauc_map_at_3_max
            value: 26.720427753104087
          - type: nauc_map_at_3_std
            value: -8.720105706265599
          - type: nauc_map_at_5_diff1
            value: 46.60720659354551
          - type: nauc_map_at_5_max
            value: 26.571065579915974
          - type: nauc_map_at_5_std
            value: -8.595067960972495
          - type: nauc_mrr_at_1000_diff1
            value: 73.70855511936261
          - type: nauc_mrr_at_1000_max
            value: 34.73984488188905
          - type: nauc_mrr_at_1000_std
            value: -19.808375433256
          - type: nauc_mrr_at_100_diff1
            value: 73.7096330945882
          - type: nauc_mrr_at_100_max
            value: 34.742520612749445
          - type: nauc_mrr_at_100_std
            value: -19.803463171450023
          - type: nauc_mrr_at_10_diff1
            value: 73.71314616789961
          - type: nauc_mrr_at_10_max
            value: 34.947852652846485
          - type: nauc_mrr_at_10_std
            value: -19.759110050207276
          - type: nauc_mrr_at_1_diff1
            value: 74.52821692195837
          - type: nauc_mrr_at_1_max
            value: 32.2133212833154
          - type: nauc_mrr_at_1_std
            value: -18.97663485312286
          - type: nauc_mrr_at_20_diff1
            value: 73.69023729557055
          - type: nauc_mrr_at_20_max
            value: 34.80486237439106
          - type: nauc_mrr_at_20_std
            value: -19.691951099200146
          - type: nauc_mrr_at_3_diff1
            value: 73.43522847167395
          - type: nauc_mrr_at_3_max
            value: 35.072062525904414
          - type: nauc_mrr_at_3_std
            value: -20.938095342419672
          - type: nauc_mrr_at_5_diff1
            value: 73.69029982038052
          - type: nauc_mrr_at_5_max
            value: 35.14296188327372
          - type: nauc_mrr_at_5_std
            value: -20.10654798165351
          - type: nauc_ndcg_at_1000_diff1
            value: 51.65324942604166
          - type: nauc_ndcg_at_1000_max
            value: 29.729210561748797
          - type: nauc_ndcg_at_1000_std
            value: -8.830858681742994
          - type: nauc_ndcg_at_100_diff1
            value: 50.40059292035861
          - type: nauc_ndcg_at_100_max
            value: 29.323797091488856
          - type: nauc_ndcg_at_100_std
            value: -8.288820123602129
          - type: nauc_ndcg_at_10_diff1
            value: 47.73985149996194
          - type: nauc_ndcg_at_10_max
            value: 28.43547785458384
          - type: nauc_ndcg_at_10_std
            value: -7.355960453195441
          - type: nauc_ndcg_at_1_diff1
            value: 74.52821692195837
          - type: nauc_ndcg_at_1_max
            value: 32.2133212833154
          - type: nauc_ndcg_at_1_std
            value: -18.97663485312286
          - type: nauc_ndcg_at_20_diff1
            value: 48.34744447531361
          - type: nauc_ndcg_at_20_max
            value: 29.147274611665104
          - type: nauc_ndcg_at_20_std
            value: -7.1859909752874565
          - type: nauc_ndcg_at_3_diff1
            value: 48.02902219011437
          - type: nauc_ndcg_at_3_max
            value: 29.05519326030459
          - type: nauc_ndcg_at_3_std
            value: -9.562414651448368
          - type: nauc_ndcg_at_5_diff1
            value: 47.29981191574703
          - type: nauc_ndcg_at_5_max
            value: 28.014651730307428
          - type: nauc_ndcg_at_5_std
            value: -8.661224447638219
          - type: nauc_precision_at_1000_diff1
            value: -10.024865744474184
          - type: nauc_precision_at_1000_max
            value: -4.298508017924518
          - type: nauc_precision_at_1000_std
            value: 1.547025732357951
          - type: nauc_precision_at_100_diff1
            value: -12.06926468256376
          - type: nauc_precision_at_100_max
            value: -4.21291413804896
          - type: nauc_precision_at_100_std
            value: 2.872264631517362
          - type: nauc_precision_at_10_diff1
            value: -15.94007852972694
          - type: nauc_precision_at_10_max
            value: -4.544097710963198
          - type: nauc_precision_at_10_std
            value: 4.767828958024675
          - type: nauc_precision_at_1_diff1
            value: 74.52821692195837
          - type: nauc_precision_at_1_max
            value: 32.2133212833154
          - type: nauc_precision_at_1_std
            value: -18.97663485312286
          - type: nauc_precision_at_20_diff1
            value: -15.66405220649896
          - type: nauc_precision_at_20_max
            value: -3.6496367951851822
          - type: nauc_precision_at_20_std
            value: 4.825301805130045
          - type: nauc_precision_at_3_diff1
            value: -12.514109763479336
          - type: nauc_precision_at_3_max
            value: -0.24447133318217024
          - type: nauc_precision_at_3_std
            value: -0.2649163459628502
          - type: nauc_precision_at_5_diff1
            value: -15.820728575356485
          - type: nauc_precision_at_5_max
            value: -4.786371094249761
          - type: nauc_precision_at_5_std
            value: 1.7929947640996053
          - type: nauc_recall_at_1000_diff1
            value: 5.499530852392676
          - type: nauc_recall_at_1000_max
            value: 44.030520852910406
          - type: nauc_recall_at_1000_std
            value: 50.2017454712542
          - type: nauc_recall_at_100_diff1
            value: 2.0640091010830526
          - type: nauc_recall_at_100_max
            value: 24.864404635675204
          - type: nauc_recall_at_100_std
            value: 27.319350569429734
          - type: nauc_recall_at_10_diff1
            value: 13.791800250368114
          - type: nauc_recall_at_10_max
            value: 24.769825741582302
          - type: nauc_recall_at_10_std
            value: 13.59069444609498
          - type: nauc_recall_at_1_diff1
            value: 54.62356861092832
          - type: nauc_recall_at_1_max
            value: 25.79991281991449
          - type: nauc_recall_at_1_std
            value: -10.727885287362989
          - type: nauc_recall_at_20_diff1
            value: 5.336705306013041
          - type: nauc_recall_at_20_max
            value: 27.41570703746024
          - type: nauc_recall_at_20_std
            value: 23.006970266201787
          - type: nauc_recall_at_3_diff1
            value: 23.292169395266264
          - type: nauc_recall_at_3_max
            value: 24.262360079531074
          - type: nauc_recall_at_3_std
            value: -1.7422845002974312
          - type: nauc_recall_at_5_diff1
            value: 18.060917420579997
          - type: nauc_recall_at_5_max
            value: 23.06733097213354
          - type: nauc_recall_at_5_std
            value: 3.3913875084148297
          - type: ndcg_at_1
            value: 90.609
          - type: ndcg_at_10
            value: 93.147
          - type: ndcg_at_100
            value: 93.74900000000001
          - type: ndcg_at_1000
            value: 93.901
          - type: ndcg_at_20
            value: 93.447
          - type: ndcg_at_3
            value: 92.268
          - type: ndcg_at_5
            value: 92.757
          - type: precision_at_1
            value: 90.609
          - type: precision_at_10
            value: 10.926
          - type: precision_at_100
            value: 1.149
          - type: precision_at_1000
            value: 0.11800000000000001
          - type: precision_at_20
            value: 5.5809999999999995
          - type: precision_at_3
            value: 34.738
          - type: precision_at_5
            value: 21.346999999999998
          - type: recall_at_1
            value: 84.123
          - type: recall_at_10
            value: 96.539
          - type: recall_at_100
            value: 98.67899999999999
          - type: recall_at_1000
            value: 99.555
          - type: recall_at_20
            value: 97.45700000000001
          - type: recall_at_3
            value: 94.133
          - type: recall_at_5
            value: 95.44200000000001
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB FiQA2018
          revision: 27a168819829fe9bcd655c2df245fb19452e8e06
          split: test
          type: mteb/fiqa
        metrics:
          - type: main_score
            value: 61.182
          - type: map_at_1
            value: 31.877
          - type: map_at_10
            value: 52.986
          - type: map_at_100
            value: 55.242000000000004
          - type: map_at_1000
            value: 55.336
          - type: map_at_20
            value: 54.36299999999999
          - type: map_at_3
            value: 45.9
          - type: map_at_5
            value: 49.952000000000005
          - type: mrr_at_1
            value: 60.18518518518518
          - type: mrr_at_10
            value: 67.71611062120319
          - type: mrr_at_100
            value: 68.32957545203445
          - type: mrr_at_1000
            value: 68.34041293981731
          - type: mrr_at_20
            value: 68.1184684086802
          - type: mrr_at_3
            value: 66.04938271604934
          - type: mrr_at_5
            value: 67.02932098765427
          - type: nauc_map_at_1000_diff1
            value: 49.390058112037565
          - type: nauc_map_at_1000_max
            value: 33.86672922230126
          - type: nauc_map_at_1000_std
            value: -24.19297282790569
          - type: nauc_map_at_100_diff1
            value: 49.39575568085033
          - type: nauc_map_at_100_max
            value: 33.82800761671263
          - type: nauc_map_at_100_std
            value: -24.20216911890828
          - type: nauc_map_at_10_diff1
            value: 49.826703829159065
          - type: nauc_map_at_10_max
            value: 32.04132357301985
          - type: nauc_map_at_10_std
            value: -25.477594030350414
          - type: nauc_map_at_1_diff1
            value: 54.95925350681827
          - type: nauc_map_at_1_max
            value: 13.962825942647214
          - type: nauc_map_at_1_std
            value: -21.054092920927694
          - type: nauc_map_at_20_diff1
            value: 49.537681600887865
          - type: nauc_map_at_20_max
            value: 33.164569894845904
          - type: nauc_map_at_20_std
            value: -25.075136372458108
          - type: nauc_map_at_3_diff1
            value: 49.82581713716135
          - type: nauc_map_at_3_max
            value: 25.491261673133316
          - type: nauc_map_at_3_std
            value: -25.29735314206127
          - type: nauc_map_at_5_diff1
            value: 49.170865024768574
          - type: nauc_map_at_5_max
            value: 29.496572465872678
          - type: nauc_map_at_5_std
            value: -25.457134089214883
          - type: nauc_mrr_at_1000_diff1
            value: 59.44493769316621
          - type: nauc_mrr_at_1000_max
            value: 46.13272263925939
          - type: nauc_mrr_at_1000_std
            value: -19.11475143331668
          - type: nauc_mrr_at_100_diff1
            value: 59.44411441499269
          - type: nauc_mrr_at_100_max
            value: 46.13654028161708
          - type: nauc_mrr_at_100_std
            value: -19.109369325106417
          - type: nauc_mrr_at_10_diff1
            value: 59.219349927774154
          - type: nauc_mrr_at_10_max
            value: 46.02618026578592
          - type: nauc_mrr_at_10_std
            value: -19.37433068502548
          - type: nauc_mrr_at_1_diff1
            value: 62.95921038561675
          - type: nauc_mrr_at_1_max
            value: 46.18080967355503
          - type: nauc_mrr_at_1_std
            value: -18.40186184012292
          - type: nauc_mrr_at_20_diff1
            value: 59.3891382507084
          - type: nauc_mrr_at_20_max
            value: 46.044401310035894
          - type: nauc_mrr_at_20_std
            value: -19.257461333372504
          - type: nauc_mrr_at_3_diff1
            value: 59.238553596931
          - type: nauc_mrr_at_3_max
            value: 46.56487351573117
          - type: nauc_mrr_at_3_std
            value: -19.12741537508225
          - type: nauc_mrr_at_5_diff1
            value: 58.93737610599986
          - type: nauc_mrr_at_5_max
            value: 45.99436971500825
          - type: nauc_mrr_at_5_std
            value: -19.261662406716308
          - type: nauc_ndcg_at_1000_diff1
            value: 51.40360288706063
          - type: nauc_ndcg_at_1000_max
            value: 39.32722737004307
          - type: nauc_ndcg_at_1000_std
            value: -20.898685807989388
          - type: nauc_ndcg_at_100_diff1
            value: 51.36301353290372
          - type: nauc_ndcg_at_100_max
            value: 38.97243548753853
          - type: nauc_ndcg_at_100_std
            value: -20.50022060973278
          - type: nauc_ndcg_at_10_diff1
            value: 51.44403959729833
          - type: nauc_ndcg_at_10_max
            value: 36.01289481113504
          - type: nauc_ndcg_at_10_std
            value: -24.176498000068843
          - type: nauc_ndcg_at_1_diff1
            value: 62.95921038561675
          - type: nauc_ndcg_at_1_max
            value: 46.18080967355503
          - type: nauc_ndcg_at_1_std
            value: -18.40186184012292
          - type: nauc_ndcg_at_20_diff1
            value: 51.41066012197159
          - type: nauc_ndcg_at_20_max
            value: 37.24872539687912
          - type: nauc_ndcg_at_20_std
            value: -23.372189423803118
          - type: nauc_ndcg_at_3_diff1
            value: 48.489628982965854
          - type: nauc_ndcg_at_3_max
            value: 36.93242010543425
          - type: nauc_ndcg_at_3_std
            value: -23.566283895234708
          - type: nauc_ndcg_at_5_diff1
            value: 48.855011049758616
          - type: nauc_ndcg_at_5_max
            value: 34.72552703254509
          - type: nauc_ndcg_at_5_std
            value: -24.603662195056884
          - type: nauc_precision_at_1000_diff1
            value: -16.254896831329358
          - type: nauc_precision_at_1000_max
            value: 26.68880233255314
          - type: nauc_precision_at_1000_std
            value: 15.711021613094275
          - type: nauc_precision_at_100_diff1
            value: -11.963143494271204
          - type: nauc_precision_at_100_max
            value: 30.662204917415004
          - type: nauc_precision_at_100_std
            value: 15.037733765190636
          - type: nauc_precision_at_10_diff1
            value: 4.189692935472799
          - type: nauc_precision_at_10_max
            value: 37.378105954795075
          - type: nauc_precision_at_10_std
            value: -1.0086179584149657
          - type: nauc_precision_at_1_diff1
            value: 62.95921038561675
          - type: nauc_precision_at_1_max
            value: 46.18080967355503
          - type: nauc_precision_at_1_std
            value: -18.40186184012292
          - type: nauc_precision_at_20_diff1
            value: -3.1588007120578276
          - type: nauc_precision_at_20_max
            value: 35.380893467283215
          - type: nauc_precision_at_20_std
            value: 4.992120324159972
          - type: nauc_precision_at_3_diff1
            value: 18.37633057040911
          - type: nauc_precision_at_3_max
            value: 42.06004715153175
          - type: nauc_precision_at_3_std
            value: -11.214136554742755
          - type: nauc_precision_at_5_diff1
            value: 10.224008279551054
          - type: nauc_precision_at_5_max
            value: 40.18017184406908
          - type: nauc_precision_at_5_std
            value: -7.103870184792855
          - type: nauc_recall_at_1000_diff1
            value: 38.30826137726082
          - type: nauc_recall_at_1000_max
            value: 37.17044147876854
          - type: nauc_recall_at_1000_std
            value: 10.594199798446793
          - type: nauc_recall_at_100_diff1
            value: 40.454335943748475
          - type: nauc_recall_at_100_max
            value: 31.170902337200097
          - type: nauc_recall_at_100_std
            value: -0.8492074860948018
          - type: nauc_recall_at_10_diff1
            value: 44.954194528652735
          - type: nauc_recall_at_10_max
            value: 28.27547239551631
          - type: nauc_recall_at_10_std
            value: -24.747605039280685
          - type: nauc_recall_at_1_diff1
            value: 54.95925350681827
          - type: nauc_recall_at_1_max
            value: 13.962825942647214
          - type: nauc_recall_at_1_std
            value: -21.054092920927694
          - type: nauc_recall_at_20_diff1
            value: 44.398293084195636
          - type: nauc_recall_at_20_max
            value: 29.604081242804735
          - type: nauc_recall_at_20_std
            value: -22.90399779981129
          - type: nauc_recall_at_3_diff1
            value: 43.25687263417001
          - type: nauc_recall_at_3_max
            value: 20.50817103562355
          - type: nauc_recall_at_3_std
            value: -26.567575668398508
          - type: nauc_recall_at_5_diff1
            value: 40.81840199310296
          - type: nauc_recall_at_5_max
            value: 23.1238715032068
          - type: nauc_recall_at_5_std
            value: -25.64446934619821
          - type: ndcg_at_1
            value: 60.185
          - type: ndcg_at_10
            value: 61.182
          - type: ndcg_at_100
            value: 67.523
          - type: ndcg_at_1000
            value: 68.759
          - type: ndcg_at_20
            value: 64.084
          - type: ndcg_at_3
            value: 56.48
          - type: ndcg_at_5
            value: 58.098000000000006
          - type: precision_at_1
            value: 60.185
          - type: precision_at_10
            value: 17.083000000000002
          - type: precision_at_100
            value: 2.366
          - type: precision_at_1000
            value: 0.259
          - type: precision_at_20
            value: 9.884
          - type: precision_at_3
            value: 37.757000000000005
          - type: precision_at_5
            value: 27.747
          - type: recall_at_1
            value: 31.877
          - type: recall_at_10
            value: 68.868
          - type: recall_at_100
            value: 91.26100000000001
          - type: recall_at_1000
            value: 98.346
          - type: recall_at_20
            value: 77.523
          - type: recall_at_3
            value: 51.226000000000006
          - type: recall_at_5
            value: 59.319
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB HotpotQA
          revision: ab518f4d6fcca38d87c25209f94beba119d02014
          split: test
          type: mteb/hotpotqa
        metrics:
          - type: main_score
            value: 79.125
          - type: map_at_1
            value: 43.72
          - type: map_at_10
            value: 72.03500000000001
          - type: map_at_100
            value: 72.761
          - type: map_at_1000
            value: 72.80499999999999
          - type: map_at_20
            value: 72.477
          - type: map_at_3
            value: 68.84700000000001
          - type: map_at_5
            value: 70.982
          - type: mrr_at_1
            value: 87.44091829844699
          - type: mrr_at_10
            value: 91.31576155107534
          - type: mrr_at_100
            value: 91.40489558470692
          - type: mrr_at_1000
            value: 91.40687231624047
          - type: mrr_at_20
            value: 91.37223203223267
          - type: mrr_at_3
            value: 90.84177357641214
          - type: mrr_at_5
            value: 91.17938329957211
          - type: nauc_map_at_1000_diff1
            value: 2.160941678109871
          - type: nauc_map_at_1000_max
            value: 20.280335959707244
          - type: nauc_map_at_1000_std
            value: 2.097428882568907
          - type: nauc_map_at_100_diff1
            value: 2.1230954064310272
          - type: nauc_map_at_100_max
            value: 20.258093599808014
          - type: nauc_map_at_100_std
            value: 2.1151474260126633
          - type: nauc_map_at_10_diff1
            value: 1.8723430508681238
          - type: nauc_map_at_10_max
            value: 20.001115713122292
          - type: nauc_map_at_10_std
            value: 1.5120467206405304
          - type: nauc_map_at_1_diff1
            value: 68.47218714216126
          - type: nauc_map_at_1_max
            value: 48.79030836492533
          - type: nauc_map_at_1_std
            value: -14.325167455523276
          - type: nauc_map_at_20_diff1
            value: 2.021495128391111
          - type: nauc_map_at_20_max
            value: 20.19494185197473
          - type: nauc_map_at_20_std
            value: 1.988283622854646
          - type: nauc_map_at_3_diff1
            value: 1.3035766010655014
          - type: nauc_map_at_3_max
            value: 18.267934028448014
          - type: nauc_map_at_3_std
            value: -1.5393823883989837
          - type: nauc_map_at_5_diff1
            value: 1.6758465601660635
          - type: nauc_map_at_5_max
            value: 19.611409174084766
          - type: nauc_map_at_5_std
            value: 0.5379733914867968
          - type: nauc_mrr_at_1000_diff1
            value: 68.60925278528931
          - type: nauc_mrr_at_1000_max
            value: 53.41174729989386
          - type: nauc_mrr_at_1000_std
            value: -10.94381937854199
          - type: nauc_mrr_at_100_diff1
            value: 68.61192764944234
          - type: nauc_mrr_at_100_max
            value: 53.41979323473436
          - type: nauc_mrr_at_100_std
            value: -10.928418937183535
          - type: nauc_mrr_at_10_diff1
            value: 68.58075465200439
          - type: nauc_mrr_at_10_max
            value: 53.469248695058894
          - type: nauc_mrr_at_10_std
            value: -11.033247242342176
          - type: nauc_mrr_at_1_diff1
            value: 68.47218714216126
          - type: nauc_mrr_at_1_max
            value: 48.79030836492533
          - type: nauc_mrr_at_1_std
            value: -14.325167455523276
          - type: nauc_mrr_at_20_diff1
            value: 68.61440353772745
          - type: nauc_mrr_at_20_max
            value: 53.48475026827637
          - type: nauc_mrr_at_20_std
            value: -10.890302904034154
          - type: nauc_mrr_at_3_diff1
            value: 68.69282004791216
          - type: nauc_mrr_at_3_max
            value: 54.06094833361629
          - type: nauc_mrr_at_3_std
            value: -11.153009129882598
          - type: nauc_mrr_at_5_diff1
            value: 68.73035503749831
          - type: nauc_mrr_at_5_max
            value: 53.83508048703245
          - type: nauc_mrr_at_5_std
            value: -11.003690030416173
          - type: nauc_ndcg_at_1000_diff1
            value: 9.50087869973644
          - type: nauc_ndcg_at_1000_max
            value: 25.950105183418927
          - type: nauc_ndcg_at_1000_std
            value: 5.135066113356472
          - type: nauc_ndcg_at_100_diff1
            value: 8.362935638818364
          - type: nauc_ndcg_at_100_max
            value: 25.34061127640931
          - type: nauc_ndcg_at_100_std
            value: 5.754839950507415
          - type: nauc_ndcg_at_10_diff1
            value: 7.156928707580207
          - type: nauc_ndcg_at_10_max
            value: 24.251874180080023
          - type: nauc_ndcg_at_10_std
            value: 3.4311673728584373
          - type: nauc_ndcg_at_1_diff1
            value: 68.47218714216126
          - type: nauc_ndcg_at_1_max
            value: 48.79030836492533
          - type: nauc_ndcg_at_1_std
            value: -14.325167455523276
          - type: nauc_ndcg_at_20_diff1
            value: 7.631421824536802
          - type: nauc_ndcg_at_20_max
            value: 24.899012298150367
          - type: nauc_ndcg_at_20_std
            value: 5.015727485279167
          - type: nauc_ndcg_at_3_diff1
            value: 6.765698105055132
          - type: nauc_ndcg_at_3_max
            value: 22.068064891465696
          - type: nauc_ndcg_at_3_std
            value: -1.4664522141695102
          - type: nauc_ndcg_at_5_diff1
            value: 6.97155171194824
          - type: nauc_ndcg_at_5_max
            value: 23.660849668507527
          - type: nauc_ndcg_at_5_std
            value: 1.4707432249488543
          - type: nauc_precision_at_1000_diff1
            value: -5.507220131591544
          - type: nauc_precision_at_1000_max
            value: 35.494019207652336
          - type: nauc_precision_at_1000_std
            value: 51.48431882469268
          - type: nauc_precision_at_100_diff1
            value: -9.856655267678178
          - type: nauc_precision_at_100_max
            value: 23.40730506252858
          - type: nauc_precision_at_100_std
            value: 34.01534710435972
          - type: nauc_precision_at_10_diff1
            value: -7.169347416977972
          - type: nauc_precision_at_10_max
            value: 20.252826543847206
          - type: nauc_precision_at_10_std
            value: 13.940728560252206
          - type: nauc_precision_at_1_diff1
            value: 68.47218714216126
          - type: nauc_precision_at_1_max
            value: 48.79030836492533
          - type: nauc_precision_at_1_std
            value: -14.325167455523276
          - type: nauc_precision_at_20_diff1
            value: -7.783356154578335
          - type: nauc_precision_at_20_max
            value: 21.74000065585772
          - type: nauc_precision_at_20_std
            value: 21.489921794963333
          - type: nauc_precision_at_3_diff1
            value: -4.4855992702233385
          - type: nauc_precision_at_3_max
            value: 17.58424070747094
          - type: nauc_precision_at_3_std
            value: 1.8777336548123371
          - type: nauc_precision_at_5_diff1
            value: -5.604031655005792
          - type: nauc_precision_at_5_max
            value: 19.580893429923517
          - type: nauc_precision_at_5_std
            value: 7.8203617045788505
          - type: nauc_recall_at_1000_diff1
            value: -5.507220131591377
          - type: nauc_recall_at_1000_max
            value: 35.494019207652414
          - type: nauc_recall_at_1000_std
            value: 51.48431882469249
          - type: nauc_recall_at_100_diff1
            value: -9.856655267678182
          - type: nauc_recall_at_100_max
            value: 23.407305062528323
          - type: nauc_recall_at_100_std
            value: 34.01534710435951
          - type: nauc_recall_at_10_diff1
            value: -7.169347416977698
          - type: nauc_recall_at_10_max
            value: 20.252826543847338
          - type: nauc_recall_at_10_std
            value: 13.940728560252335
          - type: nauc_recall_at_1_diff1
            value: 68.47218714216126
          - type: nauc_recall_at_1_max
            value: 48.79030836492533
          - type: nauc_recall_at_1_std
            value: -14.325167455523276
          - type: nauc_recall_at_20_diff1
            value: -7.7833561545783985
          - type: nauc_recall_at_20_max
            value: 21.740000655857713
          - type: nauc_recall_at_20_std
            value: 21.489921794963426
          - type: nauc_recall_at_3_diff1
            value: -4.485599270223427
          - type: nauc_recall_at_3_max
            value: 17.584240707470887
          - type: nauc_recall_at_3_std
            value: 1.8777336548121935
          - type: nauc_recall_at_5_diff1
            value: -5.604031655005744
          - type: nauc_recall_at_5_max
            value: 19.580893429923695
          - type: nauc_recall_at_5_std
            value: 7.820361704579018
          - type: ndcg_at_1
            value: 87.441
          - type: ndcg_at_10
            value: 79.125
          - type: ndcg_at_100
            value: 81.45400000000001
          - type: ndcg_at_1000
            value: 82.25099999999999
          - type: ndcg_at_20
            value: 80.17
          - type: ndcg_at_3
            value: 74.956
          - type: ndcg_at_5
            value: 77.48
          - type: precision_at_1
            value: 87.441
          - type: precision_at_10
            value: 16.323999999999998
          - type: precision_at_100
            value: 1.8110000000000002
          - type: precision_at_1000
            value: 0.192
          - type: precision_at_20
            value: 8.498
          - type: precision_at_3
            value: 48.368
          - type: precision_at_5
            value: 31.002999999999997
          - type: recall_at_1
            value: 43.72
          - type: recall_at_10
            value: 81.621
          - type: recall_at_100
            value: 90.554
          - type: recall_at_1000
            value: 95.787
          - type: recall_at_20
            value: 84.983
          - type: recall_at_3
            value: 72.552
          - type: recall_at_5
            value: 77.508
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB MSMARCO
          revision: c5a29a104738b98a9e76336939199e264163d4a0
          split: dev
          type: mteb/msmarco
        metrics:
          - type: main_score
            value: 44.89
          - type: map_at_1
            value: 24.432000000000002
          - type: map_at_10
            value: 37.591
          - type: map_at_100
            value: 38.751000000000005
          - type: map_at_1000
            value: 38.79
          - type: map_at_20
            value: 38.322
          - type: map_at_3
            value: 33.505
          - type: map_at_5
            value: 35.859
          - type: mrr_at_1
            value: 25.171919770773638
          - type: mrr_at_10
            value: 38.21256310547136
          - type: mrr_at_100
            value: 39.30753721884505
          - type: mrr_at_1000
            value: 39.340691344391445
          - type: mrr_at_20
            value: 38.90961306475649
          - type: mrr_at_3
            value: 34.26456542502386
          - type: mrr_at_5
            value: 36.53748806112701
          - type: nauc_map_at_1000_diff1
            value: 38.66852221567241
          - type: nauc_map_at_1000_max
            value: 4.1057766737799595
          - type: nauc_map_at_1000_std
            value: -27.382157855077754
          - type: nauc_map_at_100_diff1
            value: 38.6621397928445
          - type: nauc_map_at_100_max
            value: 4.111681335095865
          - type: nauc_map_at_100_std
            value: -27.36539945792605
          - type: nauc_map_at_10_diff1
            value: 38.63319989433825
          - type: nauc_map_at_10_max
            value: 3.9346979349074953
          - type: nauc_map_at_10_std
            value: -28.0900393767871
          - type: nauc_map_at_1_diff1
            value: 41.71535844577686
          - type: nauc_map_at_1_max
            value: 3.4832962062214006
          - type: nauc_map_at_1_std
            value: -23.525528000333843
          - type: nauc_map_at_20_diff1
            value: 38.68062082411943
          - type: nauc_map_at_20_max
            value: 4.046538867480454
          - type: nauc_map_at_20_std
            value: -27.688449948610472
          - type: nauc_map_at_3_diff1
            value: 38.584342089335685
          - type: nauc_map_at_3_max
            value: 3.63965785769002
          - type: nauc_map_at_3_std
            value: -27.46268496496546
          - type: nauc_map_at_5_diff1
            value: 38.42816219182273
          - type: nauc_map_at_5_max
            value: 3.839849854247509
          - type: nauc_map_at_5_std
            value: -28.015487623173605
          - type: nauc_mrr_at_1000_diff1
            value: 38.232755814715766
          - type: nauc_mrr_at_1000_max
            value: 3.987692507096141
          - type: nauc_mrr_at_1000_std
            value: -26.888695263011808
          - type: nauc_mrr_at_100_diff1
            value: 38.22616005576646
          - type: nauc_mrr_at_100_max
            value: 3.9948619556899123
          - type: nauc_mrr_at_100_std
            value: -26.872832670267883
          - type: nauc_mrr_at_10_diff1
            value: 38.155508621490306
          - type: nauc_mrr_at_10_max
            value: 3.8153177084303582
          - type: nauc_mrr_at_10_std
            value: -27.546238510006503
          - type: nauc_mrr_at_1_diff1
            value: 41.26563649433227
          - type: nauc_mrr_at_1_max
            value: 3.2940832364845734
          - type: nauc_mrr_at_1_std
            value: -23.246326699010055
          - type: nauc_mrr_at_20_diff1
            value: 38.23581610598243
          - type: nauc_mrr_at_20_max
            value: 3.9519434237902455
          - type: nauc_mrr_at_20_std
            value: -27.153182984955542
          - type: nauc_mrr_at_3_diff1
            value: 38.123012505586516
          - type: nauc_mrr_at_3_max
            value: 3.5952793301902446
          - type: nauc_mrr_at_3_std
            value: -26.96557107215608
          - type: nauc_mrr_at_5_diff1
            value: 38.00080442994164
          - type: nauc_mrr_at_5_max
            value: 3.6611507063907838
          - type: nauc_mrr_at_5_std
            value: -27.5217700193094
          - type: nauc_ndcg_at_1000_diff1
            value: 38.08376371232426
          - type: nauc_ndcg_at_1000_max
            value: 4.741285538467179
          - type: nauc_ndcg_at_1000_std
            value: -26.876920597404325
          - type: nauc_ndcg_at_100_diff1
            value: 37.933209786580186
          - type: nauc_ndcg_at_100_max
            value: 5.003377252588231
          - type: nauc_ndcg_at_100_std
            value: -26.136134328732467
          - type: nauc_ndcg_at_10_diff1
            value: 37.82072609591181
          - type: nauc_ndcg_at_10_max
            value: 4.24748877233556
          - type: nauc_ndcg_at_10_std
            value: -29.766127219449835
          - type: nauc_ndcg_at_1_diff1
            value: 41.26563649433227
          - type: nauc_ndcg_at_1_max
            value: 3.2940832364845734
          - type: nauc_ndcg_at_1_std
            value: -23.246326699010055
          - type: nauc_ndcg_at_20_diff1
            value: 38.068479496194165
          - type: nauc_ndcg_at_20_max
            value: 4.686171701536077
          - type: nauc_ndcg_at_20_std
            value: -28.373083045837827
          - type: nauc_ndcg_at_3_diff1
            value: 37.664591050650714
          - type: nauc_ndcg_at_3_max
            value: 3.7238056730982425
          - type: nauc_ndcg_at_3_std
            value: -28.501705219533402
          - type: nauc_ndcg_at_5_diff1
            value: 37.39323161347562
          - type: nauc_ndcg_at_5_max
            value: 3.9884773576701846
          - type: nauc_ndcg_at_5_std
            value: -29.526098685579278
          - type: nauc_precision_at_1000_diff1
            value: -8.176278274893253
          - type: nauc_precision_at_1000_max
            value: 6.602206468153366
          - type: nauc_precision_at_1000_std
            value: 11.887969321516541
          - type: nauc_precision_at_100_diff1
            value: 10.776600450291125
          - type: nauc_precision_at_100_max
            value: 11.543791706232499
          - type: nauc_precision_at_100_std
            value: 8.05135325335674
          - type: nauc_precision_at_10_diff1
            value: 31.29891891655396
          - type: nauc_precision_at_10_max
            value: 4.793824130342508
          - type: nauc_precision_at_10_std
            value: -32.843126960584904
          - type: nauc_precision_at_1_diff1
            value: 41.26563649433227
          - type: nauc_precision_at_1_max
            value: 3.2940832364845734
          - type: nauc_precision_at_1_std
            value: -23.246326699010055
          - type: nauc_precision_at_20_diff1
            value: 28.39742040356656
          - type: nauc_precision_at_20_max
            value: 6.848015766561338
          - type: nauc_precision_at_20_std
            value: -24.61307381544946
          - type: nauc_precision_at_3_diff1
            value: 34.1967778945159
          - type: nauc_precision_at_3_max
            value: 3.6373839227371354
          - type: nauc_precision_at_3_std
            value: -31.262400131015795
          - type: nauc_precision_at_5_diff1
            value: 32.32839846166563
          - type: nauc_precision_at_5_max
            value: 4.2661314616361885
          - type: nauc_precision_at_5_std
            value: -32.94817957117079
          - type: nauc_recall_at_1000_diff1
            value: 25.124054710942882
          - type: nauc_recall_at_1000_max
            value: 52.99541699631579
          - type: nauc_recall_at_1000_std
            value: 63.880015110366394
          - type: nauc_recall_at_100_diff1
            value: 32.1323577870331
          - type: nauc_recall_at_100_max
            value: 17.26171631192854
          - type: nauc_recall_at_100_std
            value: 4.147658345720864
          - type: nauc_recall_at_10_diff1
            value: 35.35982089295331
          - type: nauc_recall_at_10_max
            value: 5.478913284596572
          - type: nauc_recall_at_10_std
            value: -35.93639290916612
          - type: nauc_recall_at_1_diff1
            value: 41.71535844577686
          - type: nauc_recall_at_1_max
            value: 3.4832962062214006
          - type: nauc_recall_at_1_std
            value: -23.525528000333843
          - type: nauc_recall_at_20_diff1
            value: 36.36549599422767
          - type: nauc_recall_at_20_max
            value: 8.112692947664327
          - type: nauc_recall_at_20_std
            value: -30.573957801286095
          - type: nauc_recall_at_3_diff1
            value: 35.227199657140844
          - type: nauc_recall_at_3_max
            value: 3.9474392083855445
          - type: nauc_recall_at_3_std
            value: -31.485135190684904
          - type: nauc_recall_at_5_diff1
            value: 34.435115639178505
          - type: nauc_recall_at_5_max
            value: 4.538709973891948
          - type: nauc_recall_at_5_std
            value: -34.07440191001999
          - type: ndcg_at_1
            value: 25.172
          - type: ndcg_at_10
            value: 44.89
          - type: ndcg_at_100
            value: 50.33800000000001
          - type: ndcg_at_1000
            value: 51.266999999999996
          - type: ndcg_at_20
            value: 47.455999999999996
          - type: ndcg_at_3
            value: 36.631
          - type: ndcg_at_5
            value: 40.801
          - type: precision_at_1
            value: 25.172
          - type: precision_at_10
            value: 7.0489999999999995
          - type: precision_at_100
            value: 0.976
          - type: precision_at_1000
            value: 0.106
          - type: precision_at_20
            value: 4.059
          - type: precision_at_3
            value: 15.554000000000002
          - type: precision_at_5
            value: 11.458
          - type: recall_at_1
            value: 24.432000000000002
          - type: recall_at_10
            value: 67.32900000000001
          - type: recall_at_100
            value: 92.23599999999999
          - type: recall_at_1000
            value: 99.21799999999999
          - type: recall_at_20
            value: 77.236
          - type: recall_at_3
            value: 44.926
          - type: recall_at_5
            value: 54.93599999999999
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB NFCorpus
          revision: ec0fa4fe99da2ff19ca1214b7966684033a58814
          split: test
          type: mteb/nfcorpus
        metrics:
          - type: main_score
            value: 45.059
          - type: map_at_1
            value: 7.51
          - type: map_at_10
            value: 17.696
          - type: map_at_100
            value: 23.425
          - type: map_at_1000
            value: 25.462
          - type: map_at_20
            value: 20.078
          - type: map_at_3
            value: 12.36
          - type: map_at_5
            value: 14.949000000000002
          - type: mrr_at_1
            value: 56.656346749226
          - type: mrr_at_10
            value: 64.5453093518109
          - type: mrr_at_100
            value: 65.03548614941461
          - type: mrr_at_1000
            value: 65.07113760571535
          - type: mrr_at_20
            value: 64.92649519989713
          - type: mrr_at_3
            value: 62.5902992776058
          - type: mrr_at_5
            value: 63.890608875129
          - type: nauc_map_at_1000_diff1
            value: 18.649436695375666
          - type: nauc_map_at_1000_max
            value: 32.21371026469436
          - type: nauc_map_at_1000_std
            value: 15.172576825419542
          - type: nauc_map_at_100_diff1
            value: 20.754932725250484
          - type: nauc_map_at_100_max
            value: 31.802273361479354
          - type: nauc_map_at_100_std
            value: 11.05184960109897
          - type: nauc_map_at_10_diff1
            value: 27.65114332743644
          - type: nauc_map_at_10_max
            value: 24.216308956707948
          - type: nauc_map_at_10_std
            value: -3.148160320265085
          - type: nauc_map_at_1_diff1
            value: 44.074701941156576
          - type: nauc_map_at_1_max
            value: 7.313976830684179
          - type: nauc_map_at_1_std
            value: -17.775136864794273
          - type: nauc_map_at_20_diff1
            value: 24.40381389925362
          - type: nauc_map_at_20_max
            value: 28.28590842979618
          - type: nauc_map_at_20_std
            value: 2.4199688163030033
          - type: nauc_map_at_3_diff1
            value: 36.43847181675257
          - type: nauc_map_at_3_max
            value: 12.641525583061982
          - type: nauc_map_at_3_std
            value: -13.213788837135754
          - type: nauc_map_at_5_diff1
            value: 31.38099882079377
          - type: nauc_map_at_5_max
            value: 18.693157001709874
          - type: nauc_map_at_5_std
            value: -9.06791377198616
          - type: nauc_mrr_at_1000_diff1
            value: 32.13397852247498
          - type: nauc_mrr_at_1000_max
            value: 50.13330116214628
          - type: nauc_mrr_at_1000_std
            value: 32.05378496757561
          - type: nauc_mrr_at_100_diff1
            value: 32.15640184504514
          - type: nauc_mrr_at_100_max
            value: 50.16596418746684
          - type: nauc_mrr_at_100_std
            value: 32.09654562666087
          - type: nauc_mrr_at_10_diff1
            value: 32.30697278515013
          - type: nauc_mrr_at_10_max
            value: 50.29554162816291
          - type: nauc_mrr_at_10_std
            value: 32.196301987204926
          - type: nauc_mrr_at_1_diff1
            value: 31.18633610462525
          - type: nauc_mrr_at_1_max
            value: 44.066192007922865
          - type: nauc_mrr_at_1_std
            value: 25.405697533712186
          - type: nauc_mrr_at_20_diff1
            value: 32.183918395170934
          - type: nauc_mrr_at_20_max
            value: 50.1063795003295
          - type: nauc_mrr_at_20_std
            value: 32.019605254607605
          - type: nauc_mrr_at_3_diff1
            value: 32.1841620866096
          - type: nauc_mrr_at_3_max
            value: 49.86413651460263
          - type: nauc_mrr_at_3_std
            value: 31.65393088251129
          - type: nauc_mrr_at_5_diff1
            value: 32.506293256782854
          - type: nauc_mrr_at_5_max
            value: 50.22051310167734
          - type: nauc_mrr_at_5_std
            value: 32.20883162067511
          - type: nauc_ndcg_at_1000_diff1
            value: 17.07651298169536
          - type: nauc_ndcg_at_1000_max
            value: 45.68207250664515
          - type: nauc_ndcg_at_1000_std
            value: 32.2202917954314
          - type: nauc_ndcg_at_100_diff1
            value: 17.903616207181084
          - type: nauc_ndcg_at_100_max
            value: 41.75926814949547
          - type: nauc_ndcg_at_100_std
            value: 28.203224194584394
          - type: nauc_ndcg_at_10_diff1
            value: 15.047796165484423
          - type: nauc_ndcg_at_10_max
            value: 42.932973260133025
          - type: nauc_ndcg_at_10_std
            value: 28.988863166538216
          - type: nauc_ndcg_at_1_diff1
            value: 31.424681423032517
          - type: nauc_ndcg_at_1_max
            value: 41.520899599635705
          - type: nauc_ndcg_at_1_std
            value: 25.06328981312087
          - type: nauc_ndcg_at_20_diff1
            value: 14.659965916220653
          - type: nauc_ndcg_at_20_max
            value: 40.660613171359536
          - type: nauc_ndcg_at_20_std
            value: 28.05980217396367
          - type: nauc_ndcg_at_3_diff1
            value: 20.74188837396788
          - type: nauc_ndcg_at_3_max
            value: 42.17291456152861
          - type: nauc_ndcg_at_3_std
            value: 25.51560749819014
          - type: nauc_ndcg_at_5_diff1
            value: 16.85211778345349
          - type: nauc_ndcg_at_5_max
            value: 43.984121150231836
          - type: nauc_ndcg_at_5_std
            value: 26.83926214905424
          - type: nauc_precision_at_1000_diff1
            value: -17.051131025174517
          - type: nauc_precision_at_1000_max
            value: 6.764059286595738
          - type: nauc_precision_at_1000_std
            value: 40.1439309994832
          - type: nauc_precision_at_100_diff1
            value: -15.764998544735823
          - type: nauc_precision_at_100_max
            value: 19.211111148845784
          - type: nauc_precision_at_100_std
            value: 46.96427473897526
          - type: nauc_precision_at_10_diff1
            value: -7.388798905334601
          - type: nauc_precision_at_10_max
            value: 41.22907941806041
          - type: nauc_precision_at_10_std
            value: 42.59884089023569
          - type: nauc_precision_at_1_diff1
            value: 32.025767729163995
          - type: nauc_precision_at_1_max
            value: 43.754075663448575
          - type: nauc_precision_at_1_std
            value: 25.43509133901274
          - type: nauc_precision_at_20_diff1
            value: -12.0078847232814
          - type: nauc_precision_at_20_max
            value: 33.27932495727302
          - type: nauc_precision_at_20_std
            value: 43.837569920515165
          - type: nauc_precision_at_3_diff1
            value: 7.042749712513677
          - type: nauc_precision_at_3_max
            value: 42.1936184896299
          - type: nauc_precision_at_3_std
            value: 30.484961204241984
          - type: nauc_precision_at_5_diff1
            value: -2.1371357099813832
          - type: nauc_precision_at_5_max
            value: 43.476640933633895
          - type: nauc_precision_at_5_std
            value: 35.117927839092914
          - type: nauc_recall_at_1000_diff1
            value: -0.8723013662864799
          - type: nauc_recall_at_1000_max
            value: 18.909026237682543
          - type: nauc_recall_at_1000_std
            value: 13.51570098053679
          - type: nauc_recall_at_100_diff1
            value: 12.357279426756397
          - type: nauc_recall_at_100_max
            value: 27.84208167172234
          - type: nauc_recall_at_100_std
            value: 14.49863872734005
          - type: nauc_recall_at_10_diff1
            value: 21.11009281729574
          - type: nauc_recall_at_10_max
            value: 19.74472802495254
          - type: nauc_recall_at_10_std
            value: -4.09630500503252
          - type: nauc_recall_at_1_diff1
            value: 44.074701941156576
          - type: nauc_recall_at_1_max
            value: 7.313976830684179
          - type: nauc_recall_at_1_std
            value: -17.775136864794273
          - type: nauc_recall_at_20_diff1
            value: 17.31518452608809
          - type: nauc_recall_at_20_max
            value: 23.399843692692237
          - type: nauc_recall_at_20_std
            value: 0.04814256658120452
          - type: nauc_recall_at_3_diff1
            value: 35.46183411619658
          - type: nauc_recall_at_3_max
            value: 12.787287273388953
          - type: nauc_recall_at_3_std
            value: -12.428077847406232
          - type: nauc_recall_at_5_diff1
            value: 25.630390779262065
          - type: nauc_recall_at_5_max
            value: 17.81997541214207
          - type: nauc_recall_at_5_std
            value: -7.819448998740632
          - type: ndcg_at_1
            value: 55.418
          - type: ndcg_at_10
            value: 45.059
          - type: ndcg_at_100
            value: 41.89
          - type: ndcg_at_1000
            value: 50.808
          - type: ndcg_at_20
            value: 42.528
          - type: ndcg_at_3
            value: 50.273999999999994
          - type: ndcg_at_5
            value: 48.311
          - type: precision_at_1
            value: 56.347
          - type: precision_at_10
            value: 33.684
          - type: precision_at_100
            value: 10.854
          - type: precision_at_1000
            value: 2.455
          - type: precision_at_20
            value: 25.294
          - type: precision_at_3
            value: 46.749
          - type: precision_at_5
            value: 42.167
          - type: recall_at_1
            value: 7.51
          - type: recall_at_10
            value: 22.7
          - type: recall_at_100
            value: 42.324
          - type: recall_at_1000
            value: 75.047
          - type: recall_at_20
            value: 28.091
          - type: recall_at_3
            value: 13.202
          - type: recall_at_5
            value: 17.573
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB NQ
          revision: b774495ed302d8c44a3a7ea25c90dbce03968f31
          split: test
          type: mteb/nq
        metrics:
          - type: main_score
            value: 72.439
          - type: map_at_1
            value: 48.588
          - type: map_at_10
            value: 65.667
          - type: map_at_100
            value: 66.23
          - type: map_at_1000
            value: 66.238
          - type: map_at_20
            value: 66.077
          - type: map_at_3
            value: 62.173
          - type: map_at_5
            value: 64.403
          - type: mrr_at_1
            value: 54.57705677867902
          - type: mrr_at_10
            value: 68.04977330831896
          - type: mrr_at_100
            value: 68.40133412359447
          - type: mrr_at_1000
            value: 68.40674582113029
          - type: mrr_at_20
            value: 68.32025711906769
          - type: mrr_at_3
            value: 65.68173039783692
          - type: mrr_at_5
            value: 67.12292390884501
          - type: nauc_map_at_1000_diff1
            value: 42.92613415901299
          - type: nauc_map_at_1000_max
            value: 31.58722964102006
          - type: nauc_map_at_1000_std
            value: -9.181430909023906
          - type: nauc_map_at_100_diff1
            value: 42.9286603531827
          - type: nauc_map_at_100_max
            value: 31.597761214322794
          - type: nauc_map_at_100_std
            value: -9.174864948929978
          - type: nauc_map_at_10_diff1
            value: 42.742103497799874
          - type: nauc_map_at_10_max
            value: 31.73600271519757
          - type: nauc_map_at_10_std
            value: -9.599976341144492
          - type: nauc_map_at_1_diff1
            value: 44.97465030457452
          - type: nauc_map_at_1_max
            value: 24.50842235041081
          - type: nauc_map_at_1_std
            value: -9.488301413929715
          - type: nauc_map_at_20_diff1
            value: 42.93789543281411
          - type: nauc_map_at_20_max
            value: 31.649530881844477
          - type: nauc_map_at_20_std
            value: -9.284482255074405
          - type: nauc_map_at_3_diff1
            value: 42.507020478710444
          - type: nauc_map_at_3_max
            value: 30.430161368656407
          - type: nauc_map_at_3_std
            value: -10.98022633967904
          - type: nauc_map_at_5_diff1
            value: 42.65908349342647
          - type: nauc_map_at_5_max
            value: 31.712314514485808
          - type: nauc_map_at_5_std
            value: -10.162495644166388
          - type: nauc_mrr_at_1000_diff1
            value: 43.07977164212382
          - type: nauc_mrr_at_1000_max
            value: 32.71613265858574
          - type: nauc_mrr_at_1000_std
            value: -6.309541407889255
          - type: nauc_mrr_at_100_diff1
            value: 43.08243504279048
          - type: nauc_mrr_at_100_max
            value: 32.72393721047513
          - type: nauc_mrr_at_100_std
            value: -6.304478684547192
          - type: nauc_mrr_at_10_diff1
            value: 42.9454520799358
          - type: nauc_mrr_at_10_max
            value: 32.98294125539359
          - type: nauc_mrr_at_10_std
            value: -6.344731638595535
          - type: nauc_mrr_at_1_diff1
            value: 44.86265224618521
          - type: nauc_mrr_at_1_max
            value: 28.722584310944548
          - type: nauc_mrr_at_1_std
            value: -5.987388514445873
          - type: nauc_mrr_at_20_diff1
            value: 43.09463525559641
          - type: nauc_mrr_at_20_max
            value: 32.78563812600394
          - type: nauc_mrr_at_20_std
            value: -6.3101564030679365
          - type: nauc_mrr_at_3_diff1
            value: 42.778839940801525
          - type: nauc_mrr_at_3_max
            value: 32.73472475200481
          - type: nauc_mrr_at_3_std
            value: -6.873684661851209
          - type: nauc_mrr_at_5_diff1
            value: 42.819150151235355
          - type: nauc_mrr_at_5_max
            value: 33.063649047927846
          - type: nauc_mrr_at_5_std
            value: -6.690698773431876
          - type: nauc_ndcg_at_1000_diff1
            value: 42.838890830794305
          - type: nauc_ndcg_at_1000_max
            value: 33.06212912224441
          - type: nauc_ndcg_at_1000_std
            value: -7.604830337911507
          - type: nauc_ndcg_at_100_diff1
            value: 42.92532259135676
          - type: nauc_ndcg_at_100_max
            value: 33.32105898079442
          - type: nauc_ndcg_at_100_std
            value: -7.41942657927501
          - type: nauc_ndcg_at_10_diff1
            value: 42.241497889945386
          - type: nauc_ndcg_at_10_max
            value: 34.314029244865395
          - type: nauc_ndcg_at_10_std
            value: -8.705170475797276
          - type: nauc_ndcg_at_1_diff1
            value: 44.935431451080625
          - type: nauc_ndcg_at_1_max
            value: 28.761716507796287
          - type: nauc_ndcg_at_1_std
            value: -5.910155765778751
          - type: nauc_ndcg_at_20_diff1
            value: 42.98682996645045
          - type: nauc_ndcg_at_20_max
            value: 33.77639762275077
          - type: nauc_ndcg_at_20_std
            value: -7.922192840991434
          - type: nauc_ndcg_at_3_diff1
            value: 41.78169420045572
          - type: nauc_ndcg_at_3_max
            value: 32.28874867052525
          - type: nauc_ndcg_at_3_std
            value: -10.746022839903787
          - type: nauc_ndcg_at_5_diff1
            value: 41.98111900699031
          - type: nauc_ndcg_at_5_max
            value: 34.16892401395189
          - type: nauc_ndcg_at_5_std
            value: -9.835814208233074
          - type: nauc_precision_at_1000_diff1
            value: -13.893084426310164
          - type: nauc_precision_at_1000_max
            value: 4.528511169827012
          - type: nauc_precision_at_1000_std
            value: 19.808766541210563
          - type: nauc_precision_at_100_diff1
            value: -11.662187818787977
          - type: nauc_precision_at_100_max
            value: 7.106144289556965
          - type: nauc_precision_at_100_std
            value: 20.196725761912955
          - type: nauc_precision_at_10_diff1
            value: -0.0005202624402562934
          - type: nauc_precision_at_10_max
            value: 20.3322025815174
          - type: nauc_precision_at_10_std
            value: 10.996026572368203
          - type: nauc_precision_at_1_diff1
            value: 44.935431451080625
          - type: nauc_precision_at_1_max
            value: 28.761716507796287
          - type: nauc_precision_at_1_std
            value: -5.910155765778751
          - type: nauc_precision_at_20_diff1
            value: -5.251925401801626
          - type: nauc_precision_at_20_max
            value: 13.778502821797181
          - type: nauc_precision_at_20_std
            value: 16.678382538020593
          - type: nauc_precision_at_3_diff1
            value: 18.484347552428737
          - type: nauc_precision_at_3_max
            value: 29.23890691678369
          - type: nauc_precision_at_3_std
            value: -0.9617922081812927
          - type: nauc_precision_at_5_diff1
            value: 9.520921672164247
          - type: nauc_precision_at_5_max
            value: 26.114118384437084
          - type: nauc_precision_at_5_std
            value: 4.480542966435442
          - type: nauc_recall_at_1000_diff1
            value: 36.483312921782804
          - type: nauc_recall_at_1000_max
            value: 93.65683358360806
          - type: nauc_recall_at_1000_std
            value: 78.98396666115225
          - type: nauc_recall_at_100_diff1
            value: 51.223962258353374
          - type: nauc_recall_at_100_max
            value: 71.21642758603197
          - type: nauc_recall_at_100_std
            value: 29.03844845781408
          - type: nauc_recall_at_10_diff1
            value: 36.54228767944346
          - type: nauc_recall_at_10_max
            value: 48.045414485215495
          - type: nauc_recall_at_10_std
            value: -10.991004552070361
          - type: nauc_recall_at_1_diff1
            value: 44.97465030457452
          - type: nauc_recall_at_1_max
            value: 24.50842235041081
          - type: nauc_recall_at_1_std
            value: -9.488301413929715
          - type: nauc_recall_at_20_diff1
            value: 44.42937548103678
          - type: nauc_recall_at_20_max
            value: 52.02797641154168
          - type: nauc_recall_at_20_std
            value: -5.274872422912074
          - type: nauc_recall_at_3_diff1
            value: 37.370700905004796
          - type: nauc_recall_at_3_max
            value: 35.051545542223735
          - type: nauc_recall_at_3_std
            value: -14.47614675395727
          - type: nauc_recall_at_5_diff1
            value: 36.923681333914296
          - type: nauc_recall_at_5_max
            value: 41.76113305221287
          - type: nauc_recall_at_5_std
            value: -13.792057613912453
          - type: ndcg_at_1
            value: 54.547999999999995
          - type: ndcg_at_10
            value: 72.439
          - type: ndcg_at_100
            value: 74.505
          - type: ndcg_at_1000
            value: 74.656
          - type: ndcg_at_20
            value: 73.708
          - type: ndcg_at_3
            value: 66.416
          - type: ndcg_at_5
            value: 69.783
          - type: precision_at_1
            value: 54.547999999999995
          - type: precision_at_10
            value: 10.831
          - type: precision_at_100
            value: 1.201
          - type: precision_at_1000
            value: 0.121
          - type: precision_at_20
            value: 5.734
          - type: precision_at_3
            value: 29.287000000000003
          - type: precision_at_5
            value: 19.676
          - type: recall_at_1
            value: 48.588
          - type: recall_at_10
            value: 90.271
          - type: recall_at_100
            value: 98.663
          - type: recall_at_1000
            value: 99.754
          - type: recall_at_20
            value: 94.911
          - type: recall_at_3
            value: 75.14699999999999
          - type: recall_at_5
            value: 82.657
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB QuoraRetrieval
          revision: e4e08e0b7dbe3c8700f0daef558ff32256715259
          split: test
          type: mteb/quora
        metrics:
          - type: main_score
            value: 88.776
          - type: map_at_1
            value: 70.789
          - type: map_at_10
            value: 85.111
          - type: map_at_100
            value: 85.74300000000001
          - type: map_at_1000
            value: 85.757
          - type: map_at_20
            value: 85.541
          - type: map_at_3
            value: 82.16799999999999
          - type: map_at_5
            value: 84.027
          - type: mrr_at_1
            value: 81.61
          - type: mrr_at_10
            value: 87.83598809523794
          - type: mrr_at_100
            value: 87.93437534934736
          - type: mrr_at_1000
            value: 87.93537663994458
          - type: mrr_at_20
            value: 87.91460020324512
          - type: mrr_at_3
            value: 86.91999999999982
          - type: mrr_at_5
            value: 87.57549999999974
          - type: nauc_map_at_1000_diff1
            value: 76.95785603654109
          - type: nauc_map_at_1000_max
            value: 22.21137147646329
          - type: nauc_map_at_1000_std
            value: -57.67191596659913
          - type: nauc_map_at_100_diff1
            value: 76.96066980419408
          - type: nauc_map_at_100_max
            value: 22.18444499684965
          - type: nauc_map_at_100_std
            value: -57.73426948321203
          - type: nauc_map_at_10_diff1
            value: 77.27294101132748
          - type: nauc_map_at_10_max
            value: 21.520023788398827
          - type: nauc_map_at_10_std
            value: -60.149831861475946
          - type: nauc_map_at_1_diff1
            value: 80.82075671924613
          - type: nauc_map_at_1_max
            value: 16.73924350448738
          - type: nauc_map_at_1_std
            value: -49.025641726356106
          - type: nauc_map_at_20_diff1
            value: 77.03897352655657
          - type: nauc_map_at_20_max
            value: 21.879911910556256
          - type: nauc_map_at_20_std
            value: -58.72111603413064
          - type: nauc_map_at_3_diff1
            value: 77.80825908555062
          - type: nauc_map_at_3_max
            value: 19.74347230686499
          - type: nauc_map_at_3_std
            value: -61.14048758808322
          - type: nauc_map_at_5_diff1
            value: 77.64191093638766
          - type: nauc_map_at_5_max
            value: 20.82641310481968
          - type: nauc_map_at_5_std
            value: -61.5227187788429
          - type: nauc_mrr_at_1000_diff1
            value: 77.07743481780578
          - type: nauc_mrr_at_1000_max
            value: 24.973854693758668
          - type: nauc_mrr_at_1000_std
            value: -53.00097552882813
          - type: nauc_mrr_at_100_diff1
            value: 77.07743779388264
          - type: nauc_mrr_at_100_max
            value: 24.97578180973678
          - type: nauc_mrr_at_100_std
            value: -52.999857842949375
          - type: nauc_mrr_at_10_diff1
            value: 77.08832159626124
          - type: nauc_mrr_at_10_max
            value: 24.847950790779755
          - type: nauc_mrr_at_10_std
            value: -53.354412157484596
          - type: nauc_mrr_at_1_diff1
            value: 77.90054473035877
          - type: nauc_mrr_at_1_max
            value: 25.435382042849454
          - type: nauc_mrr_at_1_std
            value: -48.65542470772514
          - type: nauc_mrr_at_20_diff1
            value: 77.07410903358165
          - type: nauc_mrr_at_20_max
            value: 24.936803370937003
          - type: nauc_mrr_at_20_std
            value: -53.05367000547051
          - type: nauc_mrr_at_3_diff1
            value: 76.79835377348654
          - type: nauc_mrr_at_3_max
            value: 24.83960583182869
          - type: nauc_mrr_at_3_std
            value: -53.937122802902906
          - type: nauc_mrr_at_5_diff1
            value: 77.0611598562459
          - type: nauc_mrr_at_5_max
            value: 25.110143361000386
          - type: nauc_mrr_at_5_std
            value: -53.66721083549211
          - type: nauc_ndcg_at_1000_diff1
            value: 76.6539942038112
          - type: nauc_ndcg_at_1000_max
            value: 23.44145468342362
          - type: nauc_ndcg_at_1000_std
            value: -55.778951082488604
          - type: nauc_ndcg_at_100_diff1
            value: 76.63968651875747
          - type: nauc_ndcg_at_100_max
            value: 23.37238335196869
          - type: nauc_ndcg_at_100_std
            value: -56.013444819578936
          - type: nauc_ndcg_at_10_diff1
            value: 76.91486559815172
          - type: nauc_ndcg_at_10_max
            value: 21.882218185355374
          - type: nauc_ndcg_at_10_std
            value: -60.447241565220914
          - type: nauc_ndcg_at_1_diff1
            value: 77.91920303932993
          - type: nauc_ndcg_at_1_max
            value: 25.506195225143564
          - type: nauc_ndcg_at_1_std
            value: -48.66289988343474
          - type: nauc_ndcg_at_20_diff1
            value: 76.70353035362932
          - type: nauc_ndcg_at_20_max
            value: 22.52326792272016
          - type: nauc_ndcg_at_20_std
            value: -58.228058595950415
          - type: nauc_ndcg_at_3_diff1
            value: 76.19291654415437
          - type: nauc_ndcg_at_3_max
            value: 21.680157583116596
          - type: nauc_ndcg_at_3_std
            value: -59.78592789656886
          - type: nauc_ndcg_at_5_diff1
            value: 76.94117372509868
          - type: nauc_ndcg_at_5_max
            value: 21.80365013527183
          - type: nauc_ndcg_at_5_std
            value: -61.23723747585645
          - type: nauc_precision_at_1000_diff1
            value: -44.43454847128405
          - type: nauc_precision_at_1000_max
            value: 1.1086245603647116
          - type: nauc_precision_at_1000_std
            value: 45.957621410588445
          - type: nauc_precision_at_100_diff1
            value: -44.21353890734024
          - type: nauc_precision_at_100_max
            value: 0.8667205449931505
          - type: nauc_precision_at_100_std
            value: 44.55558297469162
          - type: nauc_precision_at_10_diff1
            value: -39.446583654372816
          - type: nauc_precision_at_10_max
            value: 1.0745424122581824
          - type: nauc_precision_at_10_std
            value: 27.715199044430115
          - type: nauc_precision_at_1_diff1
            value: 77.91920303932993
          - type: nauc_precision_at_1_max
            value: 25.506195225143564
          - type: nauc_precision_at_1_std
            value: -48.66289988343474
          - type: nauc_precision_at_20_diff1
            value: -42.82034326897596
          - type: nauc_precision_at_20_max
            value: 0.1871272488795601
          - type: nauc_precision_at_20_std
            value: 36.44930040826729
          - type: nauc_precision_at_3_diff1
            value: -20.17153834304044
          - type: nauc_precision_at_3_max
            value: 6.091482816522112
          - type: nauc_precision_at_3_std
            value: 2.2214080229171813
          - type: nauc_precision_at_5_diff1
            value: -32.30370373592924
          - type: nauc_precision_at_5_max
            value: 3.283007853748956
          - type: nauc_precision_at_5_std
            value: 15.671527569593394
          - type: nauc_recall_at_1000_diff1
            value: 25.2608289691968
          - type: nauc_recall_at_1000_max
            value: 39.63179474797547
          - type: nauc_recall_at_1000_std
            value: 25.74798035229638
          - type: nauc_recall_at_100_diff1
            value: 68.6766275832437
          - type: nauc_recall_at_100_max
            value: 24.369103177128636
          - type: nauc_recall_at_100_std
            value: -62.93899349940275
          - type: nauc_recall_at_10_diff1
            value: 73.75469598044158
          - type: nauc_recall_at_10_max
            value: 10.798765439257565
          - type: nauc_recall_at_10_std
            value: -90.65150692145126
          - type: nauc_recall_at_1_diff1
            value: 80.82075671924613
          - type: nauc_recall_at_1_max
            value: 16.73924350448738
          - type: nauc_recall_at_1_std
            value: -49.025641726356106
          - type: nauc_recall_at_20_diff1
            value: 71.88106544370252
          - type: nauc_recall_at_20_max
            value: 8.617919317783445
          - type: nauc_recall_at_20_std
            value: -88.64614006261976
          - type: nauc_recall_at_3_diff1
            value: 73.67512305142627
          - type: nauc_recall_at_3_max
            value: 14.522053228776684
          - type: nauc_recall_at_3_std
            value: -72.6164829975551
          - type: nauc_recall_at_5_diff1
            value: 73.55224072247896
          - type: nauc_recall_at_5_max
            value: 14.028581019140384
          - type: nauc_recall_at_5_std
            value: -81.70290837756839
          - type: ndcg_at_1
            value: 81.6
          - type: ndcg_at_10
            value: 88.776
          - type: ndcg_at_100
            value: 89.91799999999999
          - type: ndcg_at_1000
            value: 90.001
          - type: ndcg_at_20
            value: 89.45100000000001
          - type: ndcg_at_3
            value: 86.055
          - type: ndcg_at_5
            value: 87.603
          - type: precision_at_1
            value: 81.6
          - type: precision_at_10
            value: 13.527000000000001
          - type: precision_at_100
            value: 1.538
          - type: precision_at_1000
            value: 0.157
          - type: precision_at_20
            value: 7.183000000000001
          - type: precision_at_3
            value: 37.81
          - type: precision_at_5
            value: 24.874
          - type: recall_at_1
            value: 70.789
          - type: recall_at_10
            value: 95.829
          - type: recall_at_100
            value: 99.626
          - type: recall_at_1000
            value: 99.99900000000001
          - type: recall_at_20
            value: 98.008
          - type: recall_at_3
            value: 88.005
          - type: recall_at_5
            value: 92.394
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB SCIDOCS
          revision: f8c2fcf00f625baaa80f62ec5bd9e1fff3b8ae88
          split: test
          type: mteb/scidocs
        metrics:
          - type: main_score
            value: 22.555
          - type: map_at_1
            value: 5.093
          - type: map_at_10
            value: 13.636000000000001
          - type: map_at_100
            value: 16.169
          - type: map_at_1000
            value: 16.491
          - type: map_at_20
            value: 14.967
          - type: map_at_3
            value: 9.759
          - type: map_at_5
            value: 11.61
          - type: mrr_at_1
            value: 25.1
          - type: mrr_at_10
            value: 37.03158730158728
          - type: mrr_at_100
            value: 38.10841522691227
          - type: mrr_at_1000
            value: 38.157760714646216
          - type: mrr_at_20
            value: 37.71533302009304
          - type: mrr_at_3
            value: 33.599999999999994
          - type: mrr_at_5
            value: 35.47499999999996
          - type: nauc_map_at_1000_diff1
            value: 16.016506811794674
          - type: nauc_map_at_1000_max
            value: 26.980626723493234
          - type: nauc_map_at_1000_std
            value: 6.344668577266132
          - type: nauc_map_at_100_diff1
            value: 16.106273177734288
          - type: nauc_map_at_100_max
            value: 27.078961630580306
          - type: nauc_map_at_100_std
            value: 6.114177505174807
          - type: nauc_map_at_10_diff1
            value: 17.401956757885728
          - type: nauc_map_at_10_max
            value: 26.276474643260777
          - type: nauc_map_at_10_std
            value: 3.005814701827781
          - type: nauc_map_at_1_diff1
            value: 20.70536617482489
          - type: nauc_map_at_1_max
            value: 16.988060184234318
          - type: nauc_map_at_1_std
            value: -3.4275203611745013
          - type: nauc_map_at_20_diff1
            value: 16.56893037536464
          - type: nauc_map_at_20_max
            value: 26.994627506463566
          - type: nauc_map_at_20_std
            value: 4.443682314555823
          - type: nauc_map_at_3_diff1
            value: 17.771054815531336
          - type: nauc_map_at_3_max
            value: 22.25552550616846
          - type: nauc_map_at_3_std
            value: -1.1135548486711386
          - type: nauc_map_at_5_diff1
            value: 18.234751966525035
          - type: nauc_map_at_5_max
            value: 24.74090977327922
          - type: nauc_map_at_5_std
            value: 0.20984608573778366
          - type: nauc_mrr_at_1000_diff1
            value: 16.43908145424862
          - type: nauc_mrr_at_1000_max
            value: 19.50975861939652
          - type: nauc_mrr_at_1000_std
            value: 1.0711066308930413
          - type: nauc_mrr_at_100_diff1
            value: 16.449978087023602
          - type: nauc_mrr_at_100_max
            value: 19.546163139729455
          - type: nauc_mrr_at_100_std
            value: 1.1255804840602446
          - type: nauc_mrr_at_10_diff1
            value: 16.349572894206453
          - type: nauc_mrr_at_10_max
            value: 19.36607987819692
          - type: nauc_mrr_at_10_std
            value: 0.6815489423750116
          - type: nauc_mrr_at_1_diff1
            value: 20.81511754780404
          - type: nauc_mrr_at_1_max
            value: 17.31621820467371
          - type: nauc_mrr_at_1_std
            value: -3.062161046879616
          - type: nauc_mrr_at_20_diff1
            value: 16.453078176658412
          - type: nauc_mrr_at_20_max
            value: 19.61511763534643
          - type: nauc_mrr_at_20_std
            value: 1.1504468243169772
          - type: nauc_mrr_at_3_diff1
            value: 16.45317063630442
          - type: nauc_mrr_at_3_max
            value: 18.820538793222735
          - type: nauc_mrr_at_3_std
            value: -0.505799010681032
          - type: nauc_mrr_at_5_diff1
            value: 16.239396076435447
          - type: nauc_mrr_at_5_max
            value: 19.514405308342404
          - type: nauc_mrr_at_5_std
            value: 0.42152258676157106
          - type: nauc_ndcg_at_1000_diff1
            value: 12.799637809854447
          - type: nauc_ndcg_at_1000_max
            value: 26.286436521297098
          - type: nauc_ndcg_at_1000_std
            value: 13.849793575042407
          - type: nauc_ndcg_at_100_diff1
            value: 13.780919818793214
          - type: nauc_ndcg_at_100_max
            value: 27.263414842629384
          - type: nauc_ndcg_at_100_std
            value: 12.844324409823212
          - type: nauc_ndcg_at_10_diff1
            value: 15.691735156401645
          - type: nauc_ndcg_at_10_max
            value: 25.546421591723778
          - type: nauc_ndcg_at_10_std
            value: 5.030693260079141
          - type: nauc_ndcg_at_1_diff1
            value: 20.81511754780404
          - type: nauc_ndcg_at_1_max
            value: 17.31621820467371
          - type: nauc_ndcg_at_1_std
            value: -3.062161046879616
          - type: nauc_ndcg_at_20_diff1
            value: 14.918017633315037
          - type: nauc_ndcg_at_20_max
            value: 27.198495675799926
          - type: nauc_ndcg_at_20_std
            value: 7.859145154218754
          - type: nauc_ndcg_at_3_diff1
            value: 16.45411219760524
          - type: nauc_ndcg_at_3_max
            value: 21.843580863721826
          - type: nauc_ndcg_at_3_std
            value: 0.25079066807691736
          - type: nauc_ndcg_at_5_diff1
            value: 16.51852886026338
          - type: nauc_ndcg_at_5_max
            value: 24.32358445742888
          - type: nauc_ndcg_at_5_std
            value: 2.0046033593381365
          - type: nauc_precision_at_1000_diff1
            value: -3.043549167595678
          - type: nauc_precision_at_1000_max
            value: 17.721081069519855
          - type: nauc_precision_at_1000_std
            value: 34.394832596775096
          - type: nauc_precision_at_100_diff1
            value: 5.918389112534078
          - type: nauc_precision_at_100_max
            value: 25.041523333915638
          - type: nauc_precision_at_100_std
            value: 26.422448938245065
          - type: nauc_precision_at_10_diff1
            value: 12.559354156188075
          - type: nauc_precision_at_10_max
            value: 27.102948515447505
          - type: nauc_precision_at_10_std
            value: 9.922230490706765
          - type: nauc_precision_at_1_diff1
            value: 20.81511754780404
          - type: nauc_precision_at_1_max
            value: 17.31621820467371
          - type: nauc_precision_at_1_std
            value: -3.062161046879616
          - type: nauc_precision_at_20_diff1
            value: 10.239015656701062
          - type: nauc_precision_at_20_max
            value: 28.631431971198385
          - type: nauc_precision_at_20_std
            value: 14.923889979389953
          - type: nauc_precision_at_3_diff1
            value: 14.715917541943435
          - type: nauc_precision_at_3_max
            value: 23.488016057716443
          - type: nauc_precision_at_3_std
            value: 1.8688429519876193
          - type: nauc_precision_at_5_diff1
            value: 14.607533180532764
          - type: nauc_precision_at_5_max
            value: 26.69556237014592
          - type: nauc_precision_at_5_std
            value: 4.869786655689707
          - type: nauc_recall_at_1000_diff1
            value: -3.592050112505089
          - type: nauc_recall_at_1000_max
            value: 17.35902743346563
          - type: nauc_recall_at_1000_std
            value: 35.46357913035807
          - type: nauc_recall_at_100_diff1
            value: 5.712224816491693
          - type: nauc_recall_at_100_max
            value: 24.952810805795224
          - type: nauc_recall_at_100_std
            value: 26.49557743326384
          - type: nauc_recall_at_10_diff1
            value: 12.374218338608538
          - type: nauc_recall_at_10_max
            value: 26.5955214750823
          - type: nauc_recall_at_10_std
            value: 9.623097045252097
          - type: nauc_recall_at_1_diff1
            value: 20.70536617482489
          - type: nauc_recall_at_1_max
            value: 16.988060184234318
          - type: nauc_recall_at_1_std
            value: -3.4275203611745013
          - type: nauc_recall_at_20_diff1
            value: 10.079156462598272
          - type: nauc_recall_at_20_max
            value: 28.130382940517656
          - type: nauc_recall_at_20_std
            value: 14.778620879657767
          - type: nauc_recall_at_3_diff1
            value: 14.445322713318905
          - type: nauc_recall_at_3_max
            value: 22.913177040177732
          - type: nauc_recall_at_3_std
            value: 1.3968297812096289
          - type: nauc_recall_at_5_diff1
            value: 14.300977741042697
          - type: nauc_recall_at_5_max
            value: 26.064746286034463
          - type: nauc_recall_at_5_std
            value: 4.468436508425328
          - type: ndcg_at_1
            value: 25.1
          - type: ndcg_at_10
            value: 22.555
          - type: ndcg_at_100
            value: 31.558000000000003
          - type: ndcg_at_1000
            value: 36.866
          - type: ndcg_at_20
            value: 25.954
          - type: ndcg_at_3
            value: 21.488
          - type: ndcg_at_5
            value: 18.656
          - type: precision_at_1
            value: 25.1
          - type: precision_at_10
            value: 11.82
          - type: precision_at_100
            value: 2.465
          - type: precision_at_1000
            value: 0.373
          - type: precision_at_20
            value: 7.870000000000001
          - type: precision_at_3
            value: 20.467
          - type: precision_at_5
            value: 16.520000000000003
          - type: recall_at_1
            value: 5.093
          - type: recall_at_10
            value: 23.953
          - type: recall_at_100
            value: 50.03999999999999
          - type: recall_at_1000
            value: 75.74499999999999
          - type: recall_at_20
            value: 31.923000000000002
          - type: recall_at_3
            value: 12.468
          - type: recall_at_5
            value: 16.773
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB SciFact
          revision: 0228b52cf27578f30900b9e5271d331663a030d7
          split: test
          type: mteb/scifact
        metrics:
          - type: main_score
            value: 81.313
          - type: map_at_1
            value: 67.38300000000001
          - type: map_at_10
            value: 77.017
          - type: map_at_100
            value: 77.321
          - type: map_at_1000
            value: 77.331
          - type: map_at_20
            value: 77.262
          - type: map_at_3
            value: 74.111
          - type: map_at_5
            value: 75.881
          - type: mrr_at_1
            value: 70.33333333333334
          - type: mrr_at_10
            value: 77.81560846560845
          - type: mrr_at_100
            value: 78.00735197296981
          - type: mrr_at_1000
            value: 78.01761089473817
          - type: mrr_at_20
            value: 77.95766363266362
          - type: mrr_at_3
            value: 75.72222222222223
          - type: mrr_at_5
            value: 77.00555555555557
          - type: nauc_map_at_1000_diff1
            value: 75.04841791054689
          - type: nauc_map_at_1000_max
            value: 58.36172663414763
          - type: nauc_map_at_1000_std
            value: -11.893595632272119
          - type: nauc_map_at_100_diff1
            value: 75.05064539007354
          - type: nauc_map_at_100_max
            value: 58.37324776917011
          - type: nauc_map_at_100_std
            value: -11.877215894403568
          - type: nauc_map_at_10_diff1
            value: 74.75549994121076
          - type: nauc_map_at_10_max
            value: 58.24150489656241
          - type: nauc_map_at_10_std
            value: -12.344245577155307
          - type: nauc_map_at_1_diff1
            value: 76.73802929240316
          - type: nauc_map_at_1_max
            value: 51.51486878608817
          - type: nauc_map_at_1_std
            value: -18.187044359595266
          - type: nauc_map_at_20_diff1
            value: 75.01108764373232
          - type: nauc_map_at_20_max
            value: 58.428062710077334
          - type: nauc_map_at_20_std
            value: -11.884812488296847
          - type: nauc_map_at_3_diff1
            value: 75.76878808666785
          - type: nauc_map_at_3_max
            value: 55.0893236506397
          - type: nauc_map_at_3_std
            value: -18.680147004087416
          - type: nauc_map_at_5_diff1
            value: 75.21872474724155
          - type: nauc_map_at_5_max
            value: 56.99417811848851
          - type: nauc_map_at_5_std
            value: -15.023574589807998
          - type: nauc_mrr_at_1000_diff1
            value: 75.30185058060118
          - type: nauc_mrr_at_1000_max
            value: 58.99827784504953
          - type: nauc_mrr_at_1000_std
            value: -9.180976480652097
          - type: nauc_mrr_at_100_diff1
            value: 75.3039902169212
          - type: nauc_mrr_at_100_max
            value: 59.0096982171748
          - type: nauc_mrr_at_100_std
            value: -9.165687912589478
          - type: nauc_mrr_at_10_diff1
            value: 75.06584397042454
          - type: nauc_mrr_at_10_max
            value: 59.059479758705095
          - type: nauc_mrr_at_10_std
            value: -9.171739325385065
          - type: nauc_mrr_at_1_diff1
            value: 76.94126061472998
          - type: nauc_mrr_at_1_max
            value: 58.63634435063004
          - type: nauc_mrr_at_1_std
            value: -7.595328003491241
          - type: nauc_mrr_at_20_diff1
            value: 75.25985436830398
          - type: nauc_mrr_at_20_max
            value: 59.047844055490515
          - type: nauc_mrr_at_20_std
            value: -9.217229457280327
          - type: nauc_mrr_at_3_diff1
            value: 75.70972174140121
          - type: nauc_mrr_at_3_max
            value: 58.53109550921837
          - type: nauc_mrr_at_3_std
            value: -11.233362761574888
          - type: nauc_mrr_at_5_diff1
            value: 75.3027582677559
          - type: nauc_mrr_at_5_max
            value: 58.51186203154683
          - type: nauc_mrr_at_5_std
            value: -10.2389936280827
          - type: nauc_ndcg_at_1000_diff1
            value: 74.73042662069368
          - type: nauc_ndcg_at_1000_max
            value: 59.234679098286435
          - type: nauc_ndcg_at_1000_std
            value: -10.056585749544686
          - type: nauc_ndcg_at_100_diff1
            value: 74.77417755774573
          - type: nauc_ndcg_at_100_max
            value: 59.56267106047054
          - type: nauc_ndcg_at_100_std
            value: -9.507635585959678
          - type: nauc_ndcg_at_10_diff1
            value: 73.51173182085725
          - type: nauc_ndcg_at_10_max
            value: 59.488170283330234
          - type: nauc_ndcg_at_10_std
            value: -10.720733926384735
          - type: nauc_ndcg_at_1_diff1
            value: 76.94126061472998
          - type: nauc_ndcg_at_1_max
            value: 58.63634435063004
          - type: nauc_ndcg_at_1_std
            value: -7.595328003491241
          - type: nauc_ndcg_at_20_diff1
            value: 74.40614935696766
          - type: nauc_ndcg_at_20_max
            value: 59.958864387137226
          - type: nauc_ndcg_at_20_std
            value: -9.611226342001965
          - type: nauc_ndcg_at_3_diff1
            value: 75.17084819068555
          - type: nauc_ndcg_at_3_max
            value: 57.01635203576452
          - type: nauc_ndcg_at_3_std
            value: -16.69034944254818
          - type: nauc_ndcg_at_5_diff1
            value: 74.42154242123861
          - type: nauc_ndcg_at_5_max
            value: 56.96751544369478
          - type: nauc_ndcg_at_5_std
            value: -15.466581364009777
          - type: nauc_precision_at_1000_diff1
            value: -29.885864068853113
          - type: nauc_precision_at_1000_max
            value: 15.246331345070333
          - type: nauc_precision_at_1000_std
            value: 64.18030587603968
          - type: nauc_precision_at_100_diff1
            value: -22.526159307459164
          - type: nauc_precision_at_100_max
            value: 19.83878305556087
          - type: nauc_precision_at_100_std
            value: 61.81734299609778
          - type: nauc_precision_at_10_diff1
            value: -9.744869185690087
          - type: nauc_precision_at_10_max
            value: 30.835764902042573
          - type: nauc_precision_at_10_std
            value: 51.66797440109854
          - type: nauc_precision_at_1_diff1
            value: 76.94126061472998
          - type: nauc_precision_at_1_max
            value: 58.63634435063004
          - type: nauc_precision_at_1_std
            value: -7.595328003491241
          - type: nauc_precision_at_20_diff1
            value: -15.854662566288075
          - type: nauc_precision_at_20_max
            value: 25.540596169213263
          - type: nauc_precision_at_20_std
            value: 57.87224253577742
          - type: nauc_precision_at_3_diff1
            value: 36.685786823107975
          - type: nauc_precision_at_3_max
            value: 45.39544319415371
          - type: nauc_precision_at_3_std
            value: 8.267737553608583
          - type: nauc_precision_at_5_diff1
            value: 15.315102224001208
          - type: nauc_precision_at_5_max
            value: 39.43523589454333
          - type: nauc_precision_at_5_std
            value: 29.17523334728261
          - type: nauc_recall_at_1000_diff1
            value: null
          - type: nauc_recall_at_1000_max
            value: null
          - type: nauc_recall_at_1000_std
            value: null
          - type: nauc_recall_at_100_diff1
            value: 77.35760971055122
          - type: nauc_recall_at_100_max
            value: 82.1661998132589
          - type: nauc_recall_at_100_std
            value: 29.74789915966396
          - type: nauc_recall_at_10_diff1
            value: 60.19810822879889
          - type: nauc_recall_at_10_max
            value: 65.9952096780744
          - type: nauc_recall_at_10_std
            value: -8.764259326919047
          - type: nauc_recall_at_1_diff1
            value: 76.73802929240316
          - type: nauc_recall_at_1_max
            value: 51.51486878608817
          - type: nauc_recall_at_1_std
            value: -18.187044359595266
          - type: nauc_recall_at_20_diff1
            value: 66.887914586124
          - type: nauc_recall_at_20_max
            value: 77.53014249177924
          - type: nauc_recall_at_20_std
            value: 6.2375674907644045
          - type: nauc_recall_at_3_diff1
            value: 73.15618370243749
          - type: nauc_recall_at_3_max
            value: 51.8421919050744
          - type: nauc_recall_at_3_std
            value: -30.197347334361
          - type: nauc_recall_at_5_diff1
            value: 69.63152781695797
          - type: nauc_recall_at_5_max
            value: 52.313360589975076
          - type: nauc_recall_at_5_std
            value: -27.475502645659226
          - type: ndcg_at_1
            value: 70.333
          - type: ndcg_at_10
            value: 81.313
          - type: ndcg_at_100
            value: 82.419
          - type: ndcg_at_1000
            value: 82.645
          - type: ndcg_at_20
            value: 82.013
          - type: ndcg_at_3
            value: 76.632
          - type: ndcg_at_5
            value: 79.077
          - type: precision_at_1
            value: 70.333
          - type: precision_at_10
            value: 10.567
          - type: precision_at_100
            value: 1.113
          - type: precision_at_1000
            value: 0.11299999999999999
          - type: precision_at_20
            value: 5.45
          - type: precision_at_3
            value: 29.444
          - type: precision_at_5
            value: 19.400000000000002
          - type: recall_at_1
            value: 67.38300000000001
          - type: recall_at_10
            value: 93.611
          - type: recall_at_100
            value: 98.333
          - type: recall_at_1000
            value: 100
          - type: recall_at_20
            value: 96.167
          - type: recall_at_3
            value: 80.917
          - type: recall_at_5
            value: 87.394
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB TRECCOVID
          revision: bb9466bac8153a0349341eb1b22e06409e78ef4e
          split: test
          type: mteb/trec-covid
        metrics:
          - type: main_score
            value: 86.438
          - type: map_at_1
            value: 0.246
          - type: map_at_10
            value: 2.306
          - type: map_at_100
            value: 14.591000000000001
          - type: map_at_1000
            value: 36.059999999999995
          - type: map_at_20
            value: 4.162
          - type: map_at_3
            value: 0.738
          - type: map_at_5
            value: 1.2189999999999999
          - type: mrr_at_1
            value: 92
          - type: mrr_at_10
            value: 96
          - type: mrr_at_100
            value: 96
          - type: mrr_at_1000
            value: 96
          - type: mrr_at_20
            value: 96
          - type: mrr_at_3
            value: 96
          - type: mrr_at_5
            value: 96
          - type: nauc_map_at_1000_diff1
            value: -22.761515794474683
          - type: nauc_map_at_1000_max
            value: 27.820651228713956
          - type: nauc_map_at_1000_std
            value: 71.83059059452174
          - type: nauc_map_at_100_diff1
            value: 2.1790372665645985
          - type: nauc_map_at_100_max
            value: 14.257921425662278
          - type: nauc_map_at_100_std
            value: 52.48972009046084
          - type: nauc_map_at_10_diff1
            value: 19.82787446032468
          - type: nauc_map_at_10_max
            value: 0.6164112414011461
          - type: nauc_map_at_10_std
            value: 17.02439234880446
          - type: nauc_map_at_1_diff1
            value: 14.55103360563013
          - type: nauc_map_at_1_max
            value: -1.6788350095288704
          - type: nauc_map_at_1_std
            value: 5.297647152979803
          - type: nauc_map_at_20_diff1
            value: 14.8794609533735
          - type: nauc_map_at_20_max
            value: -2.5385796849879476
          - type: nauc_map_at_20_std
            value: 25.28013324056331
          - type: nauc_map_at_3_diff1
            value: 17.00420260483426
          - type: nauc_map_at_3_max
            value: -3.3326758887083994
          - type: nauc_map_at_3_std
            value: 6.755584420286978
          - type: nauc_map_at_5_diff1
            value: 18.01887831857493
          - type: nauc_map_at_5_max
            value: -0.20050837416180262
          - type: nauc_map_at_5_std
            value: 8.561948963118322
          - type: nauc_mrr_at_1000_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_1000_max
            value: 23.34267040149383
          - type: nauc_mrr_at_1000_std
            value: 46.49859943977593
          - type: nauc_mrr_at_100_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_100_max
            value: 23.34267040149383
          - type: nauc_mrr_at_100_std
            value: 46.49859943977593
          - type: nauc_mrr_at_10_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_10_max
            value: 23.34267040149383
          - type: nauc_mrr_at_10_std
            value: 46.49859943977593
          - type: nauc_mrr_at_1_diff1
            value: -10.971055088702213
          - type: nauc_mrr_at_1_max
            value: 23.342670401493866
          - type: nauc_mrr_at_1_std
            value: 46.49859943977584
          - type: nauc_mrr_at_20_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_20_max
            value: 23.34267040149383
          - type: nauc_mrr_at_20_std
            value: 46.49859943977593
          - type: nauc_mrr_at_3_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_3_max
            value: 23.34267040149383
          - type: nauc_mrr_at_3_std
            value: 46.49859943977593
          - type: nauc_mrr_at_5_diff1
            value: -10.971055088702034
          - type: nauc_mrr_at_5_max
            value: 23.34267040149383
          - type: nauc_mrr_at_5_std
            value: 46.49859943977593
          - type: nauc_ndcg_at_1000_diff1
            value: -18.31263218691838
          - type: nauc_ndcg_at_1000_max
            value: 27.73438353091248
          - type: nauc_ndcg_at_1000_std
            value: 71.48659179814995
          - type: nauc_ndcg_at_100_diff1
            value: -27.992325451927186
          - type: nauc_ndcg_at_100_max
            value: 28.255864098560707
          - type: nauc_ndcg_at_100_std
            value: 75.14579385079674
          - type: nauc_ndcg_at_10_diff1
            value: -8.144751519247938
          - type: nauc_ndcg_at_10_max
            value: 25.558877520680124
          - type: nauc_ndcg_at_10_std
            value: 74.7572150705637
          - type: nauc_ndcg_at_1_diff1
            value: 16.76577585000697
          - type: nauc_ndcg_at_1_max
            value: 8.307681544704138
          - type: nauc_ndcg_at_1_std
            value: 58.066321533510546
          - type: nauc_ndcg_at_20_diff1
            value: -20.395935610617506
          - type: nauc_ndcg_at_20_max
            value: 13.855324797866162
          - type: nauc_ndcg_at_20_std
            value: 73.28813885551733
          - type: nauc_ndcg_at_3_diff1
            value: 6.617214064862965
          - type: nauc_ndcg_at_3_max
            value: 6.769967032124153
          - type: nauc_ndcg_at_3_std
            value: 58.81924750609674
          - type: nauc_ndcg_at_5_diff1
            value: 4.010229362207553
          - type: nauc_ndcg_at_5_max
            value: 15.806937140075162
          - type: nauc_ndcg_at_5_std
            value: 64.16373136138701
          - type: nauc_precision_at_1000_diff1
            value: -35.69245033890321
          - type: nauc_precision_at_1000_max
            value: 29.773854942146016
          - type: nauc_precision_at_1000_std
            value: 34.51184375699267
          - type: nauc_precision_at_100_diff1
            value: -35.11125639593742
          - type: nauc_precision_at_100_max
            value: 30.702640227422588
          - type: nauc_precision_at_100_std
            value: 71.4996572186129
          - type: nauc_precision_at_10_diff1
            value: -23.298868807095037
          - type: nauc_precision_at_10_max
            value: 39.589436024499705
          - type: nauc_precision_at_10_std
            value: 76.1337980062292
          - type: nauc_precision_at_1_diff1
            value: -10.971055088702213
          - type: nauc_precision_at_1_max
            value: 23.342670401493866
          - type: nauc_precision_at_1_std
            value: 46.49859943977584
          - type: nauc_precision_at_20_diff1
            value: -29.329327980889335
          - type: nauc_precision_at_20_max
            value: 11.858896642149604
          - type: nauc_precision_at_20_std
            value: 67.29665651857641
          - type: nauc_precision_at_3_diff1
            value: -29.222972972972972
          - type: nauc_precision_at_3_max
            value: 29.892615830115947
          - type: nauc_precision_at_3_std
            value: 52.14165057915088
          - type: nauc_precision_at_5_diff1
            value: -28.95650527113159
          - type: nauc_precision_at_5_max
            value: 59.611135660627276
          - type: nauc_precision_at_5_std
            value: 68.33533236538078
          - type: nauc_recall_at_1000_diff1
            value: -12.600696861809551
          - type: nauc_recall_at_1000_max
            value: 23.65718948783771
          - type: nauc_recall_at_1000_std
            value: 58.45976113241065
          - type: nauc_recall_at_100_diff1
            value: 11.646564765343207
          - type: nauc_recall_at_100_max
            value: 8.659686510034886
          - type: nauc_recall_at_100_std
            value: 35.810233566395794
          - type: nauc_recall_at_10_diff1
            value: 21.95634026505432
          - type: nauc_recall_at_10_max
            value: -1.9343852262751597
          - type: nauc_recall_at_10_std
            value: 11.803977166363625
          - type: nauc_recall_at_1_diff1
            value: 14.55103360563013
          - type: nauc_recall_at_1_max
            value: -1.6788350095288704
          - type: nauc_recall_at_1_std
            value: 5.297647152979803
          - type: nauc_recall_at_20_diff1
            value: 18.43436469166756
          - type: nauc_recall_at_20_max
            value: -6.04718458442069
          - type: nauc_recall_at_20_std
            value: 17.696574929265427
          - type: nauc_recall_at_3_diff1
            value: 18.894666026909974
          - type: nauc_recall_at_3_max
            value: -4.980513377878677
          - type: nauc_recall_at_3_std
            value: 2.9597934364239875
          - type: nauc_recall_at_5_diff1
            value: 19.620752388113065
          - type: nauc_recall_at_5_max
            value: -1.622705626776803
          - type: nauc_recall_at_5_std
            value: 4.654905320572235
          - type: ndcg_at_1
            value: 86
          - type: ndcg_at_10
            value: 86.438
          - type: ndcg_at_100
            value: 68.979
          - type: ndcg_at_1000
            value: 61.687000000000005
          - type: ndcg_at_20
            value: 82.494
          - type: ndcg_at_3
            value: 89.011
          - type: ndcg_at_5
            value: 88.629
          - type: precision_at_1
            value: 92
          - type: precision_at_10
            value: 90.60000000000001
          - type: precision_at_100
            value: 70.94
          - type: precision_at_1000
            value: 27.002
          - type: precision_at_20
            value: 86
          - type: precision_at_3
            value: 94.667
          - type: precision_at_5
            value: 93.60000000000001
          - type: recall_at_1
            value: 0.246
          - type: recall_at_10
            value: 2.402
          - type: recall_at_100
            value: 17.463
          - type: recall_at_1000
            value: 58.095
          - type: recall_at_20
            value: 4.449
          - type: recall_at_3
            value: 0.759
          - type: recall_at_5
            value: 1.258
        task:
          type: Retrieval
      - dataset:
          config: default
          name: MTEB Touche2020
          revision: a34f9a33db75fa0cbb21bb5cfc3dae8dc8bec93f
          split: test
          type: mteb/touche2020
        metrics:
          - type: main_score
            value: 26.596999999999998
          - type: map_at_1
            value: 2.492
          - type: map_at_10
            value: 10.735
          - type: map_at_100
            value: 16.682
          - type: map_at_1000
            value: 18.403
          - type: map_at_20
            value: 12.917000000000002
          - type: map_at_3
            value: 5.17
          - type: map_at_5
            value: 7.757
          - type: mrr_at_1
            value: 32.6530612244898
          - type: mrr_at_10
            value: 46.303045027534814
          - type: mrr_at_100
            value: 47.28774571332247
          - type: mrr_at_1000
            value: 47.28774571332247
          - type: mrr_at_20
            value: 47.015586454361966
          - type: mrr_at_3
            value: 40.816326530612244
          - type: mrr_at_5
            value: 44.18367346938775
          - type: nauc_map_at_1000_diff1
            value: 11.335574982192163
          - type: nauc_map_at_1000_max
            value: -0.8598274464471192
          - type: nauc_map_at_1000_std
            value: -15.231845346554659
          - type: nauc_map_at_100_diff1
            value: 11.206116403137699
          - type: nauc_map_at_100_max
            value: -2.3784869726219764
          - type: nauc_map_at_100_std
            value: -18.67373469274601
          - type: nauc_map_at_10_diff1
            value: 14.110151248235939
          - type: nauc_map_at_10_max
            value: -0.28701326962970963
          - type: nauc_map_at_10_std
            value: -33.99696491060436
          - type: nauc_map_at_1_diff1
            value: 21.156709083334775
          - type: nauc_map_at_1_max
            value: -2.157834650647083
          - type: nauc_map_at_1_std
            value: -30.794160263652802
          - type: nauc_map_at_20_diff1
            value: 13.15680258919864
          - type: nauc_map_at_20_max
            value: -3.3318355189188305
          - type: nauc_map_at_20_std
            value: -32.22884578499942
          - type: nauc_map_at_3_diff1
            value: 16.35589367098705
          - type: nauc_map_at_3_max
            value: -2.46509831705108
          - type: nauc_map_at_3_std
            value: -36.778901075123656
          - type: nauc_map_at_5_diff1
            value: 12.399286451976096
          - type: nauc_map_at_5_max
            value: -6.660679305623031
          - type: nauc_map_at_5_std
            value: -37.17482542753885
          - type: nauc_mrr_at_1000_diff1
            value: 35.79771420444037
          - type: nauc_mrr_at_1000_max
            value: 3.96194578776969
          - type: nauc_mrr_at_1000_std
            value: -28.13723455933009
          - type: nauc_mrr_at_100_diff1
            value: 35.79771420444037
          - type: nauc_mrr_at_100_max
            value: 3.96194578776969
          - type: nauc_mrr_at_100_std
            value: -28.13723455933009
          - type: nauc_mrr_at_10_diff1
            value: 35.342862255513786
          - type: nauc_mrr_at_10_max
            value: 3.8834259049036333
          - type: nauc_mrr_at_10_std
            value: -27.68280924117899
          - type: nauc_mrr_at_1_diff1
            value: 33.380355990146
          - type: nauc_mrr_at_1_max
            value: 12.83074393320823
          - type: nauc_mrr_at_1_std
            value: -23.4424761925381
          - type: nauc_mrr_at_20_diff1
            value: 35.962814146075594
          - type: nauc_mrr_at_20_max
            value: 3.8147946011890803
          - type: nauc_mrr_at_20_std
            value: -27.60539100275652
          - type: nauc_mrr_at_3_diff1
            value: 33.12022321313229
          - type: nauc_mrr_at_3_max
            value: 3.4480043310191277
          - type: nauc_mrr_at_3_std
            value: -32.92204805838337
          - type: nauc_mrr_at_5_diff1
            value: 35.97719343207735
          - type: nauc_mrr_at_5_max
            value: 2.757619527166485
          - type: nauc_mrr_at_5_std
            value: -30.80006606256878
          - type: nauc_ndcg_at_1000_diff1
            value: 18.11533813577644
          - type: nauc_ndcg_at_1000_max
            value: 1.9915750044715081
          - type: nauc_ndcg_at_1000_std
            value: 7.352102753749795
          - type: nauc_ndcg_at_100_diff1
            value: 15.924538562545404
          - type: nauc_ndcg_at_100_max
            value: -7.179439986891839
          - type: nauc_ndcg_at_100_std
            value: 2.0323790255423355
          - type: nauc_ndcg_at_10_diff1
            value: 23.447559750152287
          - type: nauc_ndcg_at_10_max
            value: -3.6579030981671137
          - type: nauc_ndcg_at_10_std
            value: -30.086068424084626
          - type: nauc_ndcg_at_1_diff1
            value: 28.529374726155144
          - type: nauc_ndcg_at_1_max
            value: 12.404802289906062
          - type: nauc_ndcg_at_1_std
            value: -24.04566237921898
          - type: nauc_ndcg_at_20_diff1
            value: 18.242702297694578
          - type: nauc_ndcg_at_20_max
            value: -11.247547069942474
          - type: nauc_ndcg_at_20_std
            value: -26.997061324593357
          - type: nauc_ndcg_at_3_diff1
            value: 28.69532079386643
          - type: nauc_ndcg_at_3_max
            value: 0.5999757426015948
          - type: nauc_ndcg_at_3_std
            value: -37.39763786997949
          - type: nauc_ndcg_at_5_diff1
            value: 22.250418536855168
          - type: nauc_ndcg_at_5_max
            value: -5.282078779032189
          - type: nauc_ndcg_at_5_std
            value: -37.34621514266717
          - type: nauc_precision_at_1000_diff1
            value: -5.833939931080579
          - type: nauc_precision_at_1000_max
            value: 39.54611889184263
          - type: nauc_precision_at_1000_std
            value: 43.621604632945406
          - type: nauc_precision_at_100_diff1
            value: 3.136900834976186
          - type: nauc_precision_at_100_max
            value: 14.56627037716479
          - type: nauc_precision_at_100_std
            value: 61.40167189444594
          - type: nauc_precision_at_10_diff1
            value: 24.365479840589494
          - type: nauc_precision_at_10_max
            value: -2.708612191027584
          - type: nauc_precision_at_10_std
            value: -19.43242154430193
          - type: nauc_precision_at_1_diff1
            value: 33.380355990146
          - type: nauc_precision_at_1_max
            value: 12.83074393320823
          - type: nauc_precision_at_1_std
            value: -23.4424761925381
          - type: nauc_precision_at_20_diff1
            value: 20.473477308430237
          - type: nauc_precision_at_20_max
            value: -3.7772785312524912
          - type: nauc_precision_at_20_std
            value: -7.096694858556529
          - type: nauc_precision_at_3_diff1
            value: 28.334109781699112
          - type: nauc_precision_at_3_max
            value: -6.277807607594587
          - type: nauc_precision_at_3_std
            value: -40.62335017056855
          - type: nauc_precision_at_5_diff1
            value: 21.052413262881274
          - type: nauc_precision_at_5_max
            value: -15.720148003128722
          - type: nauc_precision_at_5_std
            value: -38.65755384255953
          - type: nauc_recall_at_1000_diff1
            value: 3.9912115667343886
          - type: nauc_recall_at_1000_max
            value: 2.3261787568338295
          - type: nauc_recall_at_1000_std
            value: 76.06780062528254
          - type: nauc_recall_at_100_diff1
            value: 5.859597648408654
          - type: nauc_recall_at_100_max
            value: -14.72466783682324
          - type: nauc_recall_at_100_std
            value: 28.835912273557618
          - type: nauc_recall_at_10_diff1
            value: 15.0046703019797
          - type: nauc_recall_at_10_max
            value: -12.61475085286235
          - type: nauc_recall_at_10_std
            value: -29.04758840050514
          - type: nauc_recall_at_1_diff1
            value: 21.156709083334775
          - type: nauc_recall_at_1_max
            value: -2.157834650647083
          - type: nauc_recall_at_1_std
            value: -30.794160263652802
          - type: nauc_recall_at_20_diff1
            value: 13.076618909825493
          - type: nauc_recall_at_20_max
            value: -18.0425193284075
          - type: nauc_recall_at_20_std
            value: -22.37479839545477
          - type: nauc_recall_at_3_diff1
            value: 17.013862570480683
          - type: nauc_recall_at_3_max
            value: -10.976230804308784
          - type: nauc_recall_at_3_std
            value: -39.6623780651685
          - type: nauc_recall_at_5_diff1
            value: 12.171847439522834
          - type: nauc_recall_at_5_max
            value: -17.29935794420055
          - type: nauc_recall_at_5_std
            value: -37.85648419874096
          - type: ndcg_at_1
            value: 31.633
          - type: ndcg_at_10
            value: 26.596999999999998
          - type: ndcg_at_100
            value: 38.242
          - type: ndcg_at_1000
            value: 49.999
          - type: ndcg_at_20
            value: 26.927
          - type: ndcg_at_3
            value: 26.354
          - type: ndcg_at_5
            value: 27.853
          - type: precision_at_1
            value: 32.653
          - type: precision_at_10
            value: 23.673
          - type: precision_at_100
            value: 7.878
          - type: precision_at_1000
            value: 1.5779999999999998
          - type: precision_at_20
            value: 17.143
          - type: precision_at_3
            value: 26.531
          - type: precision_at_5
            value: 28.571
          - type: recall_at_1
            value: 2.492
          - type: recall_at_10
            value: 17.328
          - type: recall_at_100
            value: 48.726
          - type: recall_at_1000
            value: 85.309
          - type: recall_at_20
            value: 24.214
          - type: recall_at_3
            value: 6.279999999999999
          - type: recall_at_5
            value: 10.656
        task:
          type: Retrieval
tags:
  - mteb
language:
  - en
license: other

Introduction

We introduce NV-Retriever-v1, an embedding model, which is optimized for retrieval. It achieves the highest score of 60.9 on 15 retrieval tasks within the MTEB retrieval benchmark (as of 12th July, 2024).

This model is ready for non-commercial use.

For commercial use, the models of NeMo Retriever Microservices (NIMs) may be used and are trained with the same techniques with different datasets.

Technical details can be found in our paper: NV-Retriever: Improving text embedding models with effective hard-negative mining

How to use

It is required to set trust_remote_code=True when loading the model, as it contains a custom module for bidirectional attention and applying the masked mean_pooling.

import torch
from transformers import AutoTokenizer, AutoModel


tokenizer = AutoTokenizer.from_pretrained('nvidia/NV-Retriever-v1')
model = AutoModel.from_pretrained('nvidia/NV-Retriever-v1', trust_remote_code=True)

query_prefix = 'Given a web search query, retrieve relevant passages that answer the query: '
document_prefix = 'passage: '


queries = [
    "how much protein should a female eat",
    "summit define",
]
documents = [
    "As a general guideline, the CDC's average requirement of protein for women ages 19 to 70 is 46 grams per day. But, as you can see from this chart, you'll need to increase that if you're expecting or training for a marathon. Check out the chart below to see how much protein you should be eating each day.",
    "Definition of summit for English Language Learners. : 1  the highest point of a mountain : the top of a mountain. : 2  the highest level. : 3  a meeting or series of meetings between the leaders of two or more governments."
]
queries = [f"{query_prefix} {query}" for query in queries]
documents = [f"{document_prefix} {document}" for document in documents]


batch_queries = tokenizer(queries, padding=True, truncation=True, return_tensors='pt')
batch_documents = tokenizer(documents, padding=True, truncation=True, return_tensors='pt')

with torch.no_grad():
    embeddings_queries = model(**batch_queries)
    embeddings_documents = model(**batch_documents)


scores = (embeddings_queries @ embeddings_documents.T)
print(scores.tolist())
# [[0.6778843402862549, -0.03561091050505638], [-0.05117562413215637, 0.7305730581283569]]

NV-Retriever-v1 Team:

• Mengyao Xu
• Gabriel Moreira
• Radek Osmulski
• Ronay Ak
• Benedikt Schifferer
• Even Oldridge

Correspondence to

Benedikt Schifferer (bschifferer@nvidia.com)

Citation

@misc{moreira2024nvretrieverimprovingtextembedding,
      title={NV-Retriever: Improving text embedding models with effective hard-negative mining}, 
      author={Gabriel de Souza P. Moreira and Radek Osmulski and Mengyao Xu and Ronay Ak and Benedikt Schifferer and Even Oldridge},
      year={2024},
      eprint={2407.15831},
      archivePrefix={arXiv},
      primaryClass={cs.IR},
      url={https://arxiv.org/abs/2407.15831}, 
}

License

License to use this model is covered by the NVIDIA license agreement. By downloading the release version of the model, you accept the terms and conditions of these licenses . For each dataset a user elects to use, the user is responsible for checking if the dataset license is fit for the intended purpose.

Troubleshooting

1. Access to model nvidia/NV-Retriever-v1 is restricted. You must be authenticated to access it

Use your Hugging Face access token to execute huggingface-cli login. You can get a User Access Token from your Settings page.

2. Instruction Prompt Templates

NV-Retriever-v1 uses a query and document prefix similar to [Improving Text Embeddings with Large Language Models] (https://arxiv.org/pdf/2401.00368). It does not use the template with “Instruct:” and “Query:” ( f'Instruct: {task_description}\nQuery: {query}' ) it uses only “{task_description}: “. It is important to end the prefix with a colon (“:”) and a space. The document prefix for documents, “passage: ”, is the same for every task. .

Example:

query = f{"Given a web search query, retrieve relevant passages that answer the query: {query}"}
document = f{"passage: {document}"}

3. User Warning About Prompt

NV-Retriever-v1 expects Instruction Prompt Templates for each query and document. The custom code will modify the attention_mask to apply mean_pooling operation only on the actual text without the prefix. The custom code will look for the token_id 28747 and remove all attention prior to the first appearance of 28747.

As query and document require a prefix with the token_id 28747, the model will output a warning, if the token_id is not present in the input. It is likely that the model is used incorrectly.

Token_id 28747 is the character “:” not separated to some word. For example “query: ”, “passage: ” or “Represent this query: ”. If the input is “query :” with a space, the token_id for “:” is different. Note our custom code will find the first 28747 token in the input, so you don’t need to worry about the “:” inside the query or document content.

UserWarning: Input does not contain special token 28747 to mask out instruction prompt. Please check if prefix are applied, correctly warnings.warn(f"Input does not contain special token {sep_token_id} to mask out instruction prompt. Please check if prefix are applied, correctly")

4. Multi-GPU support

NV-Retriever-v1 supports multi-GPU with DataParallel.

import torch

model = torch.nn.DataParallel(model).cuda()

Intended use

The NV-Retriever Model is designed for users who need a high-performance embedding model for the retrieval task.

Model Architecture

Architecture Type: Decoder-only bidirectional LLM
Network Architecture: Mistral-7B-v0.1 with Bidirectional attention masking
Pooling Type: Average (mean) pooling
Embedding Dimension: 4096
Max Input Tokens: 512

The NV-Retriever-v1 Model is based on the Mistral-7B-v0.1 architecture with a bidirectional attention masking mechanism.

Input

Input Type: Text
Input Format: List of comma separated strings with task-specific instructions

Output

Output Type: Floats
Output Format: List of float arrays
Other Properties Related to Output: Each array contains the embeddings of size 4096 for the corresponding input string

Model Version(s)

NV-Retriever-v1

Ethical Considerations

NVIDIA believes Trustworthy AI is a shared responsibility and we have established policies and practices to enable development for a wide array of AI applications. When downloaded or used in accordance with our terms of service, developers should work with their internal supporting model team to ensure this model meets requirements for the relevant industry and use case and addresses unforeseen product misuse. Please report security vulnerabilities or NVIDIA AI Concerns here.