intfloat/multilingual-e5-large-instruct
6441.5m
1---2tags:3- mteb4- sentence-transformers5- transformers6model-index:7- name: multilingual-e5-large-instruct8 results:9 - task:10 type: Classification11 dataset:12 type: mteb/amazon_counterfactual13 name: MTEB AmazonCounterfactualClassification (en)14 config: en15 split: test16 revision: e8379541af4e31359cca9fbcf4b00f2671dba20517 metrics:18 - type: accuracy19 value: 76.2388059701492420 - type: ap21 value: 39.0735196502268722 - type: f123 value: 70.0483673386268324 - task:25 type: Classification26 dataset:27 type: mteb/amazon_counterfactual28 name: MTEB AmazonCounterfactualClassification (de)29 config: de30 split: test31 revision: e8379541af4e31359cca9fbcf4b00f2671dba20532 metrics:33 - type: accuracy34 value: 66.7130620985010735 - type: ap36 value: 79.0149991475952937 - type: f138 value: 64.8195181756070339 - task:40 type: Classification41 dataset:42 type: mteb/amazon_counterfactual43 name: MTEB AmazonCounterfactualClassification (en-ext)44 config: en-ext45 split: test46 revision: e8379541af4e31359cca9fbcf4b00f2671dba20547 metrics:48 - type: accuracy49 value: 73.8530734632683750 - type: ap51 value: 22.44751988587873752 - type: f153 value: 61.016273074563354 - task:55 type: Classification56 dataset:57 type: mteb/amazon_counterfactual58 name: MTEB AmazonCounterfactualClassification (ja)59 config: ja60 split: test61 revision: e8379541af4e31359cca9fbcf4b00f2671dba20562 metrics:63 - type: accuracy64 value: 76.0492505353319165 - type: ap66 value: 23.4498321712892267 - type: f168 value: 62.572323090775969 - task:70 type: Classification71 dataset:72 type: mteb/amazon_polarity73 name: MTEB AmazonPolarityClassification74 config: default75 split: test76 revision: e2d317d38cd51312af73b3d32a06d1a08b44204677 metrics:78 - type: accuracy79 value: 96.2874250000000180 - type: ap81 value: 94.844991888746282 - type: f183 value: 96.2868092361043284 - task:85 type: Classification86 dataset:87 type: mteb/amazon_reviews_multi88 name: MTEB AmazonReviewsClassification (en)89 config: en90 split: test91 revision: 1399c76144fd37290681b995c656ef9b2e06e26d92 metrics:93 - type: accuracy94 value: 56.71695 - type: f196 value: 55.7651039826640197 - task:98 type: Classification99 dataset:100 type: mteb/amazon_reviews_multi101 name: MTEB AmazonReviewsClassification (de)102 config: de103 split: test104 revision: 1399c76144fd37290681b995c656ef9b2e06e26d105 metrics:106 - type: accuracy107 value: 52.99999999999999108 - type: f1109 value: 52.00829994765178110 - task:111 type: Classification112 dataset:113 type: mteb/amazon_reviews_multi114 name: MTEB AmazonReviewsClassification (es)115 config: es116 split: test117 revision: 1399c76144fd37290681b995c656ef9b2e06e26d118 metrics:119 - type: accuracy120 value: 48.806000000000004121 - type: f1122 value: 48.082345914983634123 - task:124 type: Classification125 dataset:126 type: mteb/amazon_reviews_multi127 name: MTEB AmazonReviewsClassification (fr)128 config: fr129 split: test130 revision: 1399c76144fd37290681b995c656ef9b2e06e26d131 metrics:132 - type: accuracy133 value: 48.507999999999996134 - type: f1135 value: 47.68752844642045136 - task:137 type: Classification138 dataset:139 type: mteb/amazon_reviews_multi140 name: MTEB AmazonReviewsClassification (ja)141 config: ja142 split: test143 revision: 1399c76144fd37290681b995c656ef9b2e06e26d144 metrics:145 - type: accuracy146 value: 47.709999999999994147 - type: f1148 value: 47.05870376637181149 - task:150 type: Classification151 dataset:152 type: mteb/amazon_reviews_multi153 name: MTEB AmazonReviewsClassification (zh)154 config: zh155 split: test156 revision: 1399c76144fd37290681b995c656ef9b2e06e26d157 metrics:158 - type: accuracy159 value: 44.662000000000006160 - type: f1161 value: 43.42371965372771162 - task:163 type: Retrieval164 dataset:165 type: arguana166 name: MTEB ArguAna167 config: default168 split: test169 revision: None170 metrics:171 - type: map_at_1172 value: 31.721173 - type: map_at_10174 value: 49.221175 - type: map_at_100176 value: 49.884177 - type: map_at_1000178 value: 49.888179 - type: map_at_3180 value: 44.31181 - type: map_at_5182 value: 47.276183 - type: mrr_at_1184 value: 32.432185 - type: mrr_at_10186 value: 49.5187 - type: mrr_at_100188 value: 50.163000000000004189 - type: mrr_at_1000190 value: 50.166191 - type: mrr_at_3192 value: 44.618193 - type: mrr_at_5194 value: 47.541195 - type: ndcg_at_1196 value: 31.721197 - type: ndcg_at_10198 value: 58.384199 - type: ndcg_at_100200 value: 61.111000000000004201 - type: ndcg_at_1000202 value: 61.187999999999995203 - type: ndcg_at_3204 value: 48.386205 - type: ndcg_at_5206 value: 53.708999999999996207 - type: precision_at_1208 value: 31.721209 - type: precision_at_10210 value: 8.741211 - type: precision_at_100212 value: 0.991213 - type: precision_at_1000214 value: 0.1215 - type: precision_at_3216 value: 20.057217 - type: precision_at_5218 value: 14.609219 - type: recall_at_1220 value: 31.721221 - type: recall_at_10222 value: 87.411223 - type: recall_at_100224 value: 99.075225 - type: recall_at_1000226 value: 99.644227 - type: recall_at_3228 value: 60.171229 - type: recall_at_5230 value: 73.044231 - task:232 type: Clustering233 dataset:234 type: mteb/arxiv-clustering-p2p235 name: MTEB ArxivClusteringP2P236 config: default237 split: test238 revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d239 metrics:240 - type: v_measure241 value: 46.40419580759799242 - task:243 type: Clustering244 dataset:245 type: mteb/arxiv-clustering-s2s246 name: MTEB ArxivClusteringS2S247 config: default248 split: test249 revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53250 metrics:251 - type: v_measure252 value: 40.48593255007969253 - task:254 type: Reranking255 dataset:256 type: mteb/askubuntudupquestions-reranking257 name: MTEB AskUbuntuDupQuestions258 config: default259 split: test260 revision: 2000358ca161889fa9c082cb41daa8dcfb161a54261 metrics:262 - type: map263 value: 63.889179122289995264 - type: mrr265 value: 77.61146286769556266 - task:267 type: STS268 dataset:269 type: mteb/biosses-sts270 name: MTEB BIOSSES271 config: default272 split: test273 revision: d3fb88f8f02e40887cd149695127462bbcf29b4a274 metrics:275 - type: cos_sim_pearson276 value: 88.15075203727929277 - type: cos_sim_spearman278 value: 86.9622224570873279 - type: euclidean_pearson280 value: 86.70473853624121281 - type: euclidean_spearman282 value: 86.9622224570873283 - type: manhattan_pearson284 value: 86.21089380980065285 - type: manhattan_spearman286 value: 86.75318154937008287 - task:288 type: BitextMining289 dataset:290 type: mteb/bucc-bitext-mining291 name: MTEB BUCC (de-en)292 config: de-en293 split: test294 revision: d51519689f32196a32af33b075a01d0e7c51e252295 metrics:296 - type: accuracy297 value: 99.65553235908142298 - type: f1299 value: 99.60681976339595300 - type: precision301 value: 99.58246346555325302 - type: recall303 value: 99.65553235908142304 - task:305 type: BitextMining306 dataset:307 type: mteb/bucc-bitext-mining308 name: MTEB BUCC (fr-en)309 config: fr-en310 split: test311 revision: d51519689f32196a32af33b075a01d0e7c51e252312 metrics:313 - type: accuracy314 value: 99.26260180497468315 - type: f1316 value: 99.14520507740848317 - type: precision318 value: 99.08650671362535319 - type: recall320 value: 99.26260180497468321 - task:322 type: BitextMining323 dataset:324 type: mteb/bucc-bitext-mining325 name: MTEB BUCC (ru-en)326 config: ru-en327 split: test328 revision: d51519689f32196a32af33b075a01d0e7c51e252329 metrics:330 - type: accuracy331 value: 98.07412538967787332 - type: f1333 value: 97.86629719431936334 - type: precision335 value: 97.76238309664012336 - type: recall337 value: 98.07412538967787338 - task:339 type: BitextMining340 dataset:341 type: mteb/bucc-bitext-mining342 name: MTEB BUCC (zh-en)343 config: zh-en344 split: test345 revision: d51519689f32196a32af33b075a01d0e7c51e252346 metrics:347 - type: accuracy348 value: 99.42074776197998349 - type: f1350 value: 99.38564156573635351 - type: precision352 value: 99.36808846761454353 - type: recall354 value: 99.42074776197998355 - task:356 type: Classification357 dataset:358 type: mteb/banking77359 name: MTEB Banking77Classification360 config: default361 split: test362 revision: 0fd18e25b25c072e09e0d92ab615fda904d66300363 metrics:364 - type: accuracy365 value: 85.73376623376623366 - type: f1367 value: 85.68480707214599368 - task:369 type: Clustering370 dataset:371 type: mteb/biorxiv-clustering-p2p372 name: MTEB BiorxivClusteringP2P373 config: default374 split: test375 revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40376 metrics:377 - type: v_measure378 value: 40.935218072113855379 - task:380 type: Clustering381 dataset:382 type: mteb/biorxiv-clustering-s2s383 name: MTEB BiorxivClusteringS2S384 config: default385 split: test386 revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908387 metrics:388 - type: v_measure389 value: 36.276389017675264390 - task:391 type: Retrieval392 dataset:393 type: BeIR/cqadupstack394 name: MTEB CQADupstackRetrieval395 config: default396 split: test397 revision: None398 metrics:399 - type: map_at_1400 value: 27.764166666666668401 - type: map_at_10402 value: 37.298166666666674403 - type: map_at_100404 value: 38.530166666666666405 - type: map_at_1000406 value: 38.64416666666667407 - type: map_at_3408 value: 34.484833333333334409 - type: map_at_5410 value: 36.0385411 - type: mrr_at_1412 value: 32.93558333333333413 - type: mrr_at_10414 value: 41.589749999999995415 - type: mrr_at_100416 value: 42.425333333333334417 - type: mrr_at_1000418 value: 42.476333333333336419 - type: mrr_at_3420 value: 39.26825421 - type: mrr_at_5422 value: 40.567083333333336423 - type: ndcg_at_1424 value: 32.93558333333333425 - type: ndcg_at_10426 value: 42.706583333333334427 - type: ndcg_at_100428 value: 47.82483333333333429 - type: ndcg_at_1000430 value: 49.95733333333334431 - type: ndcg_at_3432 value: 38.064750000000004433 - type: ndcg_at_5434 value: 40.18158333333333435 - type: precision_at_1436 value: 32.93558333333333437 - type: precision_at_10438 value: 7.459833333333334439 - type: precision_at_100440 value: 1.1830833333333335441 - type: precision_at_1000442 value: 0.15608333333333332443 - type: precision_at_3444 value: 17.5235445 - type: precision_at_5446 value: 12.349833333333333447 - type: recall_at_1448 value: 27.764166666666668449 - type: recall_at_10450 value: 54.31775451 - type: recall_at_100452 value: 76.74350000000001453 - type: recall_at_1000454 value: 91.45208333333332455 - type: recall_at_3456 value: 41.23425457 - type: recall_at_5458 value: 46.73983333333334459 - task:460 type: Retrieval461 dataset:462 type: climate-fever463 name: MTEB ClimateFEVER464 config: default465 split: test466 revision: None467 metrics:468 - type: map_at_1469 value: 12.969470 - type: map_at_10471 value: 21.584999999999997472 - type: map_at_100473 value: 23.3474 - type: map_at_1000475 value: 23.5476 - type: map_at_3477 value: 18.218999999999998478 - type: map_at_5479 value: 19.983480 - type: mrr_at_1481 value: 29.316482 - type: mrr_at_10483 value: 40.033484 - type: mrr_at_100485 value: 40.96486 - type: mrr_at_1000487 value: 41.001488 - type: mrr_at_3489 value: 37.123490 - type: mrr_at_5491 value: 38.757999999999996492 - type: ndcg_at_1493 value: 29.316494 - type: ndcg_at_10495 value: 29.858496 - type: ndcg_at_100497 value: 36.756498 - type: ndcg_at_1000499 value: 40.245999999999995500 - type: ndcg_at_3501 value: 24.822502 - type: ndcg_at_5503 value: 26.565504 - type: precision_at_1505 value: 29.316506 - type: precision_at_10507 value: 9.186508 - type: precision_at_100509 value: 1.6549999999999998510 - type: precision_at_1000511 value: 0.22999999999999998512 - type: precision_at_3513 value: 18.436514 - type: precision_at_5515 value: 13.876516 - type: recall_at_1517 value: 12.969518 - type: recall_at_10519 value: 35.142520 - type: recall_at_100521 value: 59.143522 - type: recall_at_1000523 value: 78.594524 - type: recall_at_3525 value: 22.604526 - type: recall_at_5527 value: 27.883000000000003528 - task:529 type: Retrieval530 dataset:531 type: dbpedia-entity532 name: MTEB DBPedia533 config: default534 split: test535 revision: None536 metrics:537 - type: map_at_1538 value: 8.527999999999999539 - type: map_at_10540 value: 17.974999999999998541 - type: map_at_100542 value: 25.665543 - type: map_at_1000544 value: 27.406000000000002545 - type: map_at_3546 value: 13.017999999999999547 - type: map_at_5548 value: 15.137549 - type: mrr_at_1550 value: 62.5551 - type: mrr_at_10552 value: 71.891553 - type: mrr_at_100554 value: 72.294555 - type: mrr_at_1000556 value: 72.296557 - type: mrr_at_3558 value: 69.958559 - type: mrr_at_5560 value: 71.121561 - type: ndcg_at_1562 value: 50.875563 - type: ndcg_at_10564 value: 38.36565 - type: ndcg_at_100566 value: 44.235567 - type: ndcg_at_1000568 value: 52.154569 - type: ndcg_at_3570 value: 43.008571 - type: ndcg_at_5572 value: 40.083999999999996573 - type: precision_at_1574 value: 62.5575 - type: precision_at_10576 value: 30.0577 - type: precision_at_100578 value: 10.038579 - type: precision_at_1000580 value: 2.0869999999999997581 - type: precision_at_3582 value: 46.833000000000006583 - type: precision_at_5584 value: 38.800000000000004585 - type: recall_at_1586 value: 8.527999999999999587 - type: recall_at_10588 value: 23.828589 - type: recall_at_100590 value: 52.322591 - type: recall_at_1000592 value: 77.143593 - type: recall_at_3594 value: 14.136000000000001595 - type: recall_at_5596 value: 17.761597 - task:598 type: Classification599 dataset:600 type: mteb/emotion601 name: MTEB EmotionClassification602 config: default603 split: test604 revision: 4f58c6b202a23cf9a4da393831edf4f9183cad37605 metrics:606 - type: accuracy607 value: 51.51608 - type: f1609 value: 47.632159862049896610 - task:611 type: Retrieval612 dataset:613 type: fever614 name: MTEB FEVER615 config: default616 split: test617 revision: None618 metrics:619 - type: map_at_1620 value: 60.734621 - type: map_at_10622 value: 72.442623 - type: map_at_100624 value: 72.735625 - type: map_at_1000626 value: 72.75627 - type: map_at_3628 value: 70.41199999999999629 - type: map_at_5630 value: 71.80499999999999631 - type: mrr_at_1632 value: 65.212633 - type: mrr_at_10634 value: 76.613635 - type: mrr_at_100636 value: 76.79899999999999637 - type: mrr_at_1000638 value: 76.801639 - type: mrr_at_3640 value: 74.8641 - type: mrr_at_5642 value: 76.12400000000001643 - type: ndcg_at_1644 value: 65.212645 - type: ndcg_at_10646 value: 77.988647 - type: ndcg_at_100648 value: 79.167649 - type: ndcg_at_1000650 value: 79.452651 - type: ndcg_at_3652 value: 74.362653 - type: ndcg_at_5654 value: 76.666655 - type: precision_at_1656 value: 65.212657 - type: precision_at_10658 value: 10.003659 - type: precision_at_100660 value: 1.077661 - type: precision_at_1000662 value: 0.11199999999999999663 - type: precision_at_3664 value: 29.518665 - type: precision_at_5666 value: 19.016667 - type: recall_at_1668 value: 60.734669 - type: recall_at_10670 value: 90.824671 - type: recall_at_100672 value: 95.71600000000001673 - type: recall_at_1000674 value: 97.577675 - type: recall_at_3676 value: 81.243677 - type: recall_at_5678 value: 86.90299999999999679 - task:680 type: Retrieval681 dataset:682 type: fiqa683 name: MTEB FiQA2018684 config: default685 split: test686 revision: None687 metrics:688 - type: map_at_1689 value: 23.845690 - type: map_at_10691 value: 39.281692 - type: map_at_100693 value: 41.422694 - type: map_at_1000695 value: 41.593696 - type: map_at_3697 value: 34.467698 - type: map_at_5699 value: 37.017700 - type: mrr_at_1701 value: 47.531702 - type: mrr_at_10703 value: 56.204704 - type: mrr_at_100705 value: 56.928999999999995706 - type: mrr_at_1000707 value: 56.962999999999994708 - type: mrr_at_3709 value: 54.115710 - type: mrr_at_5711 value: 55.373000000000005712 - type: ndcg_at_1713 value: 47.531714 - type: ndcg_at_10715 value: 47.711999999999996716 - type: ndcg_at_100717 value: 54.510999999999996718 - type: ndcg_at_1000719 value: 57.103720 - type: ndcg_at_3721 value: 44.145722 - type: ndcg_at_5723 value: 45.032724 - type: precision_at_1725 value: 47.531726 - type: precision_at_10727 value: 13.194728 - type: precision_at_100729 value: 2.045730 - type: precision_at_1000731 value: 0.249732 - type: precision_at_3733 value: 29.424734 - type: precision_at_5735 value: 21.451736 - type: recall_at_1737 value: 23.845738 - type: recall_at_10739 value: 54.967740 - type: recall_at_100741 value: 79.11399999999999742 - type: recall_at_1000743 value: 94.56700000000001744 - type: recall_at_3745 value: 40.256746 - type: recall_at_5747 value: 46.215748 - task:749 type: Retrieval750 dataset:751 type: hotpotqa752 name: MTEB HotpotQA753 config: default754 split: test755 revision: None756 metrics:757 - type: map_at_1758 value: 37.819759 - type: map_at_10760 value: 60.889761 - type: map_at_100762 value: 61.717999999999996763 - type: map_at_1000764 value: 61.778765 - type: map_at_3766 value: 57.254000000000005767 - type: map_at_5768 value: 59.541769 - type: mrr_at_1770 value: 75.638771 - type: mrr_at_10772 value: 82.173773 - type: mrr_at_100774 value: 82.362775 - type: mrr_at_1000776 value: 82.37777 - type: mrr_at_3778 value: 81.089779 - type: mrr_at_5780 value: 81.827781 - type: ndcg_at_1782 value: 75.638783 - type: ndcg_at_10784 value: 69.317785 - type: ndcg_at_100786 value: 72.221787 - type: ndcg_at_1000788 value: 73.382789 - type: ndcg_at_3790 value: 64.14791 - type: ndcg_at_5792 value: 67.07600000000001793 - type: precision_at_1794 value: 75.638795 - type: precision_at_10796 value: 14.704999999999998797 - type: precision_at_100798 value: 1.698799 - type: precision_at_1000800 value: 0.185801 - type: precision_at_3802 value: 41.394999999999996803 - type: precision_at_5804 value: 27.162999999999997805 - type: recall_at_1806 value: 37.819807 - type: recall_at_10808 value: 73.52499999999999809 - type: recall_at_100810 value: 84.875811 - type: recall_at_1000812 value: 92.559813 - type: recall_at_3814 value: 62.092999999999996815 - type: recall_at_5816 value: 67.907817 - task:818 type: Classification819 dataset:820 type: mteb/imdb821 name: MTEB ImdbClassification822 config: default823 split: test824 revision: 3d86128a09e091d6018b6d26cad27f2739fc2db7825 metrics:826 - type: accuracy827 value: 94.60079999999999828 - type: ap829 value: 92.67396345347356830 - type: f1831 value: 94.5988098167121832 - task:833 type: Retrieval834 dataset:835 type: msmarco836 name: MTEB MSMARCO837 config: default838 split: dev839 revision: None840 metrics:841 - type: map_at_1842 value: 21.285843 - type: map_at_10844 value: 33.436845 - type: map_at_100846 value: 34.63847 - type: map_at_1000848 value: 34.681849 - type: map_at_3850 value: 29.412851 - type: map_at_5852 value: 31.715853 - type: mrr_at_1854 value: 21.848855 - type: mrr_at_10856 value: 33.979857 - type: mrr_at_100858 value: 35.118859 - type: mrr_at_1000860 value: 35.162861 - type: mrr_at_3862 value: 30.036863 - type: mrr_at_5864 value: 32.298865 - type: ndcg_at_1866 value: 21.862000000000002867 - type: ndcg_at_10868 value: 40.43869 - type: ndcg_at_100870 value: 46.17871 - type: ndcg_at_1000872 value: 47.412873 - type: ndcg_at_3874 value: 32.221875 - type: ndcg_at_5876 value: 36.332877 - type: precision_at_1878 value: 21.862000000000002879 - type: precision_at_10880 value: 6.491881 - type: precision_at_100882 value: 0.935883 - type: precision_at_1000884 value: 0.104885 - type: precision_at_3886 value: 13.744887 - type: precision_at_5888 value: 10.331999999999999889 - type: recall_at_1890 value: 21.285891 - type: recall_at_10892 value: 62.083893 - type: recall_at_100894 value: 88.576895 - type: recall_at_1000896 value: 98.006897 - type: recall_at_3898 value: 39.729899 - type: recall_at_5900 value: 49.608000000000004901 - task:902 type: Classification903 dataset:904 type: mteb/mtop_domain905 name: MTEB MTOPDomainClassification (en)906 config: en907 split: test908 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf909 metrics:910 - type: accuracy911 value: 93.92612859097127912 - type: f1913 value: 93.82370333372853914 - task:915 type: Classification916 dataset:917 type: mteb/mtop_domain918 name: MTEB MTOPDomainClassification (de)919 config: de920 split: test921 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf922 metrics:923 - type: accuracy924 value: 92.67681036911807925 - type: f1926 value: 92.14191382411472927 - task:928 type: Classification929 dataset:930 type: mteb/mtop_domain931 name: MTEB MTOPDomainClassification (es)932 config: es933 split: test934 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf935 metrics:936 - type: accuracy937 value: 92.26817878585723938 - type: f1939 value: 91.92824250337878940 - task:941 type: Classification942 dataset:943 type: mteb/mtop_domain944 name: MTEB MTOPDomainClassification (fr)945 config: fr946 split: test947 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf948 metrics:949 - type: accuracy950 value: 89.96554963983714951 - type: f1952 value: 90.02859329630792953 - task:954 type: Classification955 dataset:956 type: mteb/mtop_domain957 name: MTEB MTOPDomainClassification (hi)958 config: hi959 split: test960 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf961 metrics:962 - type: accuracy963 value: 90.02509860164935964 - type: f1965 value: 89.30665159182062966 - task:967 type: Classification968 dataset:969 type: mteb/mtop_domain970 name: MTEB MTOPDomainClassification (th)971 config: th972 split: test973 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf974 metrics:975 - type: accuracy976 value: 87.55515370705244977 - type: f1978 value: 87.94449232331907979 - task:980 type: Classification981 dataset:982 type: mteb/mtop_intent983 name: MTEB MTOPIntentClassification (en)984 config: en985 split: test986 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba987 metrics:988 - type: accuracy989 value: 82.4623803009576990 - type: f1991 value: 66.06738378772725992 - task:993 type: Classification994 dataset:995 type: mteb/mtop_intent996 name: MTEB MTOPIntentClassification (de)997 config: de998 split: test999 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1000 metrics:1001 - type: accuracy1002 value: 79.37165398703861003 - type: f11004 value: 60.376140333968531005 - task:1006 type: Classification1007 dataset:1008 type: mteb/mtop_intent1009 name: MTEB MTOPIntentClassification (es)1010 config: es1011 split: test1012 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1013 metrics:1014 - type: accuracy1015 value: 80.340226817878571016 - type: f11017 value: 58.3020080269521018 - task:1019 type: Classification1020 dataset:1021 type: mteb/mtop_intent1022 name: MTEB MTOPIntentClassification (fr)1023 config: fr1024 split: test1025 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1026 metrics:1027 - type: accuracy1028 value: 76.720952082680871029 - type: f11030 value: 59.645247240090491031 - task:1032 type: Classification1033 dataset:1034 type: mteb/mtop_intent1035 name: MTEB MTOPIntentClassification (hi)1036 config: hi1037 split: test1038 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1039 metrics:1040 - type: accuracy1041 value: 77.870204374327731042 - type: f11043 value: 57.802026946705671044 - task:1045 type: Classification1046 dataset:1047 type: mteb/mtop_intent1048 name: MTEB MTOPIntentClassification (th)1049 config: th1050 split: test1051 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1052 metrics:1053 - type: accuracy1054 value: 77.735985533453871055 - type: f11056 value: 58.196282506750311057 - task:1058 type: Classification1059 dataset:1060 type: mteb/amazon_massive_intent1061 name: MTEB MassiveIntentClassification (af)1062 config: af1063 split: test1064 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71065 metrics:1066 - type: accuracy1067 value: 67.66308002689981068 - type: f11069 value: 65.009966680516911070 - task:1071 type: Classification1072 dataset:1073 type: mteb/amazon_massive_intent1074 name: MTEB MassiveIntentClassification (am)1075 config: am1076 split: test1077 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71078 metrics:1079 - type: accuracy1080 value: 60.71284465366511081 - type: f11082 value: 57.958605948749631083 - task:1084 type: Classification1085 dataset:1086 type: mteb/amazon_massive_intent1087 name: MTEB MassiveIntentClassification (ar)1088 config: ar1089 split: test1090 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71091 metrics:1092 - type: accuracy1093 value: 63.611297915265631094 - type: f11095 value: 59.753282902064831096 - task:1097 type: Classification1098 dataset:1099 type: mteb/amazon_massive_intent1100 name: MTEB MassiveIntentClassification (az)1101 config: az1102 split: test1103 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71104 metrics:1105 - type: accuracy1106 value: 69.001344989912571107 - type: f11108 value: 67.02304839918021109 - task:1110 type: Classification1111 dataset:1112 type: mteb/amazon_massive_intent1113 name: MTEB MassiveIntentClassification (bn)1114 config: bn1115 split: test1116 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71117 metrics:1118 - type: accuracy1119 value: 68.540685944855411120 - type: f11121 value: 65.546046289469761122 - task:1123 type: Classification1124 dataset:1125 type: mteb/amazon_massive_intent1126 name: MTEB MassiveIntentClassification (cy)1127 config: cy1128 split: test1129 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71130 metrics:1131 - type: accuracy1132 value: 63.0329522528580951133 - type: f11134 value: 58.7157418570571041135 - task:1136 type: Classification1137 dataset:1138 type: mteb/amazon_massive_intent1139 name: MTEB MassiveIntentClassification (da)1140 config: da1141 split: test1142 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71143 metrics:1144 - type: accuracy1145 value: 71.809011432414271146 - type: f11147 value: 68.339639892438771148 - task:1149 type: Classification1150 dataset:1151 type: mteb/amazon_massive_intent1152 name: MTEB MassiveIntentClassification (de)1153 config: de1154 split: test1155 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71156 metrics:1157 - type: accuracy1158 value: 72.471418964357771159 - type: f11160 value: 69.567650203082621161 - task:1162 type: Classification1163 dataset:1164 type: mteb/amazon_massive_intent1165 name: MTEB MassiveIntentClassification (el)1166 config: el1167 split: test1168 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71169 metrics:1170 - type: accuracy1171 value: 71.23739071956961172 - type: f11173 value: 69.045298360364671174 - task:1175 type: Classification1176 dataset:1177 type: mteb/amazon_massive_intent1178 name: MTEB MassiveIntentClassification (en)1179 config: en1180 split: test1181 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71182 metrics:1183 - type: accuracy1184 value: 77.057834566240761185 - type: f11186 value: 74.694305847081741187 - task:1188 type: Classification1189 dataset:1190 type: mteb/amazon_massive_intent1191 name: MTEB MassiveIntentClassification (es)1192 config: es1193 split: test1194 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71195 metrics:1196 - type: accuracy1197 value: 72.821116341627441198 - type: f11199 value: 70.772289528037621200 - task: