intfloat/multilingual-e5-large
1.3k6.9m
1---2tags:3- mteb4- Sentence Transformers5- sentence-similarity6- feature-extraction7- sentence-transformers8model-index:9- name: multilingual-e5-large10 results:11 - task:12 type: Classification13 dataset:14 type: mteb/amazon_counterfactual15 name: MTEB AmazonCounterfactualClassification (en)16 config: en17 split: test18 revision: e8379541af4e31359cca9fbcf4b00f2671dba20519 metrics:20 - type: accuracy21 value: 79.0597014925373122 - type: ap23 value: 43.48657439083563524 - type: f125 value: 73.3270009214014826 - task:27 type: Classification28 dataset:29 type: mteb/amazon_counterfactual30 name: MTEB AmazonCounterfactualClassification (de)31 config: de32 split: test33 revision: e8379541af4e31359cca9fbcf4b00f2671dba20534 metrics:35 - type: accuracy36 value: 71.2205567451820137 - type: ap38 value: 81.5575671083049839 - type: f140 value: 69.2827178775266141 - task:42 type: Classification43 dataset:44 type: mteb/amazon_counterfactual45 name: MTEB AmazonCounterfactualClassification (en-ext)46 config: en-ext47 split: test48 revision: e8379541af4e31359cca9fbcf4b00f2671dba20549 metrics:50 - type: accuracy51 value: 80.4197901049475452 - type: ap53 value: 29.3487992237634454 - type: f155 value: 67.6247544901127856 - task:57 type: Classification58 dataset:59 type: mteb/amazon_counterfactual60 name: MTEB AmazonCounterfactualClassification (ja)61 config: ja62 split: test63 revision: e8379541af4e31359cca9fbcf4b00f2671dba20564 metrics:65 - type: accuracy66 value: 77.837259100642467 - type: ap68 value: 26.55756059121073869 - type: f170 value: 64.9661941736870771 - task:72 type: Classification73 dataset:74 type: mteb/amazon_polarity75 name: MTEB AmazonPolarityClassification76 config: default77 split: test78 revision: e2d317d38cd51312af73b3d32a06d1a08b44204679 metrics:80 - type: accuracy81 value: 93.48987582 - type: ap83 value: 90.9875863691760384 - type: f185 value: 93.4855481971733286 - task:87 type: Classification88 dataset:89 type: mteb/amazon_reviews_multi90 name: MTEB AmazonReviewsClassification (en)91 config: en92 split: test93 revision: 1399c76144fd37290681b995c656ef9b2e06e26d94 metrics:95 - type: accuracy96 value: 47.56497 - type: f198 value: 46.7512217351804799 - task:100 type: Classification101 dataset:102 type: mteb/amazon_reviews_multi103 name: MTEB AmazonReviewsClassification (de)104 config: de105 split: test106 revision: 1399c76144fd37290681b995c656ef9b2e06e26d107 metrics:108 - type: accuracy109 value: 45.400000000000006110 - type: f1111 value: 44.17195682400632112 - task:113 type: Classification114 dataset:115 type: mteb/amazon_reviews_multi116 name: MTEB AmazonReviewsClassification (es)117 config: es118 split: test119 revision: 1399c76144fd37290681b995c656ef9b2e06e26d120 metrics:121 - type: accuracy122 value: 43.068123 - type: f1124 value: 42.38155696855596125 - task:126 type: Classification127 dataset:128 type: mteb/amazon_reviews_multi129 name: MTEB AmazonReviewsClassification (fr)130 config: fr131 split: test132 revision: 1399c76144fd37290681b995c656ef9b2e06e26d133 metrics:134 - type: accuracy135 value: 41.89136 - type: f1137 value: 40.84407321682663138 - task:139 type: Classification140 dataset:141 type: mteb/amazon_reviews_multi142 name: MTEB AmazonReviewsClassification (ja)143 config: ja144 split: test145 revision: 1399c76144fd37290681b995c656ef9b2e06e26d146 metrics:147 - type: accuracy148 value: 40.120000000000005149 - type: f1150 value: 39.522976223819114151 - task:152 type: Classification153 dataset:154 type: mteb/amazon_reviews_multi155 name: MTEB AmazonReviewsClassification (zh)156 config: zh157 split: test158 revision: 1399c76144fd37290681b995c656ef9b2e06e26d159 metrics:160 - type: accuracy161 value: 38.832162 - type: f1163 value: 38.0392533394713164 - task:165 type: Retrieval166 dataset:167 type: arguana168 name: MTEB ArguAna169 config: default170 split: test171 revision: None172 metrics:173 - type: map_at_1174 value: 30.725175 - type: map_at_10176 value: 46.055177 - type: map_at_100178 value: 46.900999999999996179 - type: map_at_1000180 value: 46.911181 - type: map_at_3182 value: 41.548183 - type: map_at_5184 value: 44.297185 - type: mrr_at_1186 value: 31.152187 - type: mrr_at_10188 value: 46.231189 - type: mrr_at_100190 value: 47.07191 - type: mrr_at_1000192 value: 47.08193 - type: mrr_at_3194 value: 41.738195 - type: mrr_at_5196 value: 44.468999999999994197 - type: ndcg_at_1198 value: 30.725199 - type: ndcg_at_10200 value: 54.379999999999995201 - type: ndcg_at_100202 value: 58.138203 - type: ndcg_at_1000204 value: 58.389205 - type: ndcg_at_3206 value: 45.156207 - type: ndcg_at_5208 value: 50.123209 - type: precision_at_1210 value: 30.725211 - type: precision_at_10212 value: 8.087213 - type: precision_at_100214 value: 0.9769999999999999215 - type: precision_at_1000216 value: 0.1217 - type: precision_at_3218 value: 18.54219 - type: precision_at_5220 value: 13.542000000000002221 - type: recall_at_1222 value: 30.725223 - type: recall_at_10224 value: 80.868225 - type: recall_at_100226 value: 97.653227 - type: recall_at_1000228 value: 99.57300000000001229 - type: recall_at_3230 value: 55.619231 - type: recall_at_5232 value: 67.71000000000001233 - task:234 type: Clustering235 dataset:236 type: mteb/arxiv-clustering-p2p237 name: MTEB ArxivClusteringP2P238 config: default239 split: test240 revision: a122ad7f3f0291bf49cc6f4d32aa80929df69d5d241 metrics:242 - type: v_measure243 value: 44.30960650674069244 - task:245 type: Clustering246 dataset:247 type: mteb/arxiv-clustering-s2s248 name: MTEB ArxivClusteringS2S249 config: default250 split: test251 revision: f910caf1a6075f7329cdf8c1a6135696f37dbd53252 metrics:253 - type: v_measure254 value: 38.427074197498996255 - task:256 type: Reranking257 dataset:258 type: mteb/askubuntudupquestions-reranking259 name: MTEB AskUbuntuDupQuestions260 config: default261 split: test262 revision: 2000358ca161889fa9c082cb41daa8dcfb161a54263 metrics:264 - type: map265 value: 60.28270056031872266 - type: mrr267 value: 74.38332673789738268 - task:269 type: STS270 dataset:271 type: mteb/biosses-sts272 name: MTEB BIOSSES273 config: default274 split: test275 revision: d3fb88f8f02e40887cd149695127462bbcf29b4a276 metrics:277 - type: cos_sim_pearson278 value: 84.05942144105269279 - type: cos_sim_spearman280 value: 82.51212105850809281 - type: euclidean_pearson282 value: 81.95639829909122283 - type: euclidean_spearman284 value: 82.3717564144213285 - type: manhattan_pearson286 value: 81.79273425468256287 - type: manhattan_spearman288 value: 82.20066817871039289 - task:290 type: BitextMining291 dataset:292 type: mteb/bucc-bitext-mining293 name: MTEB BUCC (de-en)294 config: de-en295 split: test296 revision: d51519689f32196a32af33b075a01d0e7c51e252297 metrics:298 - type: accuracy299 value: 99.46764091858039300 - type: f1301 value: 99.37717466945023302 - type: precision303 value: 99.33194154488518304 - type: recall305 value: 99.46764091858039306 - task:307 type: BitextMining308 dataset:309 type: mteb/bucc-bitext-mining310 name: MTEB BUCC (fr-en)311 config: fr-en312 split: test313 revision: d51519689f32196a32af33b075a01d0e7c51e252314 metrics:315 - type: accuracy316 value: 98.29407880255337317 - type: f1318 value: 98.11248073959938319 - type: precision320 value: 98.02443319392472321 - type: recall322 value: 98.29407880255337323 - task:324 type: BitextMining325 dataset:326 type: mteb/bucc-bitext-mining327 name: MTEB BUCC (ru-en)328 config: ru-en329 split: test330 revision: d51519689f32196a32af33b075a01d0e7c51e252331 metrics:332 - type: accuracy333 value: 97.79009352268791334 - type: f1335 value: 97.5176076665512336 - type: precision337 value: 97.38136473848286338 - type: recall339 value: 97.79009352268791340 - task:341 type: BitextMining342 dataset:343 type: mteb/bucc-bitext-mining344 name: MTEB BUCC (zh-en)345 config: zh-en346 split: test347 revision: d51519689f32196a32af33b075a01d0e7c51e252348 metrics:349 - type: accuracy350 value: 99.26276987888363351 - type: f1352 value: 99.20133403545726353 - type: precision354 value: 99.17500438827453355 - type: recall356 value: 99.26276987888363357 - task:358 type: Classification359 dataset:360 type: mteb/banking77361 name: MTEB Banking77Classification362 config: default363 split: test364 revision: 0fd18e25b25c072e09e0d92ab615fda904d66300365 metrics:366 - type: accuracy367 value: 84.72727272727273368 - type: f1369 value: 84.67672206031433370 - task:371 type: Clustering372 dataset:373 type: mteb/biorxiv-clustering-p2p374 name: MTEB BiorxivClusteringP2P375 config: default376 split: test377 revision: 65b79d1d13f80053f67aca9498d9402c2d9f1f40378 metrics:379 - type: v_measure380 value: 35.34220182511161381 - task:382 type: Clustering383 dataset:384 type: mteb/biorxiv-clustering-s2s385 name: MTEB BiorxivClusteringS2S386 config: default387 split: test388 revision: 258694dd0231531bc1fd9de6ceb52a0853c6d908389 metrics:390 - type: v_measure391 value: 33.4987096128766392 - task:393 type: Retrieval394 dataset:395 type: BeIR/cqadupstack396 name: MTEB CQADupstackRetrieval397 config: default398 split: test399 revision: None400 metrics:401 - type: map_at_1402 value: 25.558249999999997403 - type: map_at_10404 value: 34.44425000000001405 - type: map_at_100406 value: 35.59833333333333407 - type: map_at_1000408 value: 35.706916666666665409 - type: map_at_3410 value: 31.691749999999995411 - type: map_at_5412 value: 33.252916666666664413 - type: mrr_at_1414 value: 30.252666666666666415 - type: mrr_at_10416 value: 38.60675417 - type: mrr_at_100418 value: 39.42666666666666419 - type: mrr_at_1000420 value: 39.48408333333334421 - type: mrr_at_3422 value: 36.17441666666665423 - type: mrr_at_5424 value: 37.56275425 - type: ndcg_at_1426 value: 30.252666666666666427 - type: ndcg_at_10428 value: 39.683429 - type: ndcg_at_100430 value: 44.68541666666667431 - type: ndcg_at_1000432 value: 46.94316666666668433 - type: ndcg_at_3434 value: 34.961749999999995435 - type: ndcg_at_5436 value: 37.215666666666664437 - type: precision_at_1438 value: 30.252666666666666439 - type: precision_at_10440 value: 6.904166666666667441 - type: precision_at_100442 value: 1.0989999999999995443 - type: precision_at_1000444 value: 0.14733333333333334445 - type: precision_at_3446 value: 16.037666666666667447 - type: precision_at_5448 value: 11.413583333333333449 - type: recall_at_1450 value: 25.558249999999997451 - type: recall_at_10452 value: 51.13341666666666453 - type: recall_at_100454 value: 73.08366666666667455 - type: recall_at_1000456 value: 88.79483333333334457 - type: recall_at_3458 value: 37.989083333333326459 - type: recall_at_5460 value: 43.787833333333325461 - task:462 type: Retrieval463 dataset:464 type: climate-fever465 name: MTEB ClimateFEVER466 config: default467 split: test468 revision: None469 metrics:470 - type: map_at_1471 value: 10.338472 - type: map_at_10473 value: 18.360000000000003474 - type: map_at_100475 value: 19.942476 - type: map_at_1000477 value: 20.134478 - type: map_at_3479 value: 15.174000000000001480 - type: map_at_5481 value: 16.830000000000002482 - type: mrr_at_1483 value: 23.257484 - type: mrr_at_10485 value: 33.768486 - type: mrr_at_100487 value: 34.707488 - type: mrr_at_1000489 value: 34.766000000000005490 - type: mrr_at_3491 value: 30.977492 - type: mrr_at_5493 value: 32.528494 - type: ndcg_at_1495 value: 23.257496 - type: ndcg_at_10497 value: 25.733498 - type: ndcg_at_100499 value: 32.288500 - type: ndcg_at_1000501 value: 35.992000000000004502 - type: ndcg_at_3503 value: 20.866504 - type: ndcg_at_5505 value: 22.612506 - type: precision_at_1507 value: 23.257508 - type: precision_at_10509 value: 8.124510 - type: precision_at_100511 value: 1.518512 - type: precision_at_1000513 value: 0.219514 - type: precision_at_3515 value: 15.679000000000002516 - type: precision_at_5517 value: 12.117518 - type: recall_at_1519 value: 10.338520 - type: recall_at_10521 value: 31.154522 - type: recall_at_100523 value: 54.161524 - type: recall_at_1000525 value: 75.21900000000001526 - type: recall_at_3527 value: 19.427528 - type: recall_at_5529 value: 24.214530 - task:531 type: Retrieval532 dataset:533 type: dbpedia-entity534 name: MTEB DBPedia535 config: default536 split: test537 revision: None538 metrics:539 - type: map_at_1540 value: 8.498541 - type: map_at_10542 value: 19.103543 - type: map_at_100544 value: 27.375545 - type: map_at_1000546 value: 28.981547 - type: map_at_3548 value: 13.764999999999999549 - type: map_at_5550 value: 15.950000000000001551 - type: mrr_at_1552 value: 65.5553 - type: mrr_at_10554 value: 74.53800000000001555 - type: mrr_at_100556 value: 74.71799999999999557 - type: mrr_at_1000558 value: 74.725559 - type: mrr_at_3560 value: 72.792561 - type: mrr_at_5562 value: 73.554563 - type: ndcg_at_1564 value: 53.37499999999999565 - type: ndcg_at_10566 value: 41.286567 - type: ndcg_at_100568 value: 45.972569 - type: ndcg_at_1000570 value: 53.123571 - type: ndcg_at_3572 value: 46.172999999999995573 - type: ndcg_at_5574 value: 43.033575 - type: precision_at_1576 value: 65.5577 - type: precision_at_10578 value: 32.725579 - type: precision_at_100580 value: 10.683581 - type: precision_at_1000582 value: 1.978583 - type: precision_at_3584 value: 50585 - type: precision_at_5586 value: 41.349999999999994587 - type: recall_at_1588 value: 8.498589 - type: recall_at_10590 value: 25.070999999999998591 - type: recall_at_100592 value: 52.383593 - type: recall_at_1000594 value: 74.91499999999999595 - type: recall_at_3596 value: 15.207999999999998597 - type: recall_at_5598 value: 18.563599 - task:600 type: Classification601 dataset:602 type: mteb/emotion603 name: MTEB EmotionClassification604 config: default605 split: test606 revision: 4f58c6b202a23cf9a4da393831edf4f9183cad37607 metrics:608 - type: accuracy609 value: 46.5610 - type: f1611 value: 41.93833713984145612 - task:613 type: Retrieval614 dataset:615 type: fever616 name: MTEB FEVER617 config: default618 split: test619 revision: None620 metrics:621 - type: map_at_1622 value: 67.914623 - type: map_at_10624 value: 78.10000000000001625 - type: map_at_100626 value: 78.333627 - type: map_at_1000628 value: 78.346629 - type: map_at_3630 value: 76.626631 - type: map_at_5632 value: 77.627633 - type: mrr_at_1634 value: 72.74199999999999635 - type: mrr_at_10636 value: 82.414637 - type: mrr_at_100638 value: 82.511639 - type: mrr_at_1000640 value: 82.513641 - type: mrr_at_3642 value: 81.231643 - type: mrr_at_5644 value: 82.065645 - type: ndcg_at_1646 value: 72.74199999999999647 - type: ndcg_at_10648 value: 82.806649 - type: ndcg_at_100650 value: 83.677651 - type: ndcg_at_1000652 value: 83.917653 - type: ndcg_at_3654 value: 80.305655 - type: ndcg_at_5656 value: 81.843657 - type: precision_at_1658 value: 72.74199999999999659 - type: precision_at_10660 value: 10.24661 - type: precision_at_100662 value: 1.089663 - type: precision_at_1000664 value: 0.11299999999999999665 - type: precision_at_3666 value: 31.268667 - type: precision_at_5668 value: 19.706000000000003669 - type: recall_at_1670 value: 67.914671 - type: recall_at_10672 value: 92.889673 - type: recall_at_100674 value: 96.42699999999999675 - type: recall_at_1000676 value: 97.92677 - type: recall_at_3678 value: 86.21679 - type: recall_at_5680 value: 90.036681 - task:682 type: Retrieval683 dataset:684 type: fiqa685 name: MTEB FiQA2018686 config: default687 split: test688 revision: None689 metrics:690 - type: map_at_1691 value: 22.166692 - type: map_at_10693 value: 35.57694 - type: map_at_100695 value: 37.405696 - type: map_at_1000697 value: 37.564698 - type: map_at_3699 value: 30.379700 - type: map_at_5701 value: 33.324702 - type: mrr_at_1703 value: 43.519000000000005704 - type: mrr_at_10705 value: 51.556000000000004706 - type: mrr_at_100707 value: 52.344708 - type: mrr_at_1000709 value: 52.373999999999995710 - type: mrr_at_3711 value: 48.868712 - type: mrr_at_5713 value: 50.319714 - type: ndcg_at_1715 value: 43.519000000000005716 - type: ndcg_at_10717 value: 43.803718 - type: ndcg_at_100719 value: 50.468999999999994720 - type: ndcg_at_1000721 value: 53.111722 - type: ndcg_at_3723 value: 38.893724 - type: ndcg_at_5725 value: 40.653726 - type: precision_at_1727 value: 43.519000000000005728 - type: precision_at_10729 value: 12.253730 - type: precision_at_100731 value: 1.931732 - type: precision_at_1000733 value: 0.242734 - type: precision_at_3735 value: 25.617736 - type: precision_at_5737 value: 19.383738 - type: recall_at_1739 value: 22.166740 - type: recall_at_10741 value: 51.6742 - type: recall_at_100743 value: 76.574744 - type: recall_at_1000745 value: 92.192746 - type: recall_at_3747 value: 34.477999999999994748 - type: recall_at_5749 value: 41.835750 - task:751 type: Retrieval752 dataset:753 type: hotpotqa754 name: MTEB HotpotQA755 config: default756 split: test757 revision: None758 metrics:759 - type: map_at_1760 value: 39.041761 - type: map_at_10762 value: 62.961999999999996763 - type: map_at_100764 value: 63.79899999999999765 - type: map_at_1000766 value: 63.854767 - type: map_at_3768 value: 59.399769 - type: map_at_5770 value: 61.669771 - type: mrr_at_1772 value: 78.082773 - type: mrr_at_10774 value: 84.321775 - type: mrr_at_100776 value: 84.49600000000001777 - type: mrr_at_1000778 value: 84.502779 - type: mrr_at_3780 value: 83.421781 - type: mrr_at_5782 value: 83.977783 - type: ndcg_at_1784 value: 78.082785 - type: ndcg_at_10786 value: 71.229787 - type: ndcg_at_100788 value: 74.10900000000001789 - type: ndcg_at_1000790 value: 75.169791 - type: ndcg_at_3792 value: 66.28699999999999793 - type: ndcg_at_5794 value: 69.084795 - type: precision_at_1796 value: 78.082797 - type: precision_at_10798 value: 14.993799 - type: precision_at_100800 value: 1.7239999999999998801 - type: precision_at_1000802 value: 0.186803 - type: precision_at_3804 value: 42.737805 - type: precision_at_5806 value: 27.843807 - type: recall_at_1808 value: 39.041809 - type: recall_at_10810 value: 74.96300000000001811 - type: recall_at_100812 value: 86.199813 - type: recall_at_1000814 value: 93.228815 - type: recall_at_3816 value: 64.105817 - type: recall_at_5818 value: 69.608819 - task:820 type: Classification821 dataset:822 type: mteb/imdb823 name: MTEB ImdbClassification824 config: default825 split: test826 revision: 3d86128a09e091d6018b6d26cad27f2739fc2db7827 metrics:828 - type: accuracy829 value: 90.23160000000001830 - type: ap831 value: 85.5674856808308832 - type: f1833 value: 90.18033354786317834 - task:835 type: Retrieval836 dataset:837 type: msmarco838 name: MTEB MSMARCO839 config: default840 split: dev841 revision: None842 metrics:843 - type: map_at_1844 value: 24.091845 - type: map_at_10846 value: 36.753847 - type: map_at_100848 value: 37.913000000000004849 - type: map_at_1000850 value: 37.958999999999996851 - type: map_at_3852 value: 32.818999999999996853 - type: map_at_5854 value: 35.171855 - type: mrr_at_1856 value: 24.742857 - type: mrr_at_10858 value: 37.285000000000004859 - type: mrr_at_100860 value: 38.391999999999996861 - type: mrr_at_1000862 value: 38.431863 - type: mrr_at_3864 value: 33.440999999999995865 - type: mrr_at_5866 value: 35.75867 - type: ndcg_at_1868 value: 24.742869 - type: ndcg_at_10870 value: 43.698871 - type: ndcg_at_100872 value: 49.145873 - type: ndcg_at_1000874 value: 50.23800000000001875 - type: ndcg_at_3876 value: 35.769877 - type: ndcg_at_5878 value: 39.961999999999996879 - type: precision_at_1880 value: 24.742881 - type: precision_at_10882 value: 6.7989999999999995883 - type: precision_at_100884 value: 0.95885 - type: precision_at_1000886 value: 0.104887 - type: precision_at_3888 value: 15.096000000000002889 - type: precision_at_5890 value: 11.183891 - type: recall_at_1892 value: 24.091893 - type: recall_at_10894 value: 65.068895 - type: recall_at_100896 value: 89.899897 - type: recall_at_1000898 value: 98.16899 - type: recall_at_3900 value: 43.68901 - type: recall_at_5902 value: 53.754999999999995903 - task:904 type: Classification905 dataset:906 type: mteb/mtop_domain907 name: MTEB MTOPDomainClassification (en)908 config: en909 split: test910 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf911 metrics:912 - type: accuracy913 value: 93.66621067031465914 - type: f1915 value: 93.49622853272142916 - task:917 type: Classification918 dataset:919 type: mteb/mtop_domain920 name: MTEB MTOPDomainClassification (de)921 config: de922 split: test923 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf924 metrics:925 - type: accuracy926 value: 91.94702733164272927 - type: f1928 value: 91.17043441745282929 - task:930 type: Classification931 dataset:932 type: mteb/mtop_domain933 name: MTEB MTOPDomainClassification (es)934 config: es935 split: test936 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf937 metrics:938 - type: accuracy939 value: 92.20146764509674940 - type: f1941 value: 91.98359080555608942 - task:943 type: Classification944 dataset:945 type: mteb/mtop_domain946 name: MTEB MTOPDomainClassification (fr)947 config: fr948 split: test949 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf950 metrics:951 - type: accuracy952 value: 88.99780770435328953 - type: f1954 value: 89.19746342724068955 - task:956 type: Classification957 dataset:958 type: mteb/mtop_domain959 name: MTEB MTOPDomainClassification (hi)960 config: hi961 split: test962 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf963 metrics:964 - type: accuracy965 value: 89.78486912871998966 - type: f1967 value: 89.24578823628642968 - task:969 type: Classification970 dataset:971 type: mteb/mtop_domain972 name: MTEB MTOPDomainClassification (th)973 config: th974 split: test975 revision: d80d48c1eb48d3562165c59d59d0034df9fff0bf976 metrics:977 - type: accuracy978 value: 88.74502712477394979 - type: f1980 value: 89.00297573881542981 - task:982 type: Classification983 dataset:984 type: mteb/mtop_intent985 name: MTEB MTOPIntentClassification (en)986 config: en987 split: test988 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba989 metrics:990 - type: accuracy991 value: 77.9046967624259992 - type: f1993 value: 59.36787125785957994 - task:995 type: Classification996 dataset:997 type: mteb/mtop_intent998 name: MTEB MTOPIntentClassification (de)999 config: de1000 split: test1001 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1002 metrics:1003 - type: accuracy1004 value: 74.52803606649761005 - type: f11006 value: 57.177234408887181007 - task:1008 type: Classification1009 dataset:1010 type: mteb/mtop_intent1011 name: MTEB MTOPIntentClassification (es)1012 config: es1013 split: test1014 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1015 metrics:1016 - type: accuracy1017 value: 75.440293529019341018 - type: f11019 value: 54.0528555310729641020 - task:1021 type: Classification1022 dataset:1023 type: mteb/mtop_intent1024 name: MTEB MTOPIntentClassification (fr)1025 config: fr1026 split: test1027 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1028 metrics:1029 - type: accuracy1030 value: 70.56060131537741031 - type: f11032 value: 52.622159343865311033 - task:1034 type: Classification1035 dataset:1036 type: mteb/mtop_intent1037 name: MTEB MTOPIntentClassification (hi)1038 config: hi1039 split: test1040 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1041 metrics:1042 - type: accuracy1043 value: 73.115812119039081044 - type: f11045 value: 52.3412918456454651046 - task:1047 type: Classification1048 dataset:1049 type: mteb/mtop_intent1050 name: MTEB MTOPIntentClassification (th)1051 config: th1052 split: test1053 revision: ae001d0e6b1228650b7bd1c2c65fb50ad11a8aba1054 metrics:1055 - type: accuracy1056 value: 74.289330922242331057 - type: f11058 value: 57.079187455049111059 - task:1060 type: Classification1061 dataset:1062 type: mteb/amazon_massive_intent1063 name: MTEB MassiveIntentClassification (af)1064 config: af1065 split: test1066 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71067 metrics:1068 - type: accuracy1069 value: 62.380632145258921070 - type: f11071 value: 59.464637234430091072 - task:1073 type: Classification1074 dataset:1075 type: mteb/amazon_massive_intent1076 name: MTEB MassiveIntentClassification (am)1077 config: am1078 split: test1079 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71080 metrics:1081 - type: accuracy1082 value: 56.069266980497661083 - type: f11084 value: 52.490842832835621085 - task:1086 type: Classification1087 dataset:1088 type: mteb/amazon_massive_intent1089 name: MTEB MassiveIntentClassification (ar)1090 config: ar1091 split: test1092 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71093 metrics:1094 - type: accuracy1095 value: 60.749831876260931096 - type: f11097 value: 56.9606406201659041098 - task:1099 type: Classification1100 dataset:1101 type: mteb/amazon_massive_intent1102 name: MTEB MassiveIntentClassification (az)1103 config: az1104 split: test1105 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71106 metrics:1107 - type: accuracy1108 value: 64.865501008742431109 - type: f11110 value: 62.473705481406881111 - task:1112 type: Classification1113 dataset:1114 type: mteb/amazon_massive_intent1115 name: MTEB MassiveIntentClassification (bn)1116 config: bn1117 split: test1118 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71119 metrics:1120 - type: accuracy1121 value: 63.9710827168796361122 - type: f11123 value: 61.038124219573811124 - task:1125 type: Classification1126 dataset:1127 type: mteb/amazon_massive_intent1128 name: MTEB MassiveIntentClassification (cy)1129 config: cy1130 split: test1131 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71132 metrics:1133 - type: accuracy1134 value: 54.983187626092821135 - type: f11136 value: 51.512079160083921137 - task:1138 type: Classification1139 dataset:1140 type: mteb/amazon_massive_intent1141 name: MTEB MassiveIntentClassification (da)1142 config: da1143 split: test1144 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71145 metrics:1146 - type: accuracy1147 value: 69.455279085406861148 - type: f11149 value: 66.166319054003181150 - task:1151 type: Classification1152 dataset:1153 type: mteb/amazon_massive_intent1154 name: MTEB MassiveIntentClassification (de)1155 config: de1156 split: test1157 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71158 metrics:1159 - type: accuracy1160 value: 69.327505043712161161 - type: f11162 value: 66.167552886465911163 - task:1164 type: Classification1165 dataset:1166 type: mteb/amazon_massive_intent1167 name: MTEB MassiveIntentClassification (el)1168 config: el1169 split: test1170 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71171 metrics:1172 - type: accuracy1173 value: 69.092131809011431174 - type: f11175 value: 66.956543946615071176 - task:1177 type: Classification1178 dataset:1179 type: mteb/amazon_massive_intent1180 name: MTEB MassiveIntentClassification (en)1181 config: en1182 split: test1183 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71184 metrics:1185 - type: accuracy1186 value: 73.755884330867521187 - type: f11188 value: 71.799737796569231189 - task:1190 type: Classification1191 dataset:1192 type: mteb/amazon_massive_intent1193 name: MTEB MassiveIntentClassification (es)1194 config: es1195 split: test1196 revision: 31efe3c427b0bae9c22cbb560b8f15491cc6bed71197 metrics:1198 - type: accuracy1199 value: 70.494283792871541200 - type: f1