MMTEB: Massive Multilingual Text Embedding Benchmark
Paper
•
2502.13595
•
Published
•
45
MMTEB
A collection of items telated the the MMTEB release
-
-
MTEB Leaderboard
🥇7.05kEmbedding Leaderboard
-
mteb/BornholmBitextMining
Viewer • Updated • 6.79k • 5.97k -
davidstap/biblenlp-corpus-mmteb
Viewer • Updated • 1.74M • 4.76k • 3 -
mteb/bucc-bitext-mining
Viewer • Updated • 70k • 541 • 3 -
mteb/DiaBlaBitextMining
Viewer • Updated • 11.5k • 502 -
mteb/FloresBitextMining
Viewer • Updated • 2.01k • 243 • 1 -
mteb/IN22GenBitextMining
Viewer • Updated • 132k • 367 • 1 -
mteb/IndicGenBenchFloresBitextMining
Viewer • Updated • 119k • 581 -
gentaiscool/bitext_nollysenti_miners
Viewer • Updated • 3.28k • 297 -
kardosdrur/norwegian-courts
Viewer • Updated • 1.14k • 403 • 1 -
mteb/NTREXBitextMining
Viewer • Updated • 2k • 175 • 1 -
gentaiscool/bitext_nusatranslation_miners
Viewer • Updated • 100k • 353 -
gentaiscool/bitext_nusax_miners
Viewer • Updated • 11k • 394 -
mteb/tatoeba-bitext-mining
Viewer • Updated • 176k • 1.3k • 8 -
artist/Bulgarian-Online-Store-Feedback-Text-Analysis
Viewer • Updated • 906 • 369 -
fewshot-goes-multilingual/cs_mall-product-reviews
Viewer • Updated • 30k • 358 • 1 -
AI-team-UoA/greek_legal_code
Viewer • Updated • 143k • 1.43k • 13 -
fancyzhx/dbpedia_14
Viewer • Updated • 630k • 4.53k • 34 -
mteb/FinancialPhrasebankClassification
Viewer • Updated • 2.26k • 334 -
mteb/PoemSentimentClassification
Viewer • Updated • 1.1k • 347 -
mteb/toxic_conversations_50k
Viewer • Updated • 100k • 2.75k • 19 -
mteb/TweetTopicSingleClassification
Viewer • Updated • 30.1k • 174 -
kardosdrur/estonian-valence
Viewer • Updated • 4.09k • 360 • 1 -
scaredmeow/shopee-reviews-tl-stars
Viewer • Updated • 15k • 183 • 2 -
mlexplorer008/gujarati_news_classification
Viewer • Updated • 6.59k • 338 • 1 -
OdiaGenAI/sentiment_analysis_hindi
Viewer • Updated • 2.5k • 399 • 2 -
manandey/id_clickbait
Viewer • Updated • 15k • 178 -
itacasehold/itacasehold
Viewer • Updated • 1.1k • 453 • 2 -
mteb/KorSarcasmClassification
Viewer • Updated • 2.35k • 135 -
asparius/Kurdish-Sentiment
Viewer • Updated • 7.99k • 181 • 1 -
isaacchung/macedonian-tweet-sentiment-classification
Viewer • Updated • 9.71k • 188 -
mteb/AfriSentiClassification
Viewer • Updated • 94.8k • 668 -
mteb/amazon_counterfactual
Viewer • Updated • 21.2k • 4.91k • 3 -
community-datasets/catalonia_independence
Viewer • Updated • 20.1k • 253 • 4 -
tatiana-merz/cyrillic_turkic_langs
Viewer • Updated • 90k • 393 • 1 -
ai4bharat/Bhasha-Abhijnaanam
Viewer • Updated • 1 • 300 • 2 -
mteb/masakhanews
Viewer • Updated • 62.2k • 2.13k -
mteb/amazon_massive_intent
Viewer • Updated • 1.6M • 6.31k • 27 -
mteb/multi-hatecheck
Viewer • Updated • 40.3k • 621 -
mteb/NordicLangClassification
Viewer • Updated • 60k • 328 -
gentaiscool/nusaparagraph_emot
Viewer • Updated • 44.6k • 956 -
mteb/NusaX-senti
Viewer • Updated • 12k • 708 -
mteb/multilingual-scala-classification
Viewer • Updated • 74.8k • 810 • 1 -
mteb/SwissJudgementClassification
Viewer • Updated • 72.8k • 611 -
bpHigh/iNLTK_Nepali_News_Dataset
Viewer • Updated • 7.47k • 331 • 3 -
mlexplorer008/odia_news_classification
Viewer • Updated • 19k • 164 -
mlexplorer008/punjabi_news_classification
Viewer • Updated • 784 • 318 • 2 -
PL-MTEB/polemo2_out
Viewer • Updated • 6.77k • 352 -
mteb/PAC
Viewer • Updated • 9.25k • 327 -
NLPC-UOM/Sinhala-News-Category-classification
Viewer • Updated • 3.33k • 186 • 1 -
fewshot-goes-multilingual/sk_csfd-movie-reviews
Viewer • Updated • 30k • 405 • 1 -
isaacchung/siswati-news
Viewer • Updated • 80 • 160 -
janko/sk_csfd-movie-reviews
Viewer • Updated • 25k • 221 -
Mollel/SwahiliNewsClassification
Viewer • Updated • 24.3k • 170 • 1 -
mteb/DalajClassification
Viewer • Updated • 9.46k • 303 -
dsfsi/daily-news-dikgang
Viewer • Updated • 4.87k • 280 • 2 -
isaacchung/isizulu-news
Viewer • Updated • 752 • 170 -
jinaai/cities_wiki_clustering
Viewer • Updated • 1 • 327 • 1 -
mteb/MasakhaNEWSClusteringS2S
Viewer • Updated • 80 • 1.21k -
kardosdrur/romani-bible
Viewer • Updated • 4 • 286 -
mteb/arxiv-clustering-p2p
Viewer • Updated • 31 • 2.33k • 3 -
mteb/arxiv-clustering-s2s
Viewer • Updated • 31 • 2.84k • 1 -
mteb/big-patent
Viewer • Updated • 67.1k • 351 • 1 -
mteb/biorxiv-clustering-p2p
Viewer • Updated • 53.8k • 2.2k -
mteb/medrxiv-clustering-p2p
Viewer • Updated • 17.6k • 2.23k • 2 -
mteb/stackexchange-clustering
Viewer • Updated • 50 • 2.89k • 1 -
mteb/AlloProfClusteringS2S.v2
Viewer • Updated • 2.56k • 315 -
lyon-nlp/clustering-hal-s2s
Viewer • Updated • 197k • 758 • 1 -
mteb/sib200
Viewer • Updated • 387k • 1.64k • 3 -
ryzzlestrizzle/multi-wiki-clustering-p2p
Viewer • Updated • 140 • 1.08k -
PL-MTEB/plsc-clustering-p2p
Viewer • Updated • 17.5k • 331 -
mteb/SwednClusteringP2P
Viewer • Updated • 103k • 296 -
C-MTEB/CLSClusteringP2P
Viewer • Updated • 10 • 797 -
CoIR-Retrieval/stackoverflow-qa
Viewer • Updated • 55.8k • 1.64k -
sorenmulli/da-hashtag-twitterhjerne
Viewer • Updated • 78 • 3.73k -
mteb/AILA_statutes
Viewer • Updated • 349 • 2.41k • 2 -
mteb/arguana
Benchmark • Updated • 11.5k • 9.02k • 1 -
mteb/HagridRetrieval
Viewer • Updated • 1.49k • 939 -
mteb/legalbench_corporate_lobbying
Viewer • Updated • 999 • 1.13k -
dwzhu/LongEmbed
Viewer • Updated • 29.6k • 5.73k • 7 -
mteb/scidocs
Viewer • Updated • 56.6k • 5.37k • 5 -
mteb/SpartQA
Viewer • Updated • 11.9k • 951 -
mteb/TempReasonL1
Viewer • Updated • 20.5k • 911 -
mteb/trec-covid
Viewer • Updated • 238k • 5.68k • 3 -
mteb/WinoGrande
Viewer • Updated • 7.63k • 953 -
facebook/belebele
Viewer • Updated • 110k • 9.01k • 122 -
mteb/MLQARetrieval
Viewer • Updated • 500k • 2.5k -
McGill-NLP/statcan-dialogue-dataset-retrieval
Viewer • Updated • 18.5k • 635 • 1 -
mteb/WikipediaRetrievalMultilingual
Viewer • Updated • 264k • 877 • 1 -
mteb/CovidRetrieval
Viewer • Updated • 102k • 1.21k -
jhu-clsp/core17-instructions-mteb
Viewer • Updated • 29.5k • 4.85k -
jhu-clsp/news21-instructions-mteb
Viewer • Updated • 39.7k • 1.76k -
jhu-clsp/robust04-instructions-mteb
Viewer • Updated • 84.8k • 1.89k -
mteb/KorHateSpeechMLClassification
Viewer • Updated • 19k • 164 -
MLRS/maltese_news_categories
Viewer • Updated • 15.4k • 686 -
mteb/eurlex-multilingual
Viewer • Updated • 1.04M • 939 • 1 -
mteb/BrazilianToxicTweetsClassification
Viewer • Updated • 10.2k • 2.85k • 1 -
ai-forever/cedr-classification
Viewer • Updated • 9.41k • 542 -
mteb/CTKFactsNLI
Viewer • Updated • 680 • 302 -
mteb/sprintduplicatequestions-pairclassification
Viewer • Updated • 2 • 4k -
mteb/twitterurlcorpus-pairclassification
Viewer • Updated • 1 • 3.51k -
asparius/Armenian-Paraphrase-PC
Viewer • Updated • 2 • 149 • 1 -
mteb/indonli
Viewer • Updated • 2.04k • 139 -
mteb/OpusparcusPC
Viewer • Updated • 24 • 845 -
mteb/PawsXPairClassification
Viewer • Updated • 28k • 945 -
maximoss/rte3-multi
Viewer • Updated • 6.4k • 362 • 2 -
mteb/xnli
Viewer • Updated • 12M • 2.97k • 1 -
PL-MTEB/ppc-pairclassification
Viewer • Updated • 3 • 318 -
ai-forever/terra-pairclassification
Viewer • Updated • 2 • 1.31k -
mteb/WebLINXCandidatesReranking
Viewer • Updated • 12M • 505 -
mteb/AlloprofReranking
Viewer • Updated • 25k • 1.08k -
mteb/VoyageMMarcoReranking
Viewer • Updated • 111k • 318 -
mteb/WikipediaRerankingMultilingual
Viewer • Updated • 480k • 815 -
mteb/RuBQReranking
Viewer • Updated • 78k • 1.2k • 1 -
mteb/T2Reranking
Viewer • Updated • 207k • 1.16k -
jinaai/german-STSbenchmark
Viewer • Updated • 8.63k • 635 • 1 -
mteb/sickr-sts
Viewer • Updated • 9.93k • 16.9k • 5 -
mteb/sts12-sts
Viewer • Updated • 5.34k • 48.8k • 7 -
mteb/sts13-sts
Viewer • Updated • 1.5k • 16k • 1 -
mteb/sts14-sts
Viewer • Updated • 3.75k • 15.4k • 2 -
mteb/sts15-sts
Viewer • Updated • 3k • 4.36k • 2 -
mteb/stsbenchmark-sts
Viewer • Updated • 8.63k • 20.1k • 17 -
vesteinn/faroese-sts
Viewer • Updated • 729 • 4.28k • 2 -
mteb/FinParaSTS
Viewer • Updated • 3k • 1.17k -
mteb/JSICK
Viewer • Updated • 9.93k • 1.24k -
mteb/IndicCrosslingualSTS
Viewer • Updated • 3.07k • 1.16k -
SemRel/SemRel2024
Viewer • Updated • 26.3k • 1.46k • 1 -
mteb/sts17-crosslingual-sts
Viewer • Updated • 10.7k • 5.73k • 3 -
mteb/sts22-crosslingual-sts
Viewer • Updated • 17.2k • 116k • 9 -
mteb/STSES
Viewer • Updated • 155 • 1.19k -
C-MTEB/STSB
Viewer • Updated • 8.05k • 1.79k • 1 -
mteb/MIRACLRetrievalHardNegatives
Viewer • Updated • 2.57M • 3.98k