Published on October 20, 2025, version 2 of the MTEB suite introduces simplified evaluation, multimodal support, rerankers, new interfaces, documentation, dataset statistics, and migration guidance.
On October 20, 2025, the MTEB team announced version 2 of its suite for evaluating embedding models. The announcement says the update includes simplified evaluation, multimodal support, rerankers, new interfaces and documentation, as well as dataset statistics and a migration guide.
Engineers evaluating embeddings can consult the original post for the updated features and migration guidance. To verify the details, compare the guide with the suite documentation and the datasets and statistics described in the material. If you use AI to study or apply it, avoid entering personal or confidential data without authorization, and check responses against the source.