mteb-pair-classification-distance-metrics
IN premise — summaries/2026/08/24/muennighoff-2022-mteb-s3-the-mteb-benchmark.md
Created 2026-08-25T02:58:19+00:00
MTEB pair classification searches over cosine, dot, Euclidean, and Manhattan distance metrics to select the best binary threshold, reporting average precision with cosine similarity.
Summary
Pair classification in MTEB doesn't lock in on a single similarity measure; it tests cosine, dot product, Euclidean, and Manhattan distances to find the best cutoff for calling a pair positive or negative, but the final score you see is always expressed in cosine-similarity terms. This matters because the threshold that gets selected may have been optimal under a different metric, so the reported average precision blends a multi-metric search with a single standardized reporting format.