sbert-concatenation-uv-diff-80-78
IN premise — summaries/2026/08/24/reimers-2019-sentence-bert-s5-evaluation-senteval.md
Created 2026-08-25T02:58:29+00:00
The concatenation (u, v, |u−v|) scores 80.78 on STSb, while simple concatenation (u, v) scores only 66.04 and (u*v) alone scores 70.54.
Summary
Adding the element-wise difference between two sentence embeddings to their simple concatenation boosts the similarity score by more than 14 points, showing that how two sentences diverge from each other carries a lot of meaning that plain "glue them together" or "multiply them" approaches miss. This matters because it tells the system that capturing divergence explicitly is a key ingredient in judging whether two sentences mean similar things.