mteb-speed-bench-hardware

IN premise — summaries/2026/08/24/muennighoff-2022-mteb-s4-results.md

Created 2026-08-25T02:58:21+00:00

MTEB speed benchmarks were run on 1× Nvidia A100 80GB with CUDA 11.6 using the STS15 dataset

Summary

This records the exact hardware and software setup used to measure how fast the MTEB benchmarks run, pinning the results to a single high-end GPU (an A100) with a specific CUDA version and the STS15 dataset. It matters because any speed numbers reported from this run are only directly comparable to other results produced under the same conditions, and the 80GB of VRAM means large models could be loaded without splitting across multiple GPUs.