Benchmark — AI Glossary

A benchmark in AI is a standardized test suite with predefined tasks, datasets, and evaluation metrics used to measure and compare model performance. Benchmarks provide objective scores across capabilities like reasoning, coding, math, language understanding, and safety. They enable researchers and practitioners to track progress, identify strengths and weaknesses, and make informed model selection decisions.