Reasoning Benchmark
Noun · AI & Machine Learning
Definitions
A benchmark designed to test reasoning ability, such as multi-step logic, math, planning, or problem decomposition. Reasoning benchmarks are useful, but they can overstate practical value if they diverge from real tasks.
In plain English: A benchmark used to measure reasoning ability.
Example: "The new model ranked higher on a reasoning benchmark, but their internal workflow test showed little improvement for customer support triage."