What we might look for in an AGI benchmark

Abstract

A benchmark in the field of Artificial General Intelligence (AGI) would allow evaluation and comparison of the many computational intelligence algorithms that have been developed. In this paper I propose that an ideal benchmark would possess seven key characteristics: fitness, breadth, specificity, low cost, simplicity, range, and task focus.