Can we playfully measure cognitive ability? Construct-related validity and applicant reactions

Abstract

We developed a game-based assessment (GBA) measuring cognitive ability for use in personnel selection and examined its construct-related validity. Moreover, applicant reactions toward this GBA were compared with a paper-pencil-based ability test. Both assessment tools were designed to measure verbal, numerical, and figural ability. N = 183 participants completed the GBA, the paper-pencil test, and questions capturing applicant reactions and personality. We found a strong positive correlation of 0.51 between the overall GBA and paper-pencil test scores, showing evidence for its construct-related validity. Applicant reactions toward the GBA were consistently worse compared with the paper-pencil test. Furthermore, males and individuals with more video game experience held more positive perceptions than females and individuals with less video game experience.