Stop Interrupting Me! Examining the Relationship Between Interruptions, Test Performance and Reactions

Abstract

Unproctored testing (UIT) is common, and mobile testing is increasing rapidly, which means applicants are completing assessments in a variety of test environments. Little is known about how differences in the test environment are related to candidate test performance and reactions. This study examines interruptions in the UIT test environment to better understand what interruptions candidates are experiencing and how they influence candidate outcomes. The results show that candidates are being interrupted in a UIT context. Interrupted candidates scored lower on test performance and reported less favorable applicant reactions. Mobile device moderated the relationship between interruptions and test performance such that, non-mobile test takers’ scores were more influenced by interruptions than mobile test takers. Interruptions happen and they do matter. Implications for organizations and practitioners are discussed