Cognitive computer tutors: Solving the two-sigma problem

Abstract

Individual human tutoring is the most effective and most expensive form of instruction. Students working with individual human tutors reach achievement levels as much as two standard deviations higher than students in conventional instruction (that is, 50% of tutored students score higher than 98% of the comparison group). Two early 20th-century innovations attempted to offer benefits of individualized instruction on a broader basis: (1) mechanized individualized feedback (via teaching machines and computers) and (2) mastery learning (individualized pacing of instruction). On average each of these innovations yields about a half standard deviation achievement effect. More recently, cognitive computer tutors have implemented these innovations in the context of a cognitive model of problem solving. This paper examines the achievement effect size of these two types of student-adapted instruction in a cognitive programming tutor. Results suggest that cognitive tutors have closed the gap with and arguably surpass human tutors.