Instructional video content employing user behavior analysis: Time dependent annotation with levels of detail

Abstract

We develop a multimedia instruction system for the inheritance of skills. This system identifies the difficult segments of video by analyzing user behavior. Difficulties may be inferred by the learner's requiring more time to fully process a portion of video; they may replay or pause the video during the course of a segment, or play it at a slow speed. These difficult video segments are subsequently assumed to require the addition of expert, instructor annotations, in order to enable learning. We propose a time-dependent annotation mechanism, employing a level of detail (LoD) approach. This annotation is superimposed upon the video, based on the user's selected speed of playback. The LoD, which reflects the difficulty of the training material, is used to adapt whether to display the annotation to the user. We present the results of an experiment that describes the relationship between the difficulty of material and the LoDs. © 2010 Springer-Verlag.