Hyper-interactive video browsing by a remote controller and hand gestures

Abstract

Interactive video browsing tools are designed for e-learning applications on future interactive TVs. The integrated system includes an authoring tool that produces multi-paths videos and a playback tool that uses video tracking technology and a remote controller. The playback tool enables multi-modal interaction between the user and a multi-story video clip. Three types of hyperinteractive controls are incorporated, which include a reference link of a video object to show supplementary information on the Web, a hyper link to enable hypervideo jumps, and a choice link for online answers to pre-designed questions. The underlying video is coded using the standard MPEG technology, with navigation information hidden in the user-defined data of MPEG. Thus, the default sequence of a hypervideo can also be presented using an ordinary video player. © IFIP International Federation for Information Processing 2005.