Multimedia framework for application of spatial auditory information to learning materials

Abstract

We have been investigating a tabletop interface at which spatial auditory information is presented as well as visual information. This paper describes a case study of using this platform in a classroom to enrich learning materials. The hundred waka poems by one hundred poets, called Hyakunin-Isshu, which is the famous Japanese poetry anthology and known as an intellectual game at home and school, is selected as a subject. Digital cards are spread out at random on the tabletop, where each of them has the second half of a poem. The user makes trials of taking a card to be matched with the first half of the poem that is read by a reciter (speech synthesis software). Auditory cue is given as well, as a hint at the position where the right answer is placed when the learner cannot find the one. Development of the learning material is achieved through user testing with people who are specialized in education. This multimedia framework would help the learner keep interest in learning Hyakunin-Isshu or other school subjects in general. © 2013 Springer-Verlag Berlin Heidelberg.