A ‘Kansei’ multimedia and semantic computing system for cross-cultural communication

Abstract

In the design of multimedia computing systems, one of the most important issues is how to search and analyze media data (images, music, movies and documents), according to user’s impressions and contexts. This paper presents “Kansei-Multimedia Computing System” for realizing international and cross-cultural research environments, as a new platform of multimedia computing system. We introduce a “Kansei” and semantic associative search method based on the “Mathematical Model of Meaning (MMM)”. The concept of “Kansei” includes several meanings on sensitive recognition, such as “emotion”, “impression”, “human senses”, “feelings”, “sensitivity”, “psychological reaction” and “physiological reaction”. MMM realizes “Kansei” processing and semantic associative search for media data, according to user’s impressions and contexts. This model is applied to compute semantic correlations between keywords, images, music, movies and documents dynamically in a context-dependent way. This system based on MMM realizes (1) “Kansei” image and music search and analysis for cooperative creation and manipulation of multimedia objects and (2) Cross-cultural communications with music and images databases.