Multimedia design approaches by just noticeable difference (JND) of audiovisual modalities

Abstract

Multimodalities have attracted much interest in designing effective multimedia contents and services by applying sensory information. However, sensory experience from different modalities have been less understood in the multimedia contents design. Therefore, the optimal sensory experience is required to be considered to give impact on multimedia contents. This study is to determine the normalized perception for equalizing sensory difference between audio and visual modality. They were estimated by Just noticeable differences (JND) of audio and visual modalities and combination of both JNDs. JND for sound pressure and brightness were measured or estimated by curve fitting to calculate normalized just noticeable difference (NJND). NJND showed the intensity of sound pressure and brightness for the sensory balance and the sensory dominance.