Music and Color Synaesthesia with Visual Saliency Information

Abstract

Music and color synesthesia is a stimulus in the acoustic modality will consistently and automatically trigger concurrent percepts in the visual modality. In this paper, we study the music and color synesthesia with visual saliency information in the emotional level by the eye tracking technique. We organize an experiment, letting participants look at four different color combinations on the screen when listen to the music with eight emotions. And the eye tracker is adopted to catch the eye movement of participants during the experiments. From the metrics of the total fixation time and the scan paths, we obtain the relations between music and colors in the emotional level by this objective way. Besides, a questionnaire about the music and color synaesthesia is provided for participants to fill in. So that we can compare the objective and subjective cognition styles.