What catches your eyes as you move around? On the discovery of interesting regions in the street

Abstract

Interesting regions are defined as parts of street view scenes that can attract people’s interests when they are moving on the road, and play an important role in various daily-life scenarios. In this paper, therefore, we propose a framework for locating interesting regions in the street and explore the potential use for advanced multimedia applications. Based on the psychological findings and cognitive processes, we proposed and quantified three properties for modeling interesting regions, including attractive, unique, and familiar. Also, a spatial-temporal fusion scheme is developed to combine the multiple properties for discovering the presence of interesting regions. We conduct a set of user studies to demonstrate the effectiveness of our approach. The results support that most users agreed with the interesting regions found by the proposed approach. Finally, a novel application based on interesting regions is also presented for offering an improved navigation experience to vehicle drivers.