Image user profiling with knowledge graph and computer vision

Abstract

In this paper, we explore the synergy between knowledge graph technologies and computer vision tools for image user profiling. We propose two image user profiling approaches which map an image to knowledge graph entities representing the interests of a user who appreciates the image. The first one maps an image to entities which correspond to the objects appearing in the image. The second one maps to entities which are depicted by visually similar images and which exist in the conceptual scope of the dataset within which further personalisation tasks are conducted. A demo configured with a real and recent commercial travel domain dataset is given at ESWC 2018.