Preference prediction based on eye movement using multi-layer combinatorial fusion

Abstract

Face image preference is influenced by many factors and can be detected by analyzing eye movement data. When comparing two face images, our gaze shifts within and between the faces. Eye tracking data can give us insights into the cognitive processes involved in forming a preference. In this paper, a gaze tracking dataset is analyzed using three machine learning algorithms (MLA): AdaBoost, Random Forest, and Mixed Group Ranks (MGR) as well as a newly developed machine learning framework called Multi-Layer Combinatorial Fusion (MCF) to predict a subject’s face image preference. Attributes constructed from the dataset are treated as input scoring systems. MCF involves a series of layers that consist of expansion and reduction processes. The expansion process involves performing exhaustive score and rank combinations, while the reduction process uses performance and diversity to select a subset of systems that will be passed onto the next layer of analysis. Performance and cognitive diversity are used in weighted scoring system combinations and system selection. The results outperform the Mixed Group Ranks algorithm, as well as our previous work using pairwise scoring system combinations.