Kinship verification through facial images using multiscale and multilevel handcrafted features

Abstract

We address kinship verification, which is a challenging problem in computer vision and pattern discovery. It has several applications, such as organizing photoalbums, recognizing resemblances among humans, and finding missing children. We present a system for facial kinship verification based on several kinds of texture descriptors (local binary patterns, local ternary patterns, local directional patterns, local phase quantization, and binarized statistical image features) with pyramid multilevel (PML) face representation for feature extraction along with our proposed paired feature representation and our proposed robust feature selection to reduce the number of features. The proposed approach consists of the following three main stages: (1) face preprocessing, (2) feature extraction and selection, and (3) kinship verification. Extensive experiments are conducted on five publicly available databases (Cornell, UB KinFace, Family 101, KinFace W-I, and KinFace W-II). Additionally, we provided a wide experiment for each stage to find the best and most suitable settings. We present many comparisons with state-of-the-art methods and through these comparisons, it appears that our experiments show stable and good results. © 2020 Elsevier B.V., All rights reserved.