An Automated CNN-based 3D Anatomical Landmark Detection Method to Facilitate Surface-Based 3D Facial Shape Analysis

Abstract

Maternal alcohol consumption during pregnancy can lead to a wide range of physical and neurodevelopmental problems, collectively known as fetal alcohol spectrum disorders (FASD). In many cases, diagnosis is heavily reliant on the recognition of a set of characteristic facial features, which can be subtle and difficult to objectively identify. To provide an automated and objective way to quantify these features, this paper proposes to take advantage of high-resolution 3D facial scans collected from a high-risk population. We present a method to automatically localize anatomical landmarks on each face, and align them to a standard space. Subsequent surface-based morphology analysis or anatomical measurements demands that such a method is both accurate and robust. The CNN-based model uses a novel differentiable spatial to numerical transform (DSNT) layer that could transform spatial activation to numerical values directly, which enables end-to-end training. Experiments reveal that the inserted layer helps to boost the performance and achieves sub-pixel level accuracy.