An Augmentation Strategy for Medical Image Processing Based on Statistical Shape Model and 3D Thin Plate Spline for Deep Learning

Abstract

At present, deep learning has been widely adopted in medical image processing. However, the current deep neural networks depend on a large number of labeled training data, but medical images segmentation tasks often suffer from the problem of small quantity of labeled data because labeling medical images is a very expensive and time-consuming task. In order to overcome this difficulty, this paper proposes a new image augmentation strategy based on statistical shape model and three-dimensional thin plate spline, which can generate many simulated images from a small number of real images. Firstly, the shape information of the real labeled images is modeled with the statistical shape model, and a series of simulated shapes are generated by sampling from this model. Secondly, the simulated shapes are filled with texture using three-dimensional thin plate spline to generate the simulated images. Finally, the simulated images and the real images are used together for training deep neural networks. The proposed framework is a general data augmentation method that can be used in any anatomical structure segmentation tasks with any deep neural network architecture. We used two different datasets, including prostate MRI dataset and liver CT dataset, and used two different deep network structures, including multi-scale 3D Convolutional Neural Networks (multi-scale 3D CNN) and U-net. The experimental results showed that the proposed data augmentation strategy can improve the accuracy of existing segmentation algorithms based on deep neural networks.