MRI brain tumor segmentation and patient survival prediction using random forests and fully convolutional networks

Abstract

In this paper, we propose a learning based method for automated segmentation of brain tumor in multimodal MRI images, which incorporates two sets of machine-learned and hand-crafted features. Fully convolutional networks (FCN) forms the machine-learned features and texton based histograms are considered as hand-crafted features. Random forest (RF) is used to classify the MRI image voxels into normal brain tissues and different parts of tumors. The volumetric features from the segmented tumor tissues and patient age applying to an RF is used to predict the survival time. The method was evaluated on MICCAI-BRATS 2017 challenge dataset. The mean Dice overlap measures for segmentation of validation dataset are 0.86, 0.78 and 0.66 for whole tumor, core and enhancing tumor, respectively. The validation Hausdorff values are 7.61, 8.70 and 3.76. For the survival prediction task, the classification accuracy, pairwise mean square error and Spearman rank are 0.485, 198749 and 0.334, respectively.