Schizophrenia classification using fmri data based on a multiple feature image capsule network ensemble

Abstract

Automatic diagnosis and classification of schizophrenia based on functional magnetic resonance imaging (fMRI) data have attracted increasing attention in recent years. Most previous studies abstracted highly compressed functional features from the view of brain science and fed them into shallow classifiers for this purpose. However, their classification performance in practical applications is unstable and unsatisfactory. As an acute psychotic disorder, schizophrenia shows functional complexity in fMRI data. Therefore, additional features and deep classification methods are needed to improve classification performance. In this study, we propose a multiple feature image capsule network ensemble approach for schizophrenia classification. The proposed approach proceeds in three steps: 1) extracting multiple image features from the perspective of linear sparse representation, nonlinear multiple kernel representation, and function connection of brain areas respectively; 2) feeding these image features into three specially designed independent capsule networks for classification; 3) obtaining the final results by fusing the outputs of these three deep capsule network using a ensemble approach. To further improve the classification performance, we design a optimization model of maximizing the square of correlation coefficients and propose a weighted ensemble technology based on this model, which is mathematically proved to be solved as a eigenvalue decomposition problem in certain case. Finally, the proposed approach is implemented and evaluated on the schizophrenia fMRI dataset from COBRE, UCLA and WUSTL. From the experimental results, we conclude that the proposed method outperforms some current methods and further improves the accuracy of schizophrenia classification.