Deep Prototypical Networks with Hybrid Residual Attention for Hyperspectral Image Classification

Abstract

Recently, convolutional neural networks (CNNs) have attracted enormous attention in pattern recognition and demonstrated excellent performance in hyperspectral image (HSI) classification. However, high-dimensional HSI dataset versus limited training samples is easy to cause the overfitting phenomenon in deep neural networks. Additionally, the intraclass distance of the embedding features extracted through the softmax-based CNNs may be greater than that of the interclass, which makes it difficult to further improve the classification accuracy. To address these issues, this article proposes a deep prototypical network with hybrid residual attention, which can effectively investigate the spectral-spatial information in the HSI. Specifically, in order to improve the generalization capability of the model, feature extraction with a hybrid residual attention module is presented to enhance the critical spectral-spatial features and suppress the useless ones in the classification task. Furthermore, a novel discriminant distance-based cross-entropy loss is proposed to increase the intraclass compactness, to obtain more superior results. Extensive experiments on three benchmark datasets are carried out to convincingly evaluate the proposed framework. With the generation of optimal prototypes representing each class and more discriminative embedding features, encouraging classification results are achieved compared with state-of-the-art methods.