Multi-Spectral RGB-NIR Image Classification Using Double-Channel CNN

Abstract

As 4-sensor line scan camera technology has matured, red (R), green (G), blue (B), and near-infrared (RGB-NIR) datasets have begun to appear in large numbers. The RGB-NIR data contain the rich color features of the RGB image and the sharp edge features of the NIR image. At present, in many studies, the RGB-NIR data are input directly into the processing algorithms for calculation of the 4D data; in these cases, redundant information is included, and the high correlation between the bands results in an inability to fully exploit the characteristics of the RGB-NIR data. In this paper, we propose a double-channel convolutional neural network (CNN) algorithm that takes into account the strong correlation between the R, G, and B bands in aerial images and the weaker correlation between the NIR band and the R, G, and B bands. First, the features of the RGB and NIR bands are calculated in two different CNN networks, and subsequently, feature fusion is performed in the fully connected layer. This is followed by the classification. By combining the two neural networks of RGB-CNN and NIR-CNN, the respective characteristics of the RGB-NIR data are fully exploited.