A Fine-Grained Genetic Landform Classification Network Based on Multimodal Feature Extraction and Regional Geological Context

Abstract

Deep learning networks have facilitated the automated scene recognition of landforms based on geomorphogenesis. However, current genetic landform classification methods do not consider regional geological context, which can more accurately reflect the formation and evolution mechanism of geomorphic landforms than local ones. Therefore, this study proposes a multimodal, deep learning landform recognition framework based on a joint contextual geological and channel attention module (GCMENET). First, the multibranch feature extraction network of DenseNet121 is used to extract the respective features from the target scene and the contextual geological scene. Second, the features similar to the landform features of the target scene are extracted from the contextual geological features based on the cosine method and then combined with geomorphic features of the target scene. Third, channel attention mechanism is used to reduce the interference caused by redundant contextual geological information after fusion of data. To measure the classification accuracy of GCMENET, we establish a fine geomorphogenic dataset consisting of remote sensing images of six landform types with a 64×64-pixel size and 10-m resolution (JOS10m). During the training process of two geomorphogenic datasets, the feature extraction network without batchnorm2d (batch normalization) could preserve the distribution and spatial alignment of data from the components. Using different training-to-validation data ratios and combinations of input components, the results of the GCMENET supplemented with the joint contextual geological and channel attention module exhibited greater accuracy than those obtained without the module. This observation confirms the importance of contextual geological information in automated geomorphogenic landforms.