DHRNet: A Dual-Branch Hybrid Reinforcement Network for Semantic Segmentation of Remote Sensing Images

Abstract

In the field of remote sensing image processing, semantic segmentation has always been a hot research topic. Currently, deep convolutional neural networks (DCNNs) are the mainstream methods for the semantic segmentation of remote sensing image (RSI). There are two commonly used semantic segmentation methods based on DCNNs: multiscale feature extraction based on deep-level features, and global modeling. The former can better extract object features of different scales in complex scenes. However, this method lacks sufficient spatial information, resulting in poor edge segmentation ability. The latter can effectively solve the problem of limited receptive field in DCNNs obtaining more comprehensive feature extraction results. Unfortunately, this method is prone to misclassification, resulting in incorrect predictions of local pixels. To address these issues, we propose the dual-branch hybrid reinforcement network (DHRNet) for more precise semantic segmentation of RSI. This model is a dual-branch parallel structure with a multiscale feature extraction branch and a global context and detail enhancement branch. This structure decomposes the complex semantic segmentation task, allowing each branch to extract features with different emphases while retaining sufficient spatial information. The results of both branches are fused to obtain a more comprehensive segmentation result. After conducting extensive experiments on three publicly available RSI datasets, ISPRS Potsdam, ISPRS Vaihingen, and LoveDA, DHRNet demonstrates excellent results with the mean intersection over union of 86.97%, 83.53%, and 54.48% on the three datasets, respectively.