ESPFNet: An Edge-Aware Spatial Pyramid Fusion Network for Salient Shadow Detection in Aerial Remote Sensing Images

Abstract

Shadows can hinder image interpretation in aerial remote sensing images. The existing shadow detection methods focus on all shadow regions and detect the shadow regions directly, but they ignore the fact that salient shadows have a more significant effect. In this work, a novel edge-aware spatial pyramid fusion network (ESPFNet) under a multitask learning framework is proposed for salient shadow detection in aerial remote sensing images. ESPFNet has three components: a parallel spatial pyramid (PSP) structure; an edge detection module (EDM); and an edge-aware multibranch integration (EMI). The PSP structure is constructed to extract multiscale features from the input image and fuse them gradually. The EDM then integrates the shallow features and deep features to detect the shadow edges. Finally, the EMI incorporates the edge features with multibranch features, and then concatenates them with the shallow features to generate the salient shadow detection result. The experimental analyses confirm the effectiveness of the ESPFNet method in both the qualitative and quantitative performance, compared to the existing methods, with the F-score reaching 92.04% in the salient shadow test set.