Fully Deformable Convolutional Network for Ship Detection in Remote Sensing Imagery

Abstract

In high spatial resolution remote sensing imagery (HRSI), ship detection plays a fundamental role in a wide variety of applications. Despite the remarkable progress made by many methods, ship detection remains challenging due to the dense distribution, the complex background, and the huge differences in scale and orientation of ships. To address the above problems, a novel, fully deformable convolutional network (FD-Net) is proposed for dense and multiple-scale ship detection in HRSI, which could effectively extract features at variable scales, orientations and aspect ratios by integrating deformable convolution into the entire network structure. In order to boost more accurate spatial and semantic information flow in the network, an enhanced feature pyramid network (EFPN) is designed based on deformable convolution constructing bottom-up feature maps. Additionally, in considering of the feature level imbalance in feature fusion, an adaptive balanced feature integrated (ABFI) module is connected after EFPN to model the scale-sensitive dependence among feature maps and highlight the valuable features. To further enhance the generalization ability of FD-Net, extra data augmentation and training methods are jointly designed for model training. Extensive experiments are conducted on two public remote sensing datasets, DIOR and DOTA, which then strongly prove the effectiveness of our method in remote sensing field.