Spectral-Fidelity Convolutional Neural Networks for Hyperspectral Pansharpening

Abstract

Hyperspectral (HS) pansharpening aims at fusing a low-resolution HS (LRHS) image with a panchromatic image to obtain a full-resolution HS image. Most of the existing HS pansharpening approaches are usually based on traditional multispectral pansharpening techniques, which are not especially tailored for two inherent challenges of the HS pansharpening, i.e., much wider spectral range gap between the two kinds of images and having to recover details in many continuous spectral bands simultaneously. In this article, we develop new spectral-fidelity convolutional neural networks (called HSpeNets) for HS pansharpening to keep the fidelity of a pansharpened image to its true spectra as much as possible. Our methods particularly focus on the decomposability of HS details, accordingly synthesizing these details progressively, and meanwhile introduce a spectral-fidelity loss. We give theoretical justifications and provide detailed experimental results, showing the superiorities of the proposed HSpeNets with regard to other state-of-the-art pansharpening approaches.