Infrared and Visible Image Fusion via L0 Decomposition and Intensity Mask

Abstract

Image fusion integrates complex information about a target scene from multiple sensors into a single image. The fused image can further be utilized for human perception or different machine vision tasks. In the case of infrared and visible images, infrared images have the advantage of capturing thermal radiation intensity, whereas visible images are superior in gradient texture. In order to effectively fuse thermal intensity of infrared image and texture advantage of visible image, we propose a novel fusion method based on L0 decomposition and intensity mask. The proposed method first acquires base and detail layers of images (visible & infrared) using L0 decomposition. Next, an intensity mask is obtained using the basic global thresholding method on base layers of infrared image. The layers (base layers and detail layers) and visible images are divided images into three parts by the use of intensity mask, namely, mask-base layers, mask-detail layers, and texture-background. The first and second parts effectively achieve intensity blending, whereas the third part achieves the fused image with a clear gradient texture. The proposed method shows superior performance when compared with five state-of-the-art methods (on publicly available databases).