Real-time image fusion monitoring system: Problems and solutions

Abstract

The paper presents complete real-time image fusion system intended for supervisory and monitoring purposes in mobile appliances. The system is equipped with an optoelectronic head containing two multiband image sensors: TV and IR (infrared). System structure as well as searching process of the efficient, real-time image processing algorithms are briefly described. Principally, image registration is based on the hybrid approach (edge extraction and phase correlation). The image fusion method can be chosen according to operator demands between Laplacian pyramid and FABEMD decomposition. Real-time multispectral video signals processing is performed by application of custom hardware solution based on a single FPGA chip. This allows for implementing fast paralleled and pipelined processing flow. The system hardware is also presented in this paper. © 2013 Springer-Verlag.