Estimating 3D chlorophyll content distribution of trees using an image fusion method between 2D camera and 3D portable scanning lidar

Abstract

An image fusion method has been proposed for plant images taken using a two-dimensional (2D) camera and three-dimensional (3D) portable lidar for obtaining a 3D distribution of physiological and biochemical plant properties. In this method, a 2D multispectral camera with five bands (475-840 nm) and a 3D high-resolution portable scanning lidar were applied to three sets of sample trees. After producing vegetation index (VI) images from multispectral images, 3D point cloud lidar data were projected onto the 2D plane based on perspective projection, keeping the depth information of each of the lidar points. The VI images were 2D registered to the lidar projected image based on the projective transformation and VI 3D point cloud images were reconstructed based on the depth information. Based on the relationship between the VI values and chlorophyll contents taken by a soil and plant analysis development (SPAD)-502 plus chlorophyll meter, 3D distribution images of the chlorophyll contents were produced. Similarly, a thermal 3D image for a sample was also produced. The resultant chlorophyll distribution images offered vertical and horizontal distributions, and those for each orientation for each sample, showing the spatial variability of the distribution and the difference between the samples.