Artificial Intelligence-Based Segmentation and Classification of Plant Images with Missing Parts and Fractal Dimension Estimation

Abstract

Existing research on image-based plant classification has demonstrated high performance using artificial intelligence algorithms. However, limited camera viewing angles can cause parts of the plant to be invisible in the acquired images, leading to an inaccurate classification. However, this issue has not been addressed by previous research. Hence, our study aims to introduce a method to improve classification performance by taking these limitations into account; specifically, we incorporated both segmentation and classification networks structured as shallow networks to expedite the processing times. The proposed shallow plant segmentation network (Shal-PSN) performs adversarial learning based on a discriminator network; and a shallow plant classification network (Shal-PCN) with applied residual connections was also implemented. Moreover, the fractal dimension estimation is used in this study for analyzing the segmentation results. Additionally, this study evaluated the performance of the proposed Shal-PSN that achieved the dice scores (DSs) of 87.43% and 85.71% with PlantVillage and open leaf image (OLID-I) open datasets, respectively, in instances where 40–60% of plant parts were missing. Moreover, the results demonstrate that the proposed method increased the classification accuracy from 41.16% to 90.51% in the same instances. Overall, our approach achieved superior performance compared to the existing state-of-the-art classification methods.