Accurate Classification of Multi-Cultivar Watermelons via GAF-Enhanced Feature Fusion Convolutional Neural Networks

Abstract

The online rapid classification of multi-cultivar watermelon, including seedless and seeded types, has far-reaching significance for enhancing quality control in the watermelon industry. However, interference in one-dimensional spectra affects the high-accuracy classification of multi-cultivar watermelons with similar appearances. This study proposed an innovative method integrating Gramian Angular Field (GAF), feature fusion, and Squeeze-and-Excitation (SE)-guided convolutional neural networks (CNN) based on VIS-NIR transmittance spectroscopy. First, one-dimensional spectra of 163 seedless and 160 seeded watermelons were converted into two-dimensional Gramian Angular Summation Field (GASF) and Gramian Angular Difference Field (GADF) images. Subsequently, a dual-input CNN architecture was designed to fuse discriminative features from both GASF and GADF images. Feature visualization of high-weight channels of the input images in convolutional layer revealed distinct spectral features between seedless and seeded watermelons. With the fusion of distinguishing feature information, the developed CNN model achieved a classification accuracy of 95.1% on the prediction set, outperforming traditional models based on one-dimensional spectra. Remarkably, wavelength optimization through competitive adaptive reweighted sampling (CARS) reduced GAF image generation time to 55.19% of full-wavelength processing, while improving classification accuracy to 96.3%. A better generalization of the model was demonstrated using 17 seedless and 20 seeded watermelons from other origins, with a classification accuracy of 91.9%. These findings substantiated that GAF-enhanced feature fusion CNN can significantly improve the classification accuracy of multi-cultivar watermelons, casting innovative light on fruit quality based on VIS-NIR transmittance spectroscopy.