Real-Time Embedded Vision System for Online Monitoring and Sorting of Citrus Fruits

Abstract

Citrus fruits are the second most important crop worldwide. One of the most important tasks is sorting, which involves manually separating the fruit based on its degree of maturity, and in many cases, involves a task carried out manually by human operators. A machine vision-based citrus sorting system can replace labor work for the inspection of fruit sorting. This article proposes a vision system for citrus fruit sorting implemented on a dedicated and efficient Field Programmable Gate Array (FPGA) hardware architecture coupled with a mechanical sorting machine, where the FPGA performs fruit segmentation and color and size classification. We trained a decision tree (DT) using a balanced dataset of reference images to perform pixel classification. We evaluate the segmentation task using a pixel accuracy metric, defined as the ratio between correctly segmented pixels produced by a DT and the total pixels in the reference image segmented offline using Otsu’s thresholding algorithm. The balance between correctly classified images by color or size and their corresponding labels of that color and size evaluates the color and size classification algorithms. Considering these metrics, the system reaches an accuracy of 97% for fruit segmentation, 94% for color classification, and 90% for size classification, running at 60 fps.