Evaluation of Single and Dual Image Object Detection through Image Segmentation Using ResNet18 in Robotic Vision Applications

Abstract

This study presents a method for enhancing the accuracy of object detection in industrial automation applications using ResNet18-based image segmentation. The objective is to extract object images from the background image accurately and efficiently. The study includes three experiments, RGB to grayscale conversion, single image processing, and dual image processing. The results of the experiments show that dual image processing is superior to both RGB to grayscale conversion and single image processing techniques in accurately identifying object edges, determining CG values, and cutting background images and gripper heads. The program achieved a 100% success rate for objects located in the workpiece tray, while also identifying the color and shape of the object using ResNet-18. However, single image processing may have advantages in certain scenarios with sufficient image information and favorable lighting conditions. Both methods have limitations, and future research could focus on further improvements and optimization of these methods, including separating objects into boxes of each type and converting image coordinate data into robot working area coordinates. Overall, this study provides valuable insights into the strengths and limitations of different object recognition techniques for industrial automation applications.