Handwritten Logic Circuits Analysis Using the YOLO Network and a New Boundary Tracking Algorithm

Abstract

Handwriting analysis has been addressed by researchers for decades, and many advances were achieved in understanding handwritten texts so far. However, some applications have been rarely discussed. One of these applications that has received less attention is the understanding and analyzing of handwritten circuits. Today, with the widespread use of intelligent tools in engineering and educational processes, the need for new and accurate solutions for processing such handwritings is felt more than ever. This paper presents a new method to analyze handwritten logic circuits. In this method, circuit components are first identified using a deep neural network based on YOLO. Then, the connection among these components is recognized using a new simple boundary tracking method. Then, the binary function related to the handwritten circuit is obtained. Finally, the truth table of the logic circuit is generated. We have also created a set of various handwritten logic circuits called JSU-HWLC. The results of the experiments show the proper performance of the proposed method on the collected dataset. The experiments demonstrated that the YOLO algorithm achieved better results than other deep learning methods such as faster R-CNN, Detectron2, and RetinaNet. For this reason, YOLO has been used to identify logic gates in the proposed system.