Augmented Reality Based Visual Programming of Robot Training for Educational Demonstration Site

Abstract

The human resource development of robotics and automation in the smart factory is an important factor in "Thailand 4.0" roadmap, which is following the industry 4.0 model. To pursue this goal of Thailand 4.0 roadmap of labor development, the effective and intuitive training system must be easy to understand. This study proposes the implementation of augmented reality (AR) technology for training purposes due to its ability to visualize realtime invisible data, such as device status. This involves the development of the AR-based visual programming interface with an educational demonstration site (demo site). The ARbased training system is started with animation content explaining the smart factory concept, followed by hands-on learning using Microsoft HoloLens 2 and IoT hardware devices in demo site. The demo site using an MQTT protocol, simulates an automated packing line in the smart factory. The hardware status is published in real-time to the MQTT broker. This approach enables users to comprehend the interconnected relationship between data and hardware functionality and allowing them to create their own programs to control the IoT hardware in the demo site. With this training, 22 targeted users have successfully grasped the smart factory concept and its correlation with hardware functionality. The block-based visual programming employed in the system enables easy comprehension of robot commands. Moreover, the AR application provides a smooth display at 48-60 frames per second. The proposed system's usability and value for specific tasks received high scores, ranging from 4 to 5 points, confirming its effectiveness for the targeted users. The proposed AR-based training system has proved that it has benefit for human resource development in the robotics and automation sector following the Thailand 4.0 roadmap. The proposed system empowered users to understand the smart factory concept and its practical implementation, leading to create new ideas for integrating AR and smart factory concepts into their manufacturing in the future.