Design and Implementation of a Marker-Based AR-Enabled Tool Tracking System for Manufacturing Manual Operation

Abstract

Manual operations exhibit variability and are subject to human errors, which can lead to unexpected delays or quality issues. In addition, traceability of manual processes typically relies on operators’ interactions with HMIs, which can also be inconsistent. Research suggests that augmented reality (AR) can be used to enhance the effectiveness of manual operations by enhancing operator guidance. The research presented in this paper adopts a holistic approach combining manual operation monitoring and operator feedback capabilities. The DAMPO (Digitally Augmented Manual Process Optimisation) developed at the University of Warwick, UK, is used to support both low TRL level research and direct engagement with industry on the development of human-centric manufacturing solutions. The DAMPO system implements both process monitoring capabilities and advanced operator guidance interfaces in view of enabling process traceability and no-fault forward capabilities. Manual assembly of safety-critical systems of seating components for the automotive industry is the use case application for this study. This production-ready solution is tested and evaluated on a replicable production cell using real product and real manual assembly sequences.