Switchable glass enabled contextualization for a cyber-physical safe and interactive spatial augmented reality PCBA manufacturing inspection system

6Citations
Citations of this article
59Readers
Mendeley users who have this article in their library.

Abstract

Augmented reality (AR) has been demonstrated to improve efficiency by up to thrice the level of traditional methods. Specifically, the adoption of visual AR is performed widely using handheld and head-mount technologies. Despite spatial augmented reality (SAR) addressing several shortcomings of wearable AR, its potential is yet to be fully explored. To date, it enhances the cooperation of users with its wide field of view and supports hands-free mobile operation, yet it has remained a challenge to provide references without relying on restrictive static empty surfaces of the same object or nearby objects for projection. Towards this end, we propose a novel approach that contextualizes projected references in real-time and on demand, onto and through the surface across a wireless network. To demonstrate the effectiveness of the approach, we apply the method to the safe inspection of printed circuit board assembly (PCBA) wirelessly networked to a remote automatic optical inspection (AOI) system. A defect detected and localized by the AOI system is wirelessly remitted to the proposed remote inspection system for prompt guidance to the inspector by augmenting a rectangular bracket and a reference image. The rectangular bracket transmitted through the switchable glass aids defect localization over the PCBA, whereas the image is projected over the opaque cells of the switchable glass to provide reference to a user. The developed system is evaluated in a user study for its robustness, precision and performance. Results indicate that the resulting contextualization from variability in occlusion levels not only positively affect inspection performance but also supersedes the state of the art in user preference. Furthermore, it supports a variety of complex visualization needs including varied sizes, contrast, online or offline tracking, with a simple robust integration requiring no additional calibration for registration.

References Powered by Scopus

Enhanced computer vision with Microsoft Kinect sensor: A review

1186Citations
N/AReaders
Get full text

Spatial augmented reality: Merging real and virtual worlds

701Citations
N/AReaders
Get full text

A systematic review of augmented reality applications in maintenance

579Citations
N/AReaders
Get full text

Cited by Powered by Scopus

Extended reality applications in industry 4.0. – A systematic literature review

86Citations
N/AReaders
Get full text

Design and management of assembly systems 4.0: systematic literature review and research agenda

74Citations
N/AReaders
Get full text

Defect detection of printed circuit board assembly based on YOLOv5

3Citations
N/AReaders
Get full text

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Cite

CITATION STYLE

APA

Runji, J. M., & Lin, C. Y. (2020). Switchable glass enabled contextualization for a cyber-physical safe and interactive spatial augmented reality PCBA manufacturing inspection system. Sensors (Switzerland), 20(15), 1–25. https://doi.org/10.3390/s20154286

Readers' Seniority

Tooltip

PhD / Post grad / Masters / Doc 13

68%

Professor / Associate Prof. 5

26%

Researcher 1

5%

Readers' Discipline

Tooltip

Engineering 8

53%

Computer Science 3

20%

Mathematics 2

13%

Business, Management and Accounting 2

13%

Article Metrics

Tooltip
Mentions
Blog Mentions: 1

Save time finding and organizing research with Mendeley

Sign up for free