An Application of SEMAR IoT Application Server Platform to Drone-Based Wall Inspection System Using AI Model

Abstract

Recently, artificial intelligence (AI) has been adopted in a number of Internet of Things (IoT) application systems to enhance intelligence. We have developed a ready-made server with rich built-in functions to collect, process, display, analyze, and store data from various IoT devices, the SEMAR (Smart Environmental Monitoring and Analytics in Real-Time) IoT application server platform, in which various AI techniques have been implemented to enhance its capabilities. In this paper, we present an application of SEMAR to a drone-based wall inspection system using an object detection AI model called You Only Look Once (YOLO). This system aims to detect wall cracks at high places using images taken via a camera on a flying drone. An edge computing device is installed to control the drone, sending the taken images through the Kafka system, storing them with the drone flight data, and sending the data to SEMAR. The images are analyzed via YOLO through SEMAR. For evaluations, we implemented the system using Ryze Tello for the drone and Raspberry Pi for the edge, and we evaluated the detection accuracy. The preliminary experiment results confirmed the effectiveness of the proposal.