DEVELOPMENT OF A DIGITAL TWIN-BASED SIMULATION SYSTEM AND A NOVEL SYNTHETIC VIDEO DATASET FOR ENHANCING COMPUTER VISION IN CONSTRUCTION SITE SAFETY

Abstract

In this work, we introduce a novel construction simulation system and the first photo-realistic synthetic video dataset for the construction industry, named ConSynth. The system simulates vehicle dynamics, worker behaviours, and various environmental conditions (Figure 1), generating a dataset of 200 video sequences and 24,000 images with automated labels. Our experiments have shown that models trained on ConSynth achieve robust detection with less reliance on real-world data, indicating enhanced diversity, improved performance in underrepresented scenarios, and substantial generalisability. Our work promises significant advancements in construction safety monitoring through computer vision.