Digital twins in smart farming: An autoware-based simulator for autonomous agricultural vehicles

Abstract

Digital twins can improve the level of control over physical entities and help manage complex systems by integrating a range of technologies. The autonomous agricultural machine has shown revolutionary effects on labor reduction and utilization rate in field works. Autonomous vehicles in precision agriculture have the potential to improve competitiveness compared to current crop production methods and have become a research hotspot. However, the development time and resources required in experiments have limited the research in this area. Simulation tools in unmanned farming that are required to enable more efficient, reliable, and safe autonomy are increasingly demanding. Inspired by the recent development of an open-source virtual simulation platform, this study proposed an autoware-based simulator to evaluate the performance of agricultural machine guidance based on digital twins. Oblique photogrammetry using drones is used to construct three-dimensional maps of fields at the same scale as reality. A communication format suitable for agricultural machines was developed for data input and output, along with an inter-node communication methodology. The conversion, publishing, and maintenance of multiple coordinate systems were completed based on ROS (Robot Operating System). Coverage path planning was performed using hybrid curves based on Bézier curves, and it was tested in both a simulation environment and actual fields with the aid of Pure Pursuit algorithms and PID controllers.