Robot online learning through digital twin experiments: A weightlifting project

Abstract

This paper proposes and explores an approach in which robotics projects of novice engineering students focus on development of learning robots. We implemented a reinforcement learning scenario in which a humanoid robot learns to lift a weight of unknown mass through autonomous trial-and-error search. To expedite the process, trials of the physical robot are substituted by simulations with its virtual twin. The optimal parameters of the robot posture for executing the weightlifting task, found by analysis of the virtual trials, are transmitted to the robot through internet communication. The approach exposes students to the concepts and technologies of machine learning, parametric design, digital prototyping and simulation, connectivity and internet of things. Pilot implementation of the approach indicates its potential for teaching freshman and HS students, and for teacher education.