Human-Robot Dialogue that Elicits The Alignment of Moral Principles For Driverless Vehicles

Abstract

The emergence of autonomous vehicles has raised ethical considerations regarding their controlling software. The focus is on defining ethical settings that determine the response to moral dilemmas, akin to the Trolley Problem. The study explores the interaction with a robot that engages users in a dialogue about such ethical dilemmas, allowing users to align vehicles' behaviour with their ethical preferences. Additionally, providers of these vehicles can have a codified version of user preferences to address potential real-world issues, for instance, by adjusting insurance premiums. The research details designing and implementing a human-robot interaction system for eliciting ethical settings in autonomous vehicles.