That's not a Good Idea: A Robot Changes Your Behavior Against Social Engineering

Abstract

Dangers in modern human society are commonly attributed to the safety of online activities. In the domain of cybersecurity, Social Engineering (SE) relates to how attackers manipulate and coerce their targets into divulging sensitive information. One major problem in designing social engineering defenses is making users aware they are being targeted. In the context of fostering human empowerment and building an inclusive society, we explore the possibility of leveraging social robot companions to provide improved protection for individuals and companies against cybersecurity attacks, specifically focusing on the realm of social engineering (SE) tactics. We asked participants to play an immersive interactive storytelling game, challenging them with risky and social-engineering-related decisions and monitoring their explicit (i.e., decisions) and implicit (i.e., mouse trajectories and facial expressions) behavior. After each decision, the Furhat tabletop robot intervened, always suggesting the not-selected option. We compared two Compliance Gaining Behaviors (CGBs) the robot could use, either leveraging affection with the participants or logical thinking. Overall, Furhat's interventions increased the acceptance of risky and SE proposals. However, comparing the situations in which the robot tried to convince participants to avoid a social engineering request to those in which it tried to persuade them to accept it, the former was significantly more successful. Also, participants struggled with ignoring Furhat's advice, as shown by their more uncertain mouse trajectories and negative emotional valence. From the latter results, we trained a Decision Tree model, based on mouse trajectory features only, to predict if participants would change their minds with an accuracy of 64.9%. Such defense mechanisms could help better understand users' decision-making process in cybersecurity and social engineering, designing more helpful and supportive robot companions.