Human-AI interaction and ethics of AI: how well are we following the guidelines

Abstract

Despite the benefits of AI-enabled solutions in different industrial sectors, their technology acceptance remains challenging. The acceptance of AI technologies depends on both the Human-AI (HAI) interaction and the ethics of AI. HAI interaction significantly affects the acceptance of AI-enabled solutions. Many guidelines have been developed to support HAI interaction design, including Microsoft's Guidelines for HAI interaction. On the other hand, many ethics by design guidelines were developed, such as the Ethics Guidelines for Trustworthy AI (EGTAI) developed by European Commission. However, there is less discussion about the possible relations between these two sets of guidelines for developing AI-enabled solutions. This study aims to analyze how current AI-enabled solutions comply with these two guidelines using a case study approach. To realize this aim, we conducted a co-evaluation workshop investigating how two existing AI-enabled apps, Strava and CoronaMelder, comply with these two guidelines. In this workshop, four participants with prior knowledge of designing with AI were asked to analyze the two cases by identifying whether these guidelines were met. The workshop results implied that when HAI interactions are designed according to the HAI interaction guidelines, they do not necessarily align with the EGTAI guidelines and vice versa.