Evaluating Privacy Policy Summarization: An Experimental Study among Japanese Users

Abstract

Summarization and visualization applications can help users understand the content of privacy policies. However, research has focused on English language privacy policies and has not considered users who are not native English speakers nor the potential situation of encountering. privacy policy in. foreign language. In this paper, we contribute to the research on privacy policy summarization by conducting an experimental survey on Japanese users to assess their interest on using such an application, and the influence of this application on their perception. We conducted an experimental survey among Japanese participants, and evaluated their perception on different privacy policy languages (Japanese or English) and risk levels, using PrivacyGuide. We found that PrivacyGuide can increase interest in the contents of the privacy policy for both languages, and can communicate risk level for the English privacy policy. In addition, we found that respondents who indicated interest in using the application mentioned. wide variety of scenarios for its use, while respondents who answered negatively or were hesitant mentioned lack of trust and uncertainty about PrivacyGuide's reputation and accuracy. We discuss these results and offer suggestions for improving adoption of privacy policy summarization tools like PrivacyGuide.