Providing Direct Answers in Search Results: A Study of User Behavior

Abstract

To study the impact of providing direct answers in search results on user behavior, we conducted a controlled user study to analyze factors including reading time, eye-tracked attention, and the influence of the quality of answer module content. We also studied a more advanced answer interface, where multiple answers are shown on the search engine results page (SERP). Our results show that users focus more extensively than normal on the top items in the result list when answers are provided. The existence of the answer module helps to improve user engagement on SERPs, reduces user effort, and promotes user satisfaction during the search process. Furthermore, we investigate how the question type - factoid or non-factoid - affects user interaction patterns. This work provides insight into the design of SERPs that includes direct answers to queries, including when answers should be shown.