A Reflection on Tests of AI-Search Tools in the Academic Search Process at the Royal Library, Denmark: A Case Study

Abstract

Academic search literacy and searches powered by artificial intelligence are a focus of the Royal Library and affiliated university libraries in Denmark. The ambition is to integrate AI-search tools in teaching and services that support literature seeking and hence improve the efficiency of the academic search process. However, before doing so, the library managers needed to learn more about the value AI-powered search tools have for information specialists and library users, and hence make informed decisions regarding investment in such tools. This paper presents a case study of two AI-search tools, which were tested via Think-aloud tests, a hackathon and an expert quality assessment at the Royal Library, Denmark. The results point to both opportunities and barriers for the implementation of AI-search tools at the library and we explore the consequences the results of the tests can have for library users and library services. In conclusion, there is a need for more research on the value of AI-search tools for information specialists and library users. AI-search tools are continuously being developed and improved. The library needs to provide a critical approach to where in the search process the tools add value. Accordingly, the library needs to develop guidance on how to use AI-search tools as a supplement to more traditional approaches, how to report the use of the tools as part of an academic study and address the limitations of the tools.