Towards the Use of AI-Based Tools for Systematic Literature Review

Abstract

The constant growth in the number of published research studies and their rapid rate of publication creates a significant challenge in identifying relevant studies for unbiased systematic reviews. To address this challenge, artificial intelligence (AI) methods have been used since 2016 to improve the efficiency of scientific review and synthesis. Nevertheless, the growth in the number of AI-powered tools dedicated to processing text-based data has been remarkable since the introduction of generative pre-trained transformers by OpenAI in late 2022. Moreover, alongside this development, ChatGPT, a language model that provides a user-friendly chatbot interface, was introduced. The incorporation of this interactive feature has greatly enhanced the capability of developers and end-users alike to effectively utilize and access ChatGPT. This study aims to investigate the effectiveness of six AI-based tools namely Chatpdf, Pdf2gpt, Hipdf, SciSpace, Easy-peasy AI, and DocAnalyzer AI, developed utilizing ChatGPT technology. These tools will be evaluated in a specific scenario where they are automated to carry out a particular step within a Systematic Literature Review. Furthermore, the limitations associated with each tool will be analyzed, and strategies will be proposed to overcome them. Additionally, this study aims to provide recommendations for researchers who intend to incorporate these tools into their research processes.