The development of contextual chat interactions with retrieval-augmented generation system for facilitating learning hadith

Abstract

This study explores the development and implementation of a retrieval-augmented generation (RAG) system using the large language model (LLM) to enhance the learning of hadith through a chat interface for high school students. This study addresses challenges in optimizing RAG configurations and problems associated with traditional educational methods that lack interactivity. In addition, the RAG system was designed to replace real teacher interactions, offering a chat feature that provides contextual answers to real-life scenarios related to Hadith. Various configurations were tested, with a focus on the Matn component, achieving a high accuracy score with a mean of .754 and demonstrating efficiency in context relevance with a mean of .797. Results indicated significant accessibility using our RAG system for learning hadith via WhatsApp’s chat interface. Hence, this study highlights the potential of RAG systems in transforming educational environments and offers insights into the development of technology for interactive Hadith learning solutions.