Artificial Intelligence’s Performance on the Japanese National Dental Examination

Abstract

BACKGROUND/PURPOSE: Artificial intelligence (AI) has developed rapidly and is applied to many fields including dental education. In this study, we evaluated AI performance on the Japanese National Dental Examination.MATERIALS AND METHODS: We extracted 349 of 400 compulsory questions from the National Dental Examinations over the past five years. Questions were presented to ChatGPT 3.5, ChatGPT 4o mini, and Gemini, and their performance was evaluated across 13 topic categories.RESULTS: ChatGPT 4o mini achieved the passing criteria for exams for two years and had the highest total score of the three AIs. The scores of ChatGPT 4o mini on "Society and dentistry" and "Cardinal signs" were significantly higher than those of ChatGPT 3.5 (P<0.05).CONCLUSIONS: The high performance of ChatGPT 4o mini indicates the potential value of the tool in dental education. Further improving its performance may lead to future clinical applications in dentistry.