Evaluating Medical Students’ Perceptions of AI-Assisted Clinical Documentation (CarePilot): Cross-Sectional Study

Abstract

Background: Artificial intelligence (AI) is increasingly being integrated into health care to streamline documentation and improve clinician efficiency. AI-powered documentation tools, such as CarePilot, may reduce administrative burdens and help mitigate burnout. However, their usability and perceived value among medical trainees remain underexplored. Objective: This study aims to evaluate medical students’ perceptions of usability, efficiency, and satisfaction when using an AI-powered documentation system in a simulated clinical setting. Methods: This cross-sectional study was conducted at the Burnett School of Medicine at Texas Christian University. A total of 44 third-and fourth-year medical students participated in a standardized patient encounter for a headache. Using CarePilot, participants documented patient history, physical examination findings, clinical reasoning, and management decisions. Afterward, they completed a 27-item Likert scale survey assessing ease of use, documentation efficiency, organization, and overall satisfaction. Results: The majority of respondents rated ease of use, learnability, interface likability, and documentation organization positively (with over 75% of respondents reporting satisfaction for each item). However, a subset reported neutral or dissatis-fied opinions regarding overall satisfaction (13/44, 29.5%), citing workflow interruptions and limited functionality that could affect patient interaction. Conclusions: CarePilot was generally perceived as user-friendly and effective for organizing documentation. Nonetheless, areas for refinement, particularly workflow integration and expanded functionalities, may enhance satisfaction and clinical applicability. These findings inform future design and implementation strategies for AI-powered documentation tools in health care education and beyond.