Development of a novel hospitalist advanced practice provider assessment instrument: A pilot study

Abstract

Advanced practice providers (APPs) graduate from school with variable hospitalist experience. While hospitalist-specific onboarding is recommended for hospitalist APPs, no standard method currently exists to assess their readiness for practice. We created a 17-item instrument called the Cardin Hospitalist Advanced Practice Provider-Readiness Assessment (CHAPP-RA) to assess APPs'; readiness for practice using a milestones-based scale. We piloted CHAPP-RA at a single site where 11 APPs with varied experience were rated by 30 supervising physicians. Supervisors also provided global ratings for overall performance. We investigated the feasibility of CHAPP-RA and collected validity evidence for the interpretation of scores. The mean time to complete one CHAPP-RA was 10.5 min. Supervisors rated novice APPs lower than more experienced APPs, p ≤.001. CHAPP-RA ratings also correlated strongly with global ratings. CHAPP-RA is feasible to implement and has initial validity evidence.