Wide-Scale Clinical Implementation of Knowledge-Based Planning: An Investigation of Workforce Efficiency, Need for Post-automation Refinement, and Data-Driven Model Maintenance

Abstract

Purpose: Our purpose was to investigate the effect of automated knowledge-based planning (KBP) on real-world clinical workflow efficiency, assess whether manual refinement of KBP plans improves plan quality across multiple disease sites, and develop a data-driven method to periodically improve KBP automated planning routines. Methods and Materials: Using clinical knowledge-based automated planning routines for prostate, prostatic fossa, head and neck, and hypofractionated lung disease sites in a commercial KBP solution, workflow efficiency was compared in terms of planning time in a pre-KBP (n = 145 plans) and post-KBP (n = 503) patient cohort. Post-KBP, planning was initialized with KBP (KBP-only) and subsequently manually refined (KBP +human). Differences in planning time were tested for significance using a 2-tailed Mann-Whitney U test (P <1% prescription dose). In head and neck, KBP +human did achieve clinically relevant dose reductions in some parameters. The head and neck routine was updated (KBP’HN) to incorporate dose improvements from manual refinement. The only significant dosimetric differences to KBP +human after replanning with KBP’HN were in favor of the new routine. Conclusions: KBP increased clinical efficiency by significantly reducing planning time. On average, human refinement offered minimal dose improvements over KBP-only plans. In the single disease site where KBP +human was superior to KBP-only, differences were eliminated by adjusting optimization parameters in a revised KBP routine.