Unstructured brainstorming is not enough: structured brainstorming based on four verification and validation questions yields better hazard identification in healthcare

Abstract

Objectives: (1) To introduce the Methodical Hazard Identification Checklist (MHIC) for structured brainstorming and the four V&V categories on which it is based, and (2) to compare its efficacy with that of brainstorming (BS) in identifying hazards in healthcare. Design: Comparative analysis of MHIC and team BS results. Setting: Baruch Padeh Medical Center, Poriya, Israel. Study participants: Quality engineering students, facilitators, validation teams and hospital staff who were familiar with the specific processes. Intervention(s): The number of hazards identified by team BS were compared with those deduced by applying the four V&V hazard categories to each step (the MHIC) of 10 medical and 12 administrative processes. Main Outcome Measure(s): The total number of hazards (1) identified by BS, (2) identified by MHIC, (3) validated by the validation team and (4) hazards identified by both methods that the validation team deemed unreasonable. Results: MHIC was significantly more successful than BS in identifying all hazards for the 22 processes (P < 0.0001). The estimated probabilities of success for BS for administrative and medical processes were 0.4444, 95%CI = [0.3506, 0.5424] and 0.3080, 95%CI = [0.2199, 0.4127], respectively. The estimated probabilities of success for MHIC for administrative and medical processes were 0.9885, 95%CI = [0.9638, 0.9964] and 0.9911, 95%CI = [0.9635, 0.9979], respectively. Conclusions: Compared to traditional BS, MHIC performs much better in identifying prospective hazards in the healthcare system. We applied MHIC methodology to administrative and medical processes and believe it can also be used in other industries that require hazard identification.