Reusing decisions made with one decision support system to assess a second decision support system: Introducing the notion of complex cases

Abstract

The guideline-based decision support system (GL-DSS) of the DESIREE project and OncoDoc are two clinical decision support systems applied to the management of breast cancer. In order to evaluate the DESIREE GL-DSS, we decided to reuse a sample of clinical cases previously resolved by the multidisciplinary tumor board (MTB) of the Tenon Hospital (Paris, France) when using OncoDoc. Since we had two different knowledge representation models to represent clinical parameters and decisions, and two formalisms to represent guidelines, we developed a transformation sequence, involving the creation of synthetic patients, the enrichment of DESIREE ontology, and the translation of clinical cases and their decisions, to transform OncoDoc data into the DESIREE representation. Considering MTB decisions as the gold standard, the 84% compliance rate of DESIREE recommendations was rather satisfactory. Some situations (0.7%) concerned clinical cases that were compliant neither with OncoDoc nor with DESIREE that we defined as complex cases, not handled by guidelines, which necessitate effective MTB discussions. © 2021 European Federation for Medical Informatics (EFMI) and IOS Press.