UBS: A dimension-agnostic metric for concept vector interpretability applied to radiomics

Abstract

Understanding predictions in Deep Learning (DL) models is crucial for domain experts without any DL expertise in order to justify resultant decision-making process. As of today, medical models are often based on hand-crafted features such as radiomics, though their link with neural network features remains unclear. To address the lack of interpretability, approaches based on human-understandable concepts such as TCAV have been introduced. These methods have shown promising results, though they are unsuited for continuous value concepts and their introduced metrics do not adapt well to high-dimensional spaces. To bridge the gap with radiomics-based models, we implement a regression concept vector showing the impact of radiomic features on the predictions of deep networks. In addition, we introduce a new metric with improved scaling to high-dimensional spaces, allowing comparison across multiple layers.