The Latent Doctor Model for Modeling Inter-Observer Variability

0Citations
Citations of this article
14Readers
Mendeley users who have this article in their library.

Abstract

Many inherently ambiguous tasks in medical imaging suffer from inter-observer variability, resulting in a reference standard defined by a distribution of labels with high variance. Training only on a consensus or majority vote label, as is common in medical imaging, discards valuable information on uncertainty amongst a panel of experts. In this work, we propose to train on the full label distribution to predict the uncertainty within a panel of experts and the most likely ground-truth label. To do so, we propose a new stochastic classification framework based on the conditional variational auto-encoder, which we refer to as the Latent Doctor Model (LDM). In an extensive comparative analysis, we compare the LDM with a model trained on the majority vote label and other methods capable of learning a distribution of labels. We show that the LDM is able to reproduce the reference-standard distribution significantly better than the majority vote baseline. Compared to the other baseline methods, we demonstrate that the LDM performs best at modeling the label distribution and its corresponding uncertainty in two prostate tumor grading tasks. Furthermore, we show competitive performance of the LDM with the more computationally demanding deep ensembles on a tumor budding classification task.

Cite

CITATION STYLE

APA

Linmans, J., Hoogeboom, E., Van Der Laak, J., & Litjens, G. (2024). The Latent Doctor Model for Modeling Inter-Observer Variability. IEEE Journal of Biomedical and Health Informatics, 28(1), 343–354. https://doi.org/10.1109/JBHI.2023.3323582

Register to see more suggestions

Mendeley helps you to discover research relevant for your work.

Already have an account?

Save time finding and organizing research with Mendeley

Sign up for free