Tolerance and relative utility: Two proposed indices for comparing change in clinical measurement noise between different populations (repeatability) or measurement methods (agreement)

Abstract

Reaching a consensus in terms of interchangeability and utility (i.e., disease detection/ monitoring) of a medical device is the eventual aim of repeatability and agreement studies. The aim of the tolerance and relative utility indices described in this report is to provide a methodology to compare change in clinical measurement noise between different populations (repeatability) or measurement methods (agreement), so as to highlight problematic areas. No longitudinal data are required to calculate these indices. Both indices establish a metric of least to most effected across all parameters to facilitate comparison. If validated, these indices may prove useful tools when combining reports and forming the consensus required in the validation process for software updates and new medical devices.