Reducing bias in trials due to reactions to measurement: experts produced recommendations informed by evidence

Abstract

Objective: This study (MEasurement Reactions In Trials) aimed to produce recommendations on how best to minimize bias from measurement reactivity (MR) in randomized controlled trials of interventions to improve health. Study design and setting: The MERIT study consisted of: (1) an updated systematic review that examined whether measuring participants had effects on participants’ health-related behaviors, relative to no-measurement controls, and three rapid reviews to identify: (i) existing guidance on MR; (ii) existing systematic reviews of studies that have quantified the effects of measurement on behavioral or affective outcomes; and (iii) studies that have investigated the effects of objective measurements of behavior on health-related behavior; (2) a Delphi study to identify the scope of the recommendations; and (3) an expert workshop in October 2018 to discuss potential recommendations in groups. Results: Fourteen recommendations were produced by the expert group to: (1) identify whether bias is likely to be a problem for a trial; (2) decide whether to collect data about whether bias is likely to be a problem; (3) design trials to minimize the likelihood of this bias. Conclusion: These recommendations raise awareness of how and where taking measurements can produce bias in trials, and are thus helpful for trial design.