Propensity score adjustment of a treatment effect with missing data in psychiatric health services research

Abstract

BACKGROUND: Missing values are a common problem for data analyses in observational studies, which are frequently applied in health services research. This paper examines the usefulness of different approaches in tackling the problem of incomplete observational data, focusing on whether the multiple imputation (MI) strategy yields adequate estimates when applied to a complex analysis framework. METHODS: Based on observational study data originally comparing three forms of psychotherapy, a simulation study with different missing data scenarios was conducted. The considered analysis model comprised a propensity score-adjusted treatment effect estimation. Missing values were evaluated using complete case analysis, different MI approaches, as well as mean and regression imputation. RESULTS: All point estimators of the applied methods fall within the 95% confidence interval of the treatment effect, derived from the complete simulation data set. Highest deviation was observed for complete case analysis. A distinct superiority of MI methods could not be demonstrated. CONCLUSIONS: Since there was no clear benefit of one method over another in dealing with missing values, health services researchers faced with incomplete observational data are well-advised to apply different imputation methods and compare the results in order to get an impression of their sensitivity.