Assessing socioeconomic effects on different sized populations: To weight or not to weight?

Abstract

Objective - Researchers in health care often use ecological data from population aggregates of different sizes. This paper deals with a fundamental methodological issue relating to the use of such data. This study investigates the question of whether, in doing analyses involving different areas, the estimating equations should be weighted by the populations of those areas. It is argued that the correct answer to that question turns on some deep epistemological issues that have been little considered in the public health literature. Design - To illustrate the issue, an example is presented that estimates entitlements to primary physician visits in Manitoba, Canada based on age/gender and socioeconomic status using both population weighted and unweighted regression analyses. Setting and subjects - The entire population of the province furnish the data. Primary care visits to physicians based on administrative data, demographics and a measure of socioeconomic status (SERI), based on census data, constitute the measures. Results - Significant differences between weighted and unweighted analyses are shown to emerge, with the weighted analyses biasing entitlements towards the more populous and advantaged population. Conclusions - The authors endorse the position that, in certain problems, data analyses involving population aggregates unweighted by population size are more appropriate and normatively justifiable than are analyses weighted by population. In particular, when the aggregated units make sense, theoretically, as units, it is more appropriate to carry out the analyses without weighting by the size of the units. Unweighted analyses yield more valid estimations.