Audience response systems and missingness trends: Using interactive polling systems to gather sensitive health information from youth

Abstract

Background: The widespread availability and cost-effectiveness of new-wave software-based audience response systems (ARSs) have expanded the possibilities of collecting health data from hard-to-reach populations, including youth. However, with all survey methods, biases in the data may exist because of participant nonresponse. Objective: The aims of this study were to (1) examine the extent to which an ARS could be used to gather health information from youths within a large-group school setting and (2) examine individual- A nd survey-level response biases stemming from this Web-based data collection method. Methods: We used an ARS to deliver a mental health survey to 3418 youths in 4 high schools in the Midwestern United States. The survey contained demographic questions, depression, anxiety, and suicidality screeners, and questions about their use of offline resources (eg, parents, peers, and counselors) and Web-based resources (ie, telemental health technologies) when they faced stressful life situations. We then examined the response rates for each survey item, focusing on the individual- A nd survey-level characteristics that related to nonresponse. Results: Overall, 25.39% (868/3418) of youths answered all 38 survey questions; however, missingness analyses showed that there were some survey structure factors that led to higher rates of nonresponse (eg, questions at the end of survey, sensitive questions, and questions for which precise answers were difficult to provide). There were also some personal characteristics that were associated with nonresponse (eg, not identifying as either male or female, nonwhite ethnicity, and higher levels of depression). Specifically, a multivariate model showed that male students and students who reported their gender as other had significantly higher numbers of missed items compared with female students (B=.30 and B=.47, respectively, P