User engagement and attrition in an app-based physical activity intervention: Secondary analysis of a randomized controlled trial

Abstract

Background: The success of a mobile phone app in changing health behavior is thought to be contingent on engagement, commonly operationalized as frequency of use. Objective: This subgroup analysis of the 2 intervention arms from a 3-group randomized controlled trial aimed to examine user engagement with a 100-day physical activity intervention delivered via an app. Rates of engagement, associations between user characteristics and engagement, and whether engagement was related to intervention efficacy were examined. Methods: Engagement was captured in a real-time log of interactions by users randomized to either a gamified (n=141) or nongamified version of the same app (n=160). Physical activity was assessed via accelerometry and self-report at baseline and 3-month follow-up. Survival analysis was used to assess time to nonuse attrition. Mixed models examined associations between user characteristics and engagement (total app use). Characteristics of super users (top quartile of users) and regular users (lowest 3 quartiles) were compared using t tests and a chi-square analysis. Linear mixed models were used to assess whether being a super user was related to change in physical activity over time. Results: Engagement was high. Attrition (30 days of nonuse) occurred in 32% and 39% of the gamified and basic groups, respectively, with no significant between-group differences in time to attrition (P=.17). Users with a body mass index (BMI) in the healthy range had higher total app use (mean 230.5, 95% CI 190.6-270.5; F2=8.67; P