Examination of the responsiveness of the great recess framework—observational tool

Abstract

The purpose of this study was to test the responsiveness of the great recess framework-observational tool (GRF-OT) to detect changes in recess quality. GRF-OT data were collected at two time points (fall 2017 and spring 2018) in four geographically distinct regions of the United States. Following recommendations by Massey et al. (2018), a three-day average of recess observations was used for each data point. Data analysis was conducted on nine schools contracted to receive services from Playworks, a national non-profit organization specializing in recess implementation, for the first time; eight schools with returning Playworks services (i.e., multiple years of service) and five schools with no intervention services. Analysis of the change in GRF-OT scores from fall to spring revealed a large effect for first-year intervention schools (g = 1.19; 95% CI 0.13, 2.25) and multi-year intervention schools (g = 0.788; 95% CI −0.204, 1.78). GRF-OT scores decreased for schools not receiving an intervention (g = −0.562; 95% CI, −2.20, 1.07). New intervention schools (odds ratio= 21.59; 95% CI 4.27, 109.15) and multi-year intervention schools (odds ratio= 7.34; 95% CI 1.50, 35.97) were more likely to meet the threshold for meaningful positive change than non-intervention schools. The results of the current study suggest that GRF-OT is a responsive tool that researchers, practitioners, and policy makers can use to measure and assess changes in the quality of the recess environment.