A Quantitative Content Analysis of Survey Research Methods Over a 40-Year Time Period in the Journal of Agricultural Education

Abstract

To provide a benchmark of survey methods used in agricultural education research, a content analysis of Journal of Agricultural Education (JAE) research articles was conducted to determine populations studied, survey contact and response mode use, the use of incentives, and response and participation rates reported. Findings revealed survey research is still the most commonly used research methodology for articles published in the JAE. School-based agricultural education (SBAE) teachers are the population most frequently surveyed with contact and response modes shifting from mailed paper surveys to online surveys. Incentives were rarely used in the sampled articles. Response and participation rates have declined 20 – 30% from 1979 to 2019, increasing the possibility for nonresponse error. Recommendations for practice include providing more specific information in manuscripts related to tailoring survey methods for a particular population and reporting participation and response rates more accurately. Further research was recommended for determining which survey modes are most successful for populations commonly studied in agricultural education research, conducting a cost analysis of using incentives, and exploring new technologies to reach populations via research.