Learning to evaluate sources of science (mis)information on the internet: Assessing students' scientific online reasoning

Abstract

Students frequently turn to the internet for information about a range of scientific issues. However, they can find it challenging to evaluate the credibility of the information they find, which may increase their susceptibility to mis- and disinformation. This exploratory study reports findings from an instructional intervention designed to teach high school students to engage in scientific online reasoning (SOR), a set of competencies for evaluating sources of scientific information on the internet. Forty-three ninth grade students participated in eleven instructional activities. They completed pre and post constructed response tasks designed to assess three constructs: evaluating conflicts of interest, relevant scientific expertise, and alignment with scientific consensus. A subset of students (n = 6) also completed pre and post think-aloud tasks where they evaluated websites of varying credibility. Students' written responses and screen-capture recordings were scored, coded, and analyzed using a mixed-methods approach. Findings from the study demonstrate that after the intervention: (1) students' assessment scores improved significantly on all three tasks, (2) students improved in their ability to distinguish between sources of online scientific information of varying credibility, and (3) more students used online reasoning strategies and outside sources of information. Areas for student growth are also identified, such as improving coordinated use of credibility criteria with online reasoning strategies. These results suggest that teaching criteria for the credibility of scientific information, along with online reasoning strategies, has the potential to help students evaluate scientific information encountered on the internet.