Improving the results of citizen science projects through reputation systems: The case of wolf's number experiment

Abstract

Collective intelligence projects based on citizen participation are gaining momentum in today's society. Citizen science applies crowdsourcing techniques to produce reliable data, quickly and easily. These projects allow getting new knowledge and help professional scientists to come to real conclusions. This paper proposes that the use of reputation systems improves the results obtained in citizen science projects. To prove this hypothesis, a reputation system is applied to a real experiment and the results are analyzed. The goal of the experiment is to calculate the real-time solar activity, known as theWolf number, using the infrastructure and user community of the GLORIA project (a set of professional robotic telescopes running since 2013). The sample size of the study are 196 end-users and 2,108 executions of the experiment. The key findings presented in the paper are: 1) the online experiment with volunteers correctly reproduces the traditional method of the year 1848 performed by astronomers or advanced amateurs, 2) the model is contrasted and validated with the values published by the official organization, and 3) the reputation system reduces the error in calculations by more than half, discarding the contributions of the users with lowest karma.