Evaluation of scientific production without using bibliometric indicators: Decision-making on a priori criteria

Abstract

The present contribution contains the formalisation of a method (not based on bibliometric indicators) for assigning analytical scores to the scientific production of researchers who challenge in an open competitive exam in a Socioeconomic Scientific Sector. The preliminary decisions of the evaluation board are described subdividing them into six decision steps. The role of decision-making about a priori criteria is pointed out in relation to the respect of the researcher’s identity and of the spontaneous evolution of science. In this work, also an example of application is proposed to the evaluation board. Some algebraic implications are highlighted and it is suggested to reflect on the usefulness of the rules of Boole’s Algebra for the calculation of total scores deriving from the simultaneous application of criteria having different logical characteristics.