Taking a multidimensional approach toward journal evaluation

Abstract

This study takes a comprehensive approach toward the evaluation of scientific journals. The author argues that analyses measuring the impact of periodicals cannot be based on one single citation-based indicator, but that multiple methods should be used to capture the standing of a journal within the scientific community. Based on a set of 45 physics journals, multidimensional evaluation methods are described and applied. Different approaches are presented, which aim to highlight the journal in all its different roles within the whole process of scientific communication. Indicators and methods are grouped into five dimensions; namely journal output, journal content, journal perception, scientific communication and journal management. Furthermore, a lack of communication is addressed between bibliometric research, where new or newly named citation indicators emerge regularly, and applied journal evaluation, which is more or less limited to the Impact Factor. The need for standards involving multidimensional approaches is expressed.