How ‘networked’ are online collaborative concept-maps? Introducing metrics for quantifying and comparing the ‘networkedness’ of collaboratively constructed content

Abstract

With the growing role of online multi-participant collaborations in shaping the academic, professional, and civic spheres, incorporating collaborative online practices in educational settings has become imperative. As more educators include such practices in their curricula, they are faced with new challenges. Assessment of collaborations, especially in larger groups, is particularly challenging. Assessing the quality of the collaborative “thought process” and its product is essential for both pedagogical and evaluative purposes. While traditional quantitative quality measures were designed for individual work or the aggregated work of individuals, capturing the complexity and the integrative nature of high-quality collaborative learning requires novel methodologies. Network analysis provides methods and tools that can identify, describe, and quantify non-linear and complex phenomena. This paper applies network analysis to the content created by students through large-scale online collaborative concept-mapping and explores how these can be applied for the assessment of the quality of a collective product. Quantitative network structure measures are introduced for this purpose. The application and the affordances of these metrics are demonstrated on data from six large-group online collaborative discussions from academic settings. The metrics presented here address the organization and the integration of the content and enable a comparison of collaborative discussions.