Formative Evaluation of an Automated Knowledge Elicitation and Organization Tool

Abstract

This chapter serves three purposes. First, we briefly review knowledge representations to stress the implications of different knowledge types on instruction and assessment. Second, we describe a novel cognitive tool, DNA (Decompose, Network, Assess), designed to aid knowledge elicitation and organization for instruction – specifically geared to increase the efficiency of creating the domain model used within intelligent instructional systems. Third, we present an exploratory test of the tool's efficacy. Three statistical experts used DNA to explicate their knowledge related to measures of central tendency in statistics. DNA was able to effectively elicit relevant information, commensurate with a benchmark system, generating a starting curriculum upon which to build instruction, and did so in hours compared to months for conventional elicitation procedures.