Constructing Instruments to Achieve Measurement

Abstract

During the item developmentItem developmentstage, a poolItem poolof items are produced by experienced item writers according to the instrument specificationsInstrument specifications, which may include the number of the items to measure each aspect or content area and the format of each item. After items have been developed they are typically refined through a number of item trialsItem trial. Instruments typically consist of item formatsItem formatthat require respondents to generate a response (constructed responseConstructed responseitem) and/or those that require respondents to choose a response from among alternatives (selected responseSelected responseitem). Three basic types of selected responseSelected responseitems are typically used in tests of proficiency: alternate choice, multiple-choice and matching items. Multiple-choice items consist of the correct response and a number of distractorsItem distractor. The item keyItem keyis the correct response option for a multiple-choice item. Questionnaires often include selected responseSelected responseitems with ordered response options. In orderOrderto achieve measurementMeasurement, the number, orderOrderand wording of response categories need to be carefully considered. Raters or judges often rate persons according to one or multiple rating criteriaRating criteriaon some performance.