Using the score method to construct asymmetric confidence intervals: An SAS program for content validation in scale development

Abstract

Expert review sessions are often conducted to determine the content validity of scale items. The accurate quantification of content validity is usually limited by a relatively small number of experts as well as by a small number of rating categories. These factors, combined with the bounded and discrete nature of rating scale categories, hinder use of traditional methods for computing standard errors and confidence intervals. Using an application of the score method, researchers can construct an asymmetric interval that is better suited for these situations. SAS code is provided to automate the computations, and a discussion of two methods for using the obtained results for content validation decision-making follows. Copyright 2005 Psychonomic Society, Inc.