Educational Measurement for Applied Researchers

Abstract

About ConstructsFrameworks and Test Blueprints; Writing Items; Item Format; Number of Options for Multiple-Choice Items; How Many Items Should There Be in a Test?; Scoring Items; Awarding Partial Credit Scores; Weights of Items; Discussion Points; Exercises; References; Further Reading; 3 Test Design; Introduction; Measuring Individuals; Magnitude of Measurement Error for Individual Students; Scores in Standard Deviation Unit; What Accuracy Is Sufficient?; Summary About Measuring Individuals; Measuring Populations; Computation of Sampling Error; Summary About Measuring Populations Preface; Contents; 1 What Is Measurement?; Measurements in the Physical World; Measurements in the Psycho-social Science Context; Psychometrics; Formal Definitions of Psycho-social Measurement; Levels of Measurement; Nominal; Ordinal; Interval; Ratio; Increasing Levels of Measurement in the Meaningfulness of the Numbers; The Process of Constructing Psycho-social Measurements; Define the Construct; Distinguish Between a General Survey and a Measuring Instrument; Write, Administer, and Score Test Items; Produce Measures; Reliability and Validity; Reliability; Validity Graphical Representations of Reliability and ValiditySummary; Discussion Points; Car Survey; Taxi Survey; Exercises; References; Further Reading; 2 Construct, Framework and Test Development-From IRT Perspectives; Introduction; Linking Validity to Construct; Construct in the Context of Classical Test Theory (CTT) and Item Response Theory (IRT); Unidimensionality in Relation to a Construct; The Nature of a Construct-Psychological Trait or Arbitrarily Defined Construct?; Practical Considerations of Unidimensionality; Theoretical and Practical Considerations in Reporting Sub-scale Scores Placement of Items in a TestImplications of Fatigue Effect; Balanced Incomplete Block (BIB) Booklet Design; Arranging Markers; Summary; Discussion Points; Exercises; Appendix 1: Computation of Measurement Error; References; Further Reading; 4 Test Administration and Data Preparation; Introduction; Sampling and Test Administration; Sampling; Field Operations; Data Collection and Processing; Capture Raw Data; Prepare a Codebook; Data Processing Programs; Data Cleaning; Summary; Discussion Points; Exercises; School Questionnaire; References; Further Reading; 5 Classical Test Theory; Introduction Concepts of Measurement Error and ReliabilityFormal Definitions of Reliability and Measurement Error; Assumptions of Classical Test Theory; Definition of Parallel Tests; Definition of Reliability Coefficient; Computation of Reliability Coefficient; Standard Error of Measurement (SEM); Correction for Attenuation (Dis-attenuation) of Population Variance; Correction for Attenuation (Dis-attenuation) of Correlation; Other CTT Statistics; Item Difficulty Measures; Item Discrimination Measures; Item Discrimination for Partial Credit Items