Constructing Measures introduces a way to understand the advantages and disadvantages of measurement instruments, how to use such instruments, and how to apply the methods introduced in the book to develop new instruments and/or adapt old ones. The author believes that the best way to learn is by doing. It is therefore recommended that the reader review the book while in the process of actually constructing an instrument. The book is organized around the steps taken while constructing an instrument. It opens with a summary of the constructive steps involved. Each step is then expanded on in the next 4 chapters. These chapters develop the "building blocks" that make up an instrument - the construct map, the design plan for the items, the outcome space, and the statistical measurement model. The next 3 chapters focus on quality control. They relay heavily on the calibrated construct map and review how to check if scores are operating consistently and how to evaluate the reliability and validity evidence. The book introduces a variety of item formats including multiple-choice, open-ended, and performance items, projects, portfolios, Likert and Guttman items, behavioral observations, and interview protocols. Each chapter includes several features to help the reader: a chapter overview provides the key concepts; related resources provide details for further investigating certain topics; and exercises and activities provide an opportunity to apply the chapter's concepts. Some chapters feature appendices that describe parts of the instrument development process in more detail, numerical manipulations used in the text, and/or data results of computer analyses. A variety of examples from the behavioral and social sciences and education including achievement and performance testing, attitude measures, health measures such as quality of life, and general sociological scales demonstrate the application of the material. An accompanying CD features: "GradeMap" with control files, output, and a data set to allow readers to compute all of the text's exercises and examples and crete and explore new analyses. Case archives based on the book's examples so the reader can work through the entire development of an instrument and gain a greater understanding of the ways the approach varies depending on the circumstances. Constructing Measures is intended to serve as an advanced text or supplement in courses on item, test, or instrument development, measurement, item response theory, or rasch analysis taught in a variety of departments including education and psychology. The book will also appeal to those who develop instruments including industrial/organizational, educational, and school psychologists, health outcomes researchers, program evaluators, and sociological measurers. Knowledge of basic descriptive statistics and elementary regression is recommended.
1 Construct modeling : the "four building blocks" approach 3
2 Construct maps 25
3 The items design 41
4 The outcome space 62
5 The measurement model 85
6 Choosing and evaluating a measurement model 115
7 Reliability 139
8 Validity 157
9 Next steps in measuring