Ensuring Validity in International Comparisons Using State-of-the-Art Psychometric Methodologies

Matthias Von Davier, Eugenio Gonzalez, Wolfram Schulz

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

<div class="line" id="line-37"> Researchers using quantitative methods for describing data from observational or experimental studies often rely on mathematical models referred to as latent variable models. The goal is to provide quantities that allow generalization to future observations in the same subject domain. A review of selected current and historical examples illustrates the breadth and utility of the approach, ranging from a worldwide used system for ranking chess players, to &filig;nding hidden structure in genetic data, to identifying common factors that can explain patterns of volatility of assets examined in &filig;nancial modeling. This chapter describes how latent variable models are used in educational measurement and psychometrics, and in the studies of the International Association for the Evaluation of Educational Achievement (IEA) in particular. Within this domain, these models are used to construct a validity argument by modelling individual and system level differences as these relate to performance on large-scale international comparative surveys of skills, such as those commissioned by IEA.</div>
Original languageEnglish
Title of host publicationReliability and Validity of International Large-Scale Assessment: Understanding IEA’s Comparative Studies of Student Achievement
DOIs
Publication statusPublished - 4 Sept 2020

Keywords

  • Ability identification
  • Estimation (Mathematics)
  • Item response theory
  • Measurement
  • Psychometrics
  • Rasch model
  • Regression (Statistics)
  • Validity
  • Variables

Disciplines

  • Educational Assessment, Evaluation, and Research
  • International and Comparative Education

Cite this