jeromedelisle.org

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com

  • Home
  • My Life in Pictures
  • The Research PageClick to open the The Research Page menu
    • List of Publications
  • EDEA 6202-Educational Improvement Project 2020Click to open the EDEA 6202-Educational Improvement Project 2020 menu
    • School Self Evaluation
    • Step by Step
  • EDRS 6910-Mixed Methods Research Designs: Issues and ApplicationsClick to open the EDRS 6910-Mixed Methods Research Designs: Issues and Applications menu
    • MMR-AN INTRODUCTION
    • Course Calendar
    • MMR-History & Controversies
    • Readings
    • Designs
    • Assignment
    • Paradigms/ Paradigmatic Frameworks
    • Integration in MMR
  • EDME 6121-Evaluation of Educational InstitutionsClick to open the EDME 6121-Evaluation of Educational Institutions menu
    • EDME 6121-Evaulation of Educational Institutions (Introduction)
    • EDME 6121-COURSE ASSESSMENT & EXAMINATIONS
    • EDME 6121-GENERAL TOPICS IN EVALUATION
    • EDME 6121-National Systems of Evaluation in Education
    • EDME 6121-International Benchmarking Page
    • EDME 6121-Programme Evaluation Page
    • EDME 6121-Logic Modelling
    • EDME 6121- Models & Designs
    • A Trinidad and Tobago Evaluation Association?
  • EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENTClick to open the EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENT menu
    • Course Content
    • Keep up-to-date
    • Theory Page
    • Key Readings
    • History Videos
    • Events
    • High Performing School Systems-Read & Watch
    • Evidenced-informed system and school improvement
    • The coherence framework
    • How School Systems Improve
    • Benchmarking for system improvement
    • Educational Improvement-Improving Learning Ecosystems
    • High Performing Systems-More Videos
    • Even More Videos-Snapshots of Improvement
    • Strong Performers and Successful Reformers in Education (OECD PISA)
    • Innovative school change
    • School Turnaround theory
    • Improving Teacher Preparation Systems
    • Assignment Page
  • EDME 6300-Measurement TheoryClick to open the EDME 6300-Measurement Theory menu
    • Course Schedule
    • Measurement Publications
    • People in Measurement
    • Validity Theory
    • Validity Theory Applied to the Caribbean
    • The Validity Debates
    • The Validation Process
    • Test Fairness
    • Item and test bias
    • Assignment Page
  • EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENTClick to open the EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENT menu
    • What is Action Research?
    • History & Thinkers
    • Books & References
    • The Reading Room
    • Nuts & Bolts
    • Whole School Interventions
    • SAMPLE STUDY
    • The Viewing Room
    • Brainstorming Strategies
    • Assignment Page
    • Assignment Rubric Page
    • Giving Presentations
    • Starting up a PLC
    • What Works Page-
    • Improvement & Implementation Science Tools
    • Research & Evidence in the Schools
    • The Class of 2016 Issues
  • EDME 6006-ASSESSMENT & EVALUATION-2016Click to open the EDME 6006-ASSESSMENT & EVALUATION-2016 menu
    • Updates-week by week
    • TOBAGO SCHEDULE
    • EDME 6006-ASSIGNMENTS
    • A Model for Classroom Assessment In Trinidad & Tobago
    • Assessment System-Purposes and Types
    • Issues in assessment
    • New videos on classroom assessment
    • More videos on classroom assessment
    • Experts on Formative Assessment
    • Resources & Support-Formative Assessment & Item Writing
    • Resources & Support-A call for extended performance assessments
    • Resources and Support-All about rubrics
    • Assessment in the New Primary School Curriculum
    • Item Analysis Support
    • Test Fairness & Validity
    • More on test validity
    • NEW PRACTICE QUESTIONS
    • Resources & Support-Measurement Topics
  • Friends and Family

The Validity Debates

In the Caribbean, have we really moved past early understandings of validity?

 

Can we question the value of the unitary conceptualization of validity?

 


Borsboom, D. (2006). The attack of the psychometricians. Psychometrika, 71(3), 425.



Construct validity functions as a black hole from which nothing can escape: Once a question gets labeled as a problem of construct validity, its difficulty is considered superhuman and its solution beyond a mortal’s ken. Validity theorists have themselves contributed to this situation by stating that validation research is a “never-ending process”; (e.g., Messick, 1988), which, at most, returns a “degree of validity”; (Cronbach & Meehl, 1955; Messick, 1989), but can by its very nature never yield a definitive answer to the question whether a test measures a certain attribute or not. This effectively amounts to a mystification of the problem, and discourages researchers to address it. In addition, this stance must be fundamentally ill-conceived for the simple reason that no physicists are currently involved in the “never-ending process”; of figuring out whether meter sticks really measure length, or are trying to estimate their “degree of validity”;; nevertheless, meter sticks are doing fine. So why should “construct validity”; be such an enormous problem in psychology?

The general idea seems to be based on the conviction (taken from the philosophy of science, and especially the work of Popper, 1959) that all scientific theories are by their nature “conjectures that have not yet been refuted”;; i.e., tentative and provisionally accepted working hypotheses. Whether one subscribes to this idea or not, it is evident that it cannot be specifically relevant for the problem of validity, because this view concerns not just validity, but every scientific hypothesis, and, by implication, applies to every psychometric hypothesis. Thus, if validity is problematic for this particular reason, then so are reliability, unidimensionality, internal consistency, continuity, measurement invariance, and all other properties of tests, test scores, and theoretical attributes, as well as all the relations between these properties that one could possibly imagine. But this is thoroughly uninformative; it merely teaches us that scientific research is difficult, and that we hardly ever know anything for sure. While this may be an important fact of life, it has no special bearing on the problem of test validity and most certainly cannot be used to justify the aura of intractability that surrounds the problem of “construct validity.”




Can we develop argument-based validation for high stakes public examinations?

(see Kane, M. (2004). Certification testing as an illustration of argument-based validation. Measurement, 2(3), 135-170.)

 

 



Copyright 2009 jeromedelisle.org. All rights reserved.

Web Hosting by Yahoo!

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com