jeromedelisle.org

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com

  • Home
  • My Life in Pictures
  • The Research PageClick to open the The Research Page menu
    • List of Publications
  • EDEA 6202-Educational Improvement Project 2020Click to open the EDEA 6202-Educational Improvement Project 2020 menu
    • School Self Evaluation
    • Step by Step
  • EDRS 6910-Mixed Methods Research Designs: Issues and ApplicationsClick to open the EDRS 6910-Mixed Methods Research Designs: Issues and Applications menu
    • MMR-AN INTRODUCTION
    • Course Calendar
    • MMR-History & Controversies
    • Readings
    • Designs
    • Assignment
    • Paradigms/ Paradigmatic Frameworks
    • Integration in MMR
  • EDME 6121-Evaluation of Educational InstitutionsClick to open the EDME 6121-Evaluation of Educational Institutions menu
    • EDME 6121-Evaulation of Educational Institutions (Introduction)
    • EDME 6121-COURSE ASSESSMENT & EXAMINATIONS
    • EDME 6121-GENERAL TOPICS IN EVALUATION
    • EDME 6121-National Systems of Evaluation in Education
    • EDME 6121-International Benchmarking Page
    • EDME 6121-Programme Evaluation Page
    • EDME 6121-Logic Modelling
    • EDME 6121- Models & Designs
    • A Trinidad and Tobago Evaluation Association?
  • EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENTClick to open the EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENT menu
    • Course Content
    • Keep up-to-date
    • Theory Page
    • Key Readings
    • History Videos
    • Events
    • High Performing School Systems-Read & Watch
    • Evidenced-informed system and school improvement
    • The coherence framework
    • How School Systems Improve
    • Benchmarking for system improvement
    • Educational Improvement-Improving Learning Ecosystems
    • High Performing Systems-More Videos
    • Even More Videos-Snapshots of Improvement
    • Strong Performers and Successful Reformers in Education (OECD PISA)
    • Innovative school change
    • School Turnaround theory
    • Improving Teacher Preparation Systems
    • Assignment Page
  • EDME 6300-Measurement TheoryClick to open the EDME 6300-Measurement Theory menu
    • Course Schedule
    • Measurement Publications
    • People in Measurement
    • Validity Theory
    • Validity Theory Applied to the Caribbean
    • The Validity Debates
    • The Validation Process
    • Test Fairness
    • Item and test bias
    • Assignment Page
  • EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENTClick to open the EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENT menu
    • What is Action Research?
    • History & Thinkers
    • Books & References
    • The Reading Room
    • Nuts & Bolts
    • Whole School Interventions
    • SAMPLE STUDY
    • The Viewing Room
    • Brainstorming Strategies
    • Assignment Page
    • Assignment Rubric Page
    • Giving Presentations
    • Starting up a PLC
    • What Works Page-
    • Improvement & Implementation Science Tools
    • Research & Evidence in the Schools
    • The Class of 2016 Issues
  • EDME 6006-ASSESSMENT & EVALUATION-2016Click to open the EDME 6006-ASSESSMENT & EVALUATION-2016 menu
    • Updates-week by week
    • TOBAGO SCHEDULE
    • EDME 6006-ASSIGNMENTS
    • A Model for Classroom Assessment In Trinidad & Tobago
    • Assessment System-Purposes and Types
    • Issues in assessment
    • New videos on classroom assessment
    • More videos on classroom assessment
    • Experts on Formative Assessment
    • Resources & Support-Formative Assessment & Item Writing
    • Resources & Support-A call for extended performance assessments
    • Resources and Support-All about rubrics
    • Assessment in the New Primary School Curriculum
    • Item Analysis Support
    • Test Fairness & Validity
    • More on test validity
    • NEW PRACTICE QUESTIONS
    • Resources & Support-Measurement Topics
  • Friends and Family

Test FAIRNESS & Validity

Fairness and validity are fundamental qualities of educational assessment and occupational testing.

Fariness might be regarded as a broad concept, with broad philosophical and sociological implications outside the measurement concerns.

It has been formally defined in some measurement circles as equitable treatment of all test-takers during the testing process, absence of measurement bias, equitable access to the constructs being measured, and justifiable validity of test score interpretation for the intended purpose(s)

Fairness in testing is of increasing concern in the area of measurement.

Read Fairness in educational assessment

See ETS Quality and Fariness in Testing

 

APA Code of Fair Testing Practices in Education

CLEAR Principles of Fairness for Credentialing Boards

Please read

 Xi, X. (2010). How do we go about investigating test fairness? Language Testing, 27 (2), 147–170.

Artice is here-How do we go about investigating test fairness

About the Author- Xiamong XI-A conversation with-ETS


Validity - Meanings

Eva Baker's Take on Validity and its Evolving Meanings

See The Chimera of Validity

Baker, E. L. (2013). The chimera of validity. Teachers College Record, 115(9), 1-26.

Also Read-

Kane, M. T. (2001). Current concerns in validity theory. Journal of Educational Measurement, 38(4), 319-342.





Stephen Sireci-PowerPoint on Packing and Unpacking Sources of Validity

New Understandings

Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1-73.

 

Article is here-Validating the Interpretations and Uses of Test Scores by Michael Kane-ETS

 

Abstract

Validation requires two kinds of arguments, an interpretive argument and a validity argument. The interpretive argument specifies the proposed interpretation and use of test scores in terms of a sequence of inferences and assumptions leading from observed test performances to claims about attributes of the test taker, and typically, to decisions about the test taker. The validity argument validates the proposed interpretation and use by evaluating the plausibility of the inferences and assumptions in the interpretive argument. That is, in validating a proposed interpretation or use, we first lay out the claims being made, and then we evaluate these claims. An evaluation of a test use necessarily requires an evaluation of the consequences of the use. If the consequences are, on the whole, positive, the use is justified. If the consequences are judged to be more negative than positive, the use is unjustified. Evaluating the consequences of a decision rule tends to be difficult and potentially contentious, but if we want to evaluate test uses, it is necessary. Fairness plays a major role in the evaluation of both the interpretations and uses of test scores. In the context of interpretations, fairness can be defined in terms of the consistency of score meanings and implications (e.g., predictions of various criteria) across groups. For test uses, fairness can be defined in terms of the appropriateness of the decisions based on test scores, and therefore depends mainly on the consequences of these decisions.

_______________________

You should explore the treatment of validity and fariness in the two latest versions of the testing standards and handbook

NCME

APA

NCME Open Forum on the Revision - 2011 (includes video)

___________________

Application

Apply your enhanced understandings of fairness and validity to the  Secondary School Entrance Examinations--

See

De Lisle, J. (2012). Secondary school entrance examinations in the Caribbean: Legacy, policy, and evidence within an era of seamless education. Caribbean Curriculum, 19, 109-143.

 

Article is here

 

De Lisle, J., Smith, P., Keller, C., & Jules, V. (2012). Differential outcomes in high-stakes eleven plus testing: the role of gender, geography, and assessment design in Trinidad and Tobago. Assessment in Education: Principles, Policy & Practice, 19(1), 45-64.

UWI students have access to this. If not email me.

 

There are several new textbooks and seminars on validity

 

See ETS

  • The New Edition of the Standards
    Suzanne Lane discusses the new standards
  • Assessment in Higher Education
    The basics- reflective question- Are our assessments fit for purpose?

Copyright 2009 jeromedelisle.org. All rights reserved.

Web Hosting by Turbify

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com