jeromedelisle.org

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com

  • Home
  • My Life in Pictures
  • The Research PageClick to open the The Research Page menu
    • List of Publications
  • EDEA 6202-Educational Improvement Project 2020Click to open the EDEA 6202-Educational Improvement Project 2020 menu
    • School Self Evaluation
    • Step by Step
  • EDRS 6910-Mixed Methods Research Designs: Issues and ApplicationsClick to open the EDRS 6910-Mixed Methods Research Designs: Issues and Applications menu
    • MMR-AN INTRODUCTION
    • Course Calendar
    • MMR-History & Controversies
    • Readings
    • Designs
    • Assignment
    • Paradigms/ Paradigmatic Frameworks
    • Integration in MMR
  • EDME 6121-Evaluation of Educational InstitutionsClick to open the EDME 6121-Evaluation of Educational Institutions menu
    • EDME 6121-Evaulation of Educational Institutions (Introduction)
    • EDME 6121-COURSE ASSESSMENT & EXAMINATIONS
    • EDME 6121-GENERAL TOPICS IN EVALUATION
    • EDME 6121-National Systems of Evaluation in Education
    • EDME 6121-International Benchmarking Page
    • EDME 6121-Programme Evaluation Page
    • EDME 6121-Logic Modelling
    • EDME 6121- Models & Designs
    • A Trinidad and Tobago Evaluation Association?
  • EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENTClick to open the EDEA 6201-SCHOOL AND SYSTEM IMPROVEMENT menu
    • Course Content
    • Keep up-to-date
    • Theory Page
    • Key Readings
    • History Videos
    • Events
    • High Performing School Systems-Read & Watch
    • Evidenced-informed system and school improvement
    • The coherence framework
    • How School Systems Improve
    • Benchmarking for system improvement
    • Educational Improvement-Improving Learning Ecosystems
    • High Performing Systems-More Videos
    • Even More Videos-Snapshots of Improvement
    • Strong Performers and Successful Reformers in Education (OECD PISA)
    • Innovative school change
    • School Turnaround theory
    • Improving Teacher Preparation Systems
    • Assignment Page
  • EDME 6300-Measurement TheoryClick to open the EDME 6300-Measurement Theory menu
    • Course Schedule
    • Measurement Publications
    • People in Measurement
    • Validity Theory
    • Validity Theory Applied to the Caribbean
    • The Validity Debates
    • The Validation Process
    • Test Fairness
    • Item and test bias
    • Assignment Page
  • EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENTClick to open the EDEA 6200-ACTION RESEARCH FOR SCHOOL IMPROVEMENT menu
    • What is Action Research?
    • History & Thinkers
    • Books & References
    • The Reading Room
    • Nuts & Bolts
    • Whole School Interventions
    • SAMPLE STUDY
    • The Viewing Room
    • Brainstorming Strategies
    • Assignment Page
    • Assignment Rubric Page
    • Giving Presentations
    • Starting up a PLC
    • What Works Page-
    • Improvement & Implementation Science Tools
    • Research & Evidence in the Schools
    • The Class of 2016 Issues
  • EDME 6006-ASSESSMENT & EVALUATION-2016Click to open the EDME 6006-ASSESSMENT & EVALUATION-2016 menu
    • Updates-week by week
    • TOBAGO SCHEDULE
    • EDME 6006-ASSIGNMENTS
    • A Model for Classroom Assessment In Trinidad & Tobago
    • Assessment System-Purposes and Types
    • Issues in assessment
    • New videos on classroom assessment
    • More videos on classroom assessment
    • Experts on Formative Assessment
    • Resources & Support-Formative Assessment & Item Writing
    • Resources & Support-A call for extended performance assessments
    • Resources and Support-All about rubrics
    • Assessment in the New Primary School Curriculum
    • Item Analysis Support
    • Test Fairness & Validity
    • More on test validity
    • NEW PRACTICE QUESTIONS
    • Resources & Support-Measurement Topics
  • Friends and Family

EDME 6121-COURSE ASSESSMENT & EXAMINATIONS

COURSE ASSESSMENTS

ASSIGNMENT 1

•10-15 page (2500 words) assignments

You are manager of the International Assessment Programme in the Ministry of Education, Trinidad and Tobago.  Construct a Cabinet Note that provides justification for continuing and expanding the international assessment programme in Trinidad and Tobago.

 


Scaffolding

1.Consider use of international assessments elsewhere (Ravela et al. 2008)
2.Complete a cost-benefit analysis
3.Focus on a data generation and use system for evidence-based policy-making (Segone, 2009)
4.Consider choices in assessment frameworks
5.Consider the use and value of results, including comparative studies, evidence-based policymaking, and international benchmarking

Support
Advice on writing Cabinet Notes
India
Trinidad
(Thanks Taliba)
Jamaica
Scotland
Ghana
More support
Advice with Examples from Tasmania, Australia
Public Sector Writing
Submissions to Cabinet-Queensland, Australia
Try this format
Another sample format

Cost of national and international assessments compared-readings
  1. Smaller, Quicker, Cheaper -UNESCO 193 pages
  2. How much is learning worth?
  3. DIFD Advice
  4. The Kinds of Assessments that Latin America Needs-Ravela et al (2008)

References
  • Best, M., Knight, P., Lietz, P., Lockwood, C., Nugroho, D., & Tobin, M. (2013). The impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries. Australia: ACER
    Castejón, A., & Zancajo, A. (2015). Educational differentiation policies and the performance of disadvantaged students across OECD countries. European Educational Research Journal, 14(3-4), 222-239.
  •  De Lisle, J., Mohammed, R., & Lee-Piggott, R. (2014). Explaining Trinidad and Tobago's system response to international assessment data. Journal of Educational Administration, 52(4), 487-508.
  • De Lisle, J., Seecharan, H., & Ayodike, A. T. (2010, March). Is the Trinidad and Tobago education system structured to facilitate optimum human capital development? New findings on the relationship between education structures and outcomes from National and International Assessments. Paper presented  on March 24-26, 2010 at the 11th Annual SALISES conference, Hyatt Hotel, Port of Spain, Trinidad & Tobago. 
  • Kamens, D. H., & McNeely, C. L. (2010). Globalization and the growth of international educational testing and national assessment. Comparative Education Review, 54(1), 5-25.
  • Kamens, D. H., & Benavot, A. (2011). National, regional and international learning assessments: Trends among developing countries, 1960–2009. Globalisation, Societies and Education, 9(2), 285-300.
  • OECD (2011). PISA at a glance. Paris: OECD
  • Reddy, V., Zuze, T. L., Visser, M., Winnaar, L., Juan, A., & Prinsloo, C. H. Beyond Benchmarks. What twenty years of TIMSS data tells us about South African education. South Africa: HSRC.
  • Wagner, D. A. (2010). Quality of education, comparability, and assessment choice in developing countries. Compare, 40(6), 741-760.
  • Wagner, D. A., & Castillo, N. M. (2014). Learning at the bottom of the pyramid: Constraints, comparability and policy in developing countries. Prospects, 44(4), 627-638.


ASSIGNMENT 1 ALTERNATIVE 2018 (20 Marks)

•15-17 pages (2500 - 3000 words) written assignment and presentation (use outline)

 

You are Director of the Division of Educational Research & Evaluation (DERE).

WRITE AND PRESENT a benchmarking report on the progress being made by Trinidad and Tobago towards building a high performing and equitable school system. Use data from the 2006 and 2011 PIRLS and 2009 and 2015 PISA.

  • Define and explain what is meant by a high performing and equitable school system
  • Discuss performance indicators
  • Identify metrics and data that may be used in valid comparisons
  • Discuss the value and chalenges of comparisons
  • Conduct benchmarking exercise with clear methodology
  • Evaluate key findings & policy lessons
  • Explore challenges of context in comparison
  • Explore challenges of scale-up, implementation, and sustainability
  • Write final conclusions
  • Present written report orally

REMEMBER TO INCLUDE INFOGRAPHICS AND DATA VISUALIZATIONS.

 

Further Scaffolding

1. Describe the role of benchmarking in education systems

2. Identify possible data for benchmarking

3. Benchmark performances and practices using the data

4. Identify main findings and policy lessons

5. Comment on applicability of best practice

5. Comment on scaling and implementation issues

7. Identify implications for policy direction

 

Scoring and Criteria

Paper

  • Effective and persuasive argument
  • Insightful comparisons
  • Accurate arguments
  • Coherent and logical development of ideas and evidence
  • Insightful use and presentations of evidence, including selected data visualizations




See IDB Policy Briefs on PISA for topics and data visualizations

Class Presentation and Discussion 12 marks

Paper (2500 words) 8 marks

  • Effective and persuasive argument
  • Effective presentation
  • Coherent and logical argument in paper
  • Useful data visualizations

Use this persuasion rubric for self assessment

See also for oral presentation persuasive speech rubric


 

ASSIGNMENT 2 (20 Marks for 2017-2019)

DEVELOP AN  EVALUATION WORKPLAN  FOR ANY SCHOOL, CURRICULUM, OR SYSTEM PROGRAMME RECENTLY IMPLEMENTED WITHIN THE EDUCATION SYSTEM OF TRINIDAD & TOBAGO
•Scaffolding
–1. Describe the object of the evaluation
•– Extended description of school programme, including purpose, aims, objectives, initiation and implementation, and other relevant contextual factors (Chapter 12-Fitzpatrick, Sanders, & Worthen, 2010)
–2.   Focus  the evaluation
• – Develop Logic Model or Theory of Action AND Evaluation Questions. You MAY include Goals, Criteria, Indicators, Targets, OR Standards (Provide Rationale for each)
l(Chapter 13-Fitzpatrick, Sanders, & Worthen, 2010)
–3.   Suggest & describe an appropriate evaluation design/model. 
•Recommend AN APPROACH/MODEL AND An evaluation DESIGN
•In the Design, describe the Sample/Sampling strategy, Data Collection Approaches, Instruments, and Data Analysis. (Provide Rationale for Choices) (Chapter 4-10 & 15-16-Fitzpatrick, Sanders, & Worthen, 2010)
–4.  Identify the likely audience and content of the report.
•Include proposals for better use of data, including visualizations (Chapter 17-Fitzpatrick, Sanders, & Worthen, 2010)
•Comment briefly on the politics of evaluation

Evaluation workplan on better evaluation website

Support

Program Evaluation: Alternative Approaches and Practical Guidelines (4th Edition) [Jody L. Fitzpatrick, James R. Sanders, Blaine R. Worthen (2010)]

CAP EVALUATION REPORT
CAP EVALUATION FINAL PRESENTATION-
Details on Change theory

Webinar-WATCH-Evaluation Plans
Developing Evaluation Workplans
Download CDC Guide to Developing an Evaluation Plan




 Get Rubrics here

EDME 6121 Assignment Rubrics

Support outside the classroom and feedback

 

Every Wednesday.


NEW EXAM SECTION FROM 2012

Section C: Evaluation Models, Designs, Theory & Theorists

Choose One question only

 1. Choose ONE of the following theorists and describe (a) their contribution to evaluation theory and (b) the value of their ideas to the study and practice of educational evaluation in general and (c) comment on the applicability of their theoretical work to education and social evaluation in the Anglophone Caribbean

 Jennifer Greene

Huey T. Chen

Michael Quinn Patton

 2. You are assigned to be an evaluator for a new international reading programme which is to be scaled up nationally and regionally. Choose a suitable evaluation model and an evaluation design that will help you to answer questions of accountability, which have the highest priority. Provide a detailed rationale for both of your choices.

 3. Discuss how might you better improve (i) evaluation capacity building, (ii) promote an evaluation culture, (iii) organize the evaluation function and (iv) promote better utilization of evaluation data in the Trinidad and Tobago Ministry of Education in an attempt to promote greater evidence-based policy-making?



Copyright 2009 jeromedelisle.org. All rights reserved.

Web Hosting by Turbify

School of Education
University of the West Indies, St. Augustine
St. Augustine

ph: 868-477-1500

delislejerome@gmail.com