Original Research - Special Collection: 9th AfrEA International Conference 2019

Validating an evaluation school functionality tool

Margaret Roper, Leticia Taimo, Jennifer L. Bisgard, Katharine Tjasink
African Evaluation Journal | Vol 8, No 1 | a423 | DOI: https://doi.org/10.4102/aej.v8i1.423 | © 2020 Margaret Roper, Leticia Taimo, Jennifer L. Bisgard, Katharine Tjasink | This work is licensed under CC Attribution 4.0
Submitted: 12 August 2019 | Published: 12 May 2020

About the author(s)

Margaret Roper, Khulisa Management Services, Johannesburg, South Africa
Leticia Taimo, Khulisa Management Services, Johannesburg, South Africa
Jennifer L. Bisgard, Khulisa Management Services, Johannesburg, South Africa
Katharine Tjasink, Khulisa Management Services, Johannesburg, South Africa

Abstract

Background: Evaluators are cognisant of the need to determine the effects of an intervention within its context.

Objectives: In education evaluations, there was a gap in context-specific assessment tools to determine the status of school functionality with the ultimate aim of examining whether there is a relationship between school functionality context and teaching and learning outcomes. To meet evaluation standards, evaluators must ensure that evaluation tools and data are accurately measuring the indicators and variables. The focus of the article is on lessons learned from a tool validation process. These are shared to guide evaluators in similar settings.

Method: Khulisa Management Services (Khulisa) has conducted research and evaluations in South African schools since 1993. In 2011, Khulisa developed a school functionality tool based on local and international literature, engagement with key stakeholders, and through a series of implementation phases over various evaluations. The tool identifies high functional, functional, stagnant but functional and dysfunctional schools. The authors of this article undertook a reflection process to evaluate the evidence gathered to support the meaningfulness, usefulness and appropriateness of the tool properties.

Results: Lessons from the validation process include the need to build time and resources for validation from the beginning, validating a tool over time and across evaluations adds value, training of data collectors is critical, and analysis is important towards establishing the consistency and reliability of a tool.

Conclusion: While reliability analysis and the validation process are ongoing, preliminary results show that the tool has potential to document context appropriately.


Keywords

School; Functionality; Tool; Validation; Lessons

Metrics

Total abstract views: 2801
Total article views: 3092

 

Crossref Citations

1. Zonation system in admission of new student at state secondary school in Indonesia: how predictable to learning success
B. Bulkani, M. Fatchurahman, M. A. Setiawan
The Education and science journal  vol: 25  issue: 8  first page: 115  year: 2023  
doi: 10.17853/1994-5639-2023-8-115-133