<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.1d1 20130915//EN" "http://jats.nlm.nih.gov/publishing/1.1d1/JATS-journalpublishing1.dtd">
<article xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:mml="http://www.w3.org/1998/Math/MathML" article-type="research-article" xml:lang="en">
<front>
<journal-meta>
<journal-id journal-id-type="publisher-id">AEJ</journal-id>
<journal-title-group>
<journal-title>African Evaluation Journal</journal-title>
</journal-title-group>
<issn pub-type="ppub">2310-4988</issn>
<issn pub-type="epub">2306-5133</issn>
<publisher>
<publisher-name>AOSIS</publisher-name>
</publisher>
</journal-meta>
<article-meta>
<article-id pub-id-type="publisher-id">AEJ-8-508</article-id>
<article-id pub-id-type="doi">10.4102/aej.v8i1.508</article-id>
<article-categories>
<subj-group subj-group-type="heading">
<subject>Original Research</subject>
</subj-group>
</article-categories>
<title-group>
<article-title>Adapting realist evaluation for Made in Africa evaluation criteria</article-title>
</title-group>
<contrib-group>
<contrib contrib-type="author" corresp="yes">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0001-9226-7981</contrib-id>
<name>
<surname>Mbava</surname>
<given-names>Nombeko P.</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<contrib contrib-type="author">
<contrib-id contrib-id-type="orcid">https://orcid.org/0000-0002-0861-6120</contrib-id>
<name>
<surname>Chapman</surname>
<given-names>Sarah</given-names>
</name>
<xref ref-type="aff" rid="AF0001">1</xref>
</contrib>
<aff id="AF0001"><label>1</label>Institute of Monitoring and Evaluation, Faculty of Commerce, University of Cape Town, Cape Town, South Africa</aff>
</contrib-group>
<author-notes>
<corresp id="cor1"><bold>Corresponding author:</bold> Nombeko Mbava, <email xlink:href="mbava0@gmail.com">mbava0@gmail.com</email></corresp>
</author-notes>
<pub-date pub-type="epub"><day>09</day><month>12</month><year>2020</year></pub-date>
<pub-date pub-type="collection"><year>2020</year></pub-date>
<volume>8</volume>
<issue>1</issue>
<elocation-id>508</elocation-id>
<history>
<date date-type="received"><day>30</day><month>07</month><year>2020</year></date>
<date date-type="accepted"><day>21</day><month>10</month><year>2020</year></date>
</history>
<permissions>
<copyright-statement>&#x00A9; 2020. The Authors</copyright-statement>
<copyright-year>2020</copyright-year>
<license license-type="open-access" xlink:href="https://creativecommons.org/licenses/by/4.0/">
<license-p>Licensee: AOSIS. This work is licensed under the Creative Commons Attribution License.</license-p>
</license>
</permissions>
<abstract>
<sec id="st1">
<title>Background</title>
<p>Globally, the theory and practice of evaluation largely emerged from Euro-Western worldviews and continue to evolve in a manner that addresses the needs of Euro-Western interests. The extent to which the closely held values and general outlook of diverse stakeholders underpins how evaluation is processed and designed is interrogated, given the global and multicultural nature of evaluation.</p>
</sec>
<sec id="st2">
<title>Objectives</title>
<p>We summarised contemporary debates on Made in Africa evaluation and reflected on what these debates might mean for evaluation practice. We also reflected on what it might mean to adapt a quintessentially Euro-Western evaluation method as an integral part of indigenising evaluation theory and practice in African contexts.</p>
</sec>
<sec id="st3">
<title>Method</title>
<p>Research that adopted a case study approach and a realist evaluation meta-analysis framework was conducted in South Africa, which aimed to provide better understanding of the methodologies and approaches used in past programme impact evaluations. The aim was to reflect on the usefulness of evaluation findings to policy decision makers and to determine the suitability of the realist evaluation method in the implementation of evaluations.</p>
</sec>
<sec id="st4">
<title>Results</title>
<p>While potential constraints were involved in its application, the realist evaluation held promise in addressing some of the requirements of Made in Africa evaluation. A model of an adapted realist evaluation cycle was presented. It was suggested that the model might enable better implementation of the realist evaluation framework in some African contexts.</p>
</sec>
<sec id="st5">
<title>Conclusion</title>
<p>Adaptation of evaluation models, theories and instruments, towards contextual relevance and cultural appropriateness was a progressive continuum towards originating indigenous African evaluation approaches.</p>
</sec>
</abstract>
<kwd-group>
<kwd>Africa-centric evaluation</kwd>
<kwd>adaptation</kwd>
<kwd>realist evaluation</kwd>
<kwd>evaluation cycle</kwd>
<kwd>evaluation model</kwd>
<kwd>Made in Africa evaluation</kwd>
</kwd-group>
</article-meta>
</front>
<body>
<sec id="s0001">
<title>Introduction</title>
<p>Evaluation has advanced and broadened to a highly globalised world since its earlier prevalent implementation in American government social reform programmes such as the Great Society and War on Poverty (Shadish &#x0026; Luellen <xref ref-type="bibr" rid="CIT0046">2011</xref>:184&#x2013;186).</p>
<p>Evaluation may have been phenomenally embedded through international development (Cloete <xref ref-type="bibr" rid="CIT0015">2016</xref>; Ofir <xref ref-type="bibr" rid="CIT0033">2013</xref>), however in recent years governments have increasingly started to build state capacity to evaluate (Porter &#x0026; Goldman <xref ref-type="bibr" rid="CIT0041">2013</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>).</p>
<p>Similarly, private sector and non-profit organisations have increasingly used evaluation as a tool for accountability (Bisgard <xref ref-type="bibr" rid="CIT0007">2017</xref>; Abrahams <xref ref-type="bibr" rid="CIT0001">2015</xref>:2&#x2013;5; Wildschut <xref ref-type="bibr" rid="CIT0053">2014</xref>). Globally, all manners and aspects of our lives are increasingly subjected to evaluation and assessed against quality criteria, resulting in a fervent evaluation wave within society at large (Dahler-Larsen <xref ref-type="bibr" rid="CIT0018">2011</xref>, <xref ref-type="bibr" rid="CIT0017">2019</xref>).</p>
<p>It has been asked: whose values and world views inform the evaluation process and design? (Chouinard &#x0026; Hopson <xref ref-type="bibr" rid="CIT0014">2016</xref>:248). This inquiry is underpinned by an evolving discourse that interrogates asymmetries of power structures between the regions of the Global South and the Global North, epistemic justice and issues of identity and representation (Ndlovu-Gatsheni <xref ref-type="bibr" rid="CIT0032">2015</xref>:13&#x2013;40), bringing the extent to which evaluation practices and theoretical lenses are contemplative and inclusive of those involved in the evaluation process under interrogation. While the interest in interrogating evaluation theory and practice through the lens of cultural competence and responsiveness, contextual relevance and cultural validity is not new (Chouinard &#x0026; Hopson <xref ref-type="bibr" rid="CIT0014">2016</xref>; SenGupta, Hopson &#x0026; Thompson-Robinson <xref ref-type="bibr" rid="CIT0050">2004</xref>), most rigorous expositions have focused on localities of Native Americans, New Zealand Maoris and Australian Aborigines. Meaningful engagement with these issues as they resonate in an African context has not received due consideration. In an African context, the implication has been the perpetuation of one&#x2013;size-fits-all evaluation methods that have not fully served both beneficiaries and policy decision makers (Mbava and Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>:1).</p>
<p>This article seeks to address this gap through a consideration of how existing evaluation models, theories and instruments might be adapted towards contextual relevance, cultural responsiveness and inclusivity of local stakeholders and African evaluators. Specifically, we reflect critically on the &#x2018;Made in Africa&#x2019; evaluation discourse and summarise what scholars have proposed as the way forward for moving this discourse in evaluation practice in the African continent. Drawing on empirical research that seeks to better understand the methodologies and approaches used in past programme impact evaluations in the South African public sector and drawing on the perspectives of both policy decision makers and evaluation service commissioners, we reflect on the practical steps and challenges involved in taking an adaptive approach to operationalising &#x2018;Made in Africa&#x2019; evaluation, which involves taking progressive step towards originating indigenous and authentic African evaluation approaches into existing Euro-Western traditions. To focus this discussion, we use the example of realist evaluation, which we propose by its acknowledgement of the need to accommodate unique evaluation contexts, which may serve as a promising beacon for better evaluation practices in African contexts.</p>
<p>Realist evaluation is an addition to evaluation body of knowledge from European theorists (Pawson &#x0026; Tilley <xref ref-type="bibr" rid="CIT0038">1997</xref>) and built on the assumptions of realism&#x2019;s philosophical foundation. Its central assumption lies in articulating a programme&#x2019;s theory of change as a basis of explicating how and why interventions work and for whom they effectually work for (Pawson <xref ref-type="bibr" rid="CIT0037">2006</xref>:25). This is largely described through the interrogation of the context of the intervention, the explanation of what it is that triggers the observed change and further ascertaining that the observed outcomes corroborate the original programme theory. This idea is expressed through the conceptual framework of context&#x2013;mechanism&#x2013;outcome configuration or CMO (Pawson &#x0026; Tilley <xref ref-type="bibr" rid="CIT0038">1997</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>).</p>
<p>Using this realist evaluation approach as an example that might be adapted to serve the purposes of a Made in Africa evaluation agenda, we discuss the steps that might be involved in putting this adaptation into practice. The suggestion is that acting in conducive contextual environments (the context), the programmes will have successful outcomes through a unique combination of the innate thought processes and actions of programme participants (the mechanism). Therefore, successful interventions are a result of interpreting suitable context and the underlying mechanism that result in planned outcomes (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:59). This study ends with a self-critical discussion of the limitations and potential applications of this kind of adaptive approach as well as directions for future theory and practice.</p>
</sec>
<sec id="s0002">
<title>A brief overview of evaluation</title>
<p>From its earlier roots in evaluating United States government social programmes in the eras of the &#x2018;New Deal&#x2019; and &#x2018;Great Society&#x2019; policies (Shadish &#x0026; Luellen <xref ref-type="bibr" rid="CIT0046">2011</xref>:184&#x2013;186; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>) evaluation has through development advanced and broadened to a highly globalised world and is now practiced in a multicultural world and in complex contexts, impacting the lives of various and diverse communities globally. Demanded by governments (Porter &#x0026; Goldman <xref ref-type="bibr" rid="CIT0041">2013</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>), embedded in development (Cloete <xref ref-type="bibr" rid="CIT0015">2016</xref>; Ofir <xref ref-type="bibr" rid="CIT0033">2013</xref>) and increasingly utilised in private and not-for-profit sectors (Bisgard <xref ref-type="bibr" rid="CIT0007">2017</xref>; Abrahams <xref ref-type="bibr" rid="CIT0001">2015</xref>; Wildschut <xref ref-type="bibr" rid="CIT0053">2014</xref>), an evaluation wave fuelled by performance and quality standards is creating an evaluating society (Dahler-Larsen <xref ref-type="bibr" rid="CIT0018">2011</xref>, <xref ref-type="bibr" rid="CIT0017">2019</xref>).</p>
<p>Given this context, a brief overview of some of the scholarly views and descriptions is useful.</p>
<p>It has been claimed that &#x2018;programme evaluation is primarily concerned with judging the merit, worth, quality, or value of programmes&#x2019; (Scriven <xref ref-type="bibr" rid="CIT0048">1999</xref>:521). Furthermore:</p>
<disp-quote>
<p>&#x2018;&#x2026; the evaluation process identifies relevant values or standards that apply to what is being evaluated, performs empirical investigation using techniques from the social sciences, and then integrates conclusions with the standards into an overall evaluation or set of evaluations&#x2019;. (Scriven <xref ref-type="bibr" rid="CIT0049">2003</xref>:7)</p>
</disp-quote>
<p>Others (House <xref ref-type="bibr" rid="CIT0021">1993</xref>; Mark, Henry &#x0026; Julnes <xref ref-type="bibr" rid="CIT0025">1999</xref>; Scriven <xref ref-type="bibr" rid="CIT0047">1997</xref>, <xref ref-type="bibr" rid="CIT0048">1999</xref>, <xref ref-type="bibr" rid="CIT0049">2003</xref>; Stufflebeam <xref ref-type="bibr" rid="CIT0051">2001</xref>) have interpreted evaluation&#x2019;s main purpose as that of giving precedence to the appraisal of merit and value of a programme or policy. The centrality of this characterisation encompasses the value judgement nature of evaluation. Fournier (<xref ref-type="bibr" rid="CIT0020">2005</xref>:140&#x2013;141) has suggested that the inquiry and inferences of evaluation have a value judgement that is both experimental and normative. Mark et al. (<xref ref-type="bibr" rid="CIT0025">1999</xref>:188) support the view of an intrinsic judgement underpinned by values with regard to the merit and worth of an intervention and its influence on further knowledge regarding programme efficiency. Patton (<xref ref-type="bibr" rid="CIT0035">2008</xref>:39) described programme evaluation as:</p>
<disp-quote>
<p>&#x2018;&#x2026; the systematic collection of information about the activities, characteristics, and results of programmes to make judgements about the programme, improve or further develop programme effectiveness, inform decisions about future programming and/or increase understanding&#x2019;.</p>
</disp-quote>
<p>In the context of Africa-centric evaluation, the African Evaluation Association (AfrEA; Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>: 9) has thus resolved that the role of values and culture in African contexts should be evident in current knowledge systems and infused in modelling evaluation in Africa.</p>
<p>It has also been argued that evaluation is part of applied research with a focus on empirical enquiry (Rossi, Freeman &#x0026; Lipsey <xref ref-type="bibr" rid="CIT0044">2004</xref>; Weiss <xref ref-type="bibr" rid="CIT0052">2004</xref>). Rabie and Cloete (<xref ref-type="bibr" rid="CIT0043">2009</xref>:81) have suggested that &#x2018;evaluation is nothing more than an applied social research activity&#x2019;. Weiss (in Alkin <xref ref-type="bibr" rid="CIT0002">1990</xref>:83) maintains that evaluation largely rest upon policy research evidence that aims to support decision-making and the formulation of effective programmes. Similarly, Lincoln and Guba (<xref ref-type="bibr" rid="CIT0023">1986</xref>:73&#x2013;84) claimed that evaluation is a &#x2018;disciplined inquiry&#x2019; underpinned by scientific rigour as a basis for programme planning. Others equally support this observation (Rossi &#x0026; Freeman <xref ref-type="bibr" rid="CIT0045">1993</xref>) noting that evaluation applies scientific methods on social research to enable the assessment of how interventions were conceptualised, planned and implemented.</p>
<p>The field of evaluation encompasses various definitions, this article does not claim to provide a definitive conclusion on completeness of the various perspectives, rather these few explanations provide some perspectives reflected in the literature.</p>
</sec>
<sec id="s0003">
<title>Research method</title>
<p>A recent study was conducted in South Africa, which aimed to provide better understanding of the methodologies and approaches used in past programme impact evaluations in the South African public sector and to reflect on the usefulness of evaluation findings to policy decision makers (Mbava &#x0026; Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>; Mbava &#x0026; Rabie <xref ref-type="bibr" rid="CIT0029">2018</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>).</p>
<p>In addition to a comprehensive literature review, the study adopted a case study design. Four publicly available impact evaluations were identified for assessment.</p>
<p>A meta-analysis framework that was informed by existing knowledge from the literature review as well as the realist evaluation theoretical framework was applied to the analysis of selected case studies to explore the extent to which the evaluation questions, methods and findings of the impact case studies offered insight into what works, for whom, why it works and under which conditions it works. In addition, key informant interviews were conducted with seven policy decision makers, commissioners, implementers of evaluations in the South African public sector and people familiar with the case studies to determine the usefulness of the evaluations as well as determine the suitability of the realist evaluation method in conducting policy evaluations in the South African public sector. For a detailed discussion on the study and its findings, see Mbava (<xref ref-type="bibr" rid="CIT0026">2017</xref>).</p>
</sec>
<sec id="s0004">
<title>Towards &#x2018;Made in Africa&#x2019; evaluation</title>
<p>The AfrEA has largely been championing a call for African ownership of evaluations of the highest standards from within Africa as well as evaluation theory and practice pertinent to the lived realities of the continent (Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>). The interest in &#x2018;making evaluation our own&#x2019; emerged as a strong statement in the 4<sup>th</sup> AfrEA, Niamey, Niger Conference in 2007 (AfrEA 2007). It was resolved to drive an evaluation agenda that is led and owned by Africans including exploring the possibilities of adopting African-based methods and practices in evaluation and supporting the incorporation of such within the body of evaluation (AfrEA, 2007). This had been a consistent call for the adoption of Africa-centric evaluation in both theory and practice as a response to the imperatives of African cultural contexts (AfrEA 2007; Bellagio Centre 2012; Chilisa &#x0026; Malunga <xref ref-type="bibr" rid="CIT0012">2012</xref>; Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>; Chilisa, Major, Gaotlhobogwe &#x0026; Mokgolodi <xref ref-type="bibr" rid="CIT0010">2016</xref>; Cloete <xref ref-type="bibr" rid="CIT0015">2016</xref>; Carden &#x0026; Alkin <xref ref-type="bibr" rid="CIT0008">2012</xref>; Ofir &#x0026; Kumar <xref ref-type="bibr" rid="CIT0034">2013</xref>).</p>
<p>These new voices from the Global South have increasingly called for full participation in the construction of evaluation theory and practice that is relevant to the lived realities of all evaluation stakeholders, including beneficiaries, located in the developing world (Mbava <xref ref-type="bibr" rid="CIT0027">2019</xref>). Such realities reflect the incorporation of their knowledge, value systems and perspectives in the evaluation process and designs (Chournaid &#x0026; Hopson 2016:248). It has been argued that the credible involvement of local evaluators in more ways than in the typecast &#x2018;role of practical fixers and data collectors&#x2019; results in better evaluation (Mbava &#x0026; Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>:3). For example, local voices can go beyond simply testing a programme theory, which has been developed elsewhere. Local evaluators should, for example, participate in formulating programme theory as informed by their lived realities as well as in the evaluation process through collective deliberation and communal decision-making (Mbava <xref ref-type="bibr" rid="CIT0027">2019</xref>:19).</p>
<p>As said by Chilisa (<xref ref-type="bibr" rid="CIT0011">2015</xref>:17), we learn from each other and, therefore, adapting Euro-Western evaluation approaches to suit local contexts is &#x2018;a good practice that is supported by African value systems&#x2019;. Drawing from the knowledge systems embedded in African cultural context, this has the potential to strengthen ways of thinking about evaluation and its impact.</p>
<p>Given this agenda, it is apparent that the pillars of an Africa-centric paradigm include appreciation of pluralistic methods in evaluation; active participation of key stakeholders in the construction of what is evaluated, when, by whom and how; the interrogation of the broader programme context and promotion of evaluative thinking; and finally due cognisance and infusion of African epistemology, ontology and axiology in evaluation.</p>
<p>As one perspective of evaluation enquiry necessitates empirical research to estimate how interventions are theorised, planned and implemented, we need to ask &#x2018;Whose research methods and whose scientific enquiry process are applied in evaluation?&#x2019; Furthermore, cognisant that evaluation inquiry and inferences as gleaned through the literature have an intrinsic value judgement that is underpinned by both normative and scientific bases, we need to further ask &#x2018;Whose value systems informs what is defined as evaluation evidence&#x2019;. These are some of the questions that a Made in Africa theoretical lens seek to critically analyse and interrogate. For example, it has been argued that in many African contextual environments, embedded societal values are central in regulating social and communal structures (Mbava <xref ref-type="bibr" rid="CIT0027">2019</xref>:17; Idang 201:101). Given this state of affairs, African values and worldviews should be infused and guide the development of credible evaluations.</p>
</sec>
<sec id="s0005">
<title>Whose value system?</title>
<p>Reflection and critical analysis on both the epistemological and axiological underpinning of evaluation enquiry is important, this article addresses the questions of whose value system informs evaluation enquiry within an Africa-centric viewpoint. Choices and decision-making are not only driven by the available evidence but also influenced by values, beliefs and assumptions that have shaped Euro-Western worldviews. The extent to which African values and worldviews guide and shape evaluation in Africa is important for consideration. Our own research suggests a correlation between this and the degree to which evaluation findings are ultimately utilised by African policymakers and citizens engaged with the development of the continent (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>; Mbava &#x0026; Rabie <xref ref-type="bibr" rid="CIT0029">2018</xref>).</p>
<p>Accepting that the evaluator brings an inherent value judgement in the evaluation processes has implication for objectivity in evaluation. The role of evaluations in appraising the worth and significance of a programme or policy and decision-making has implications for what is deemed legitimate and credible. We suggest this point is particularly relevant to our discussion about Africa-centric evaluation approaches, because as Mark et al. (<xref ref-type="bibr" rid="CIT0025">1999</xref>:179) argued, &#x2018;the evaluator&#x2019;s background may be the most important determinant of the type of evaluation that is done, rather than the context and the information needs of the affected groups and the public&#x2019;. Thus, whether an evaluator stems from a western background or an African one, the values are critical to informing the very process of value judgment in evaluation. As Chilisa further points out (<xref ref-type="bibr" rid="CIT0011">2015</xref>:12), these axiological, ontological and epistemological assumptions &#x2018;inform the realities that we see, how we see them, how we interpret them and how we communicate them&#x2019;. We argue that this perspective has not been dealt with frankly and sufficiently by the evaluation community, especially because a significant majority of evaluations on the African context are undertaken by non-African evaluators &#x2013; a trend that appears to be increasing rather than decreasing over time (Cameron, Mishra &#x0026; Brown <xref ref-type="bibr" rid="CIT0009">2016</xref>).</p>
</sec>
<sec id="s0006">
<title>Evaluation influences and theoretical models</title>
<p>The trajectory of evaluation into Africa has been extensively documented elsewhere (Cloete <xref ref-type="bibr" rid="CIT0015">2016</xref>; Mouton <xref ref-type="bibr" rid="CIT0030">2010</xref>; Mouton, Rabie, Cloete &#x0026; de Coning <xref ref-type="bibr" rid="CIT0031">2014</xref>; Wildschut <xref ref-type="bibr" rid="CIT0053">2014</xref>). The node of this trajectory indicates deep-rooted emergence of this phenomenon in development, where practices in this sphere have, to a large extent, defined and influenced evaluations in much of the developing world today. The colonised past of the African continent and Western influences on how evaluation is conceptualised, theorised, practiced and taught have had lasting impact on the current adopted evaluation standards and approaches as well as the teaching of evaluation that dominantly draws from Western texts and theory within the continent. This has often largely resulted in one-size-fits-all programme evaluation approaches as evaluation frameworks and adopted approaches were institutionalised and formulated from the viewpoint of development institutions and donors. Cloete (<xref ref-type="bibr" rid="CIT0015">2016</xref>:57) goes so far as to argue that these prescriptive &#x2018;mental models&#x2019; and approaches were largely brought to Africa through structural adjustment policies &#x2013; where as a condition of receiving financial loans from multilateral institutions, African economies had to adjust their economic policies as prescribed by the demands of development interventions. The consequence is that these Euro-Western influences have been thoroughly engendered and embedded through international development efforts, which explains why they have endured and continued to influence the trajectory of evaluation practice in Africa. It has been argued that this uncritical transfer of Euro-Western models has failed to transform millions of lives particularly in sub-Saharan Africa (Briggs <xref ref-type="bibr" rid="CIT0006">2013</xref>).</p>
<p>In contrast, the Africa-centric discourse emphasises that alternative theoretical frameworks should be learned from the lived realities of African stakeholders, informed by indigenous ideas and factors in such contexts (Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>; Cloete <xref ref-type="bibr" rid="CIT0015">2016</xref>; Ofir &#x0026; Kumar <xref ref-type="bibr" rid="CIT0034">2013</xref>). It is a counterbalance to the enduring tendency for theory and practice of evaluation to be largely centred on and derived from Euro-Western worldviews and perspectives. These dominant Euro-Western frameworks continue to evolve in a manner that primarily addresses the needs of donors and international agencies without sufficiently considering the realities of African beneficiaries. According to Ofir (<xref ref-type="bibr" rid="CIT0033">2013</xref>:585), adopted methods in evaluation and development have not fully strengthened evaluation in developing contexts and rather have focused on simple interventions other than the reality of complex adaptive systems. Research (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>) has identified limitations with evaluation methodologies that are inconclusive in providing coherent explanations of why interventions have demonstrated results in a particular manner. Consequently, the validity and usefulness of evaluation results from these analyses have been interrogated for their efficacy to in-country users and resulted in their under-utilisation by African policymakers (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>; Mbava &#x0026; Rabie <xref ref-type="bibr" rid="CIT0029">2018</xref>). Bamberger (<xref ref-type="bibr" rid="CIT0005">2008</xref>:134) has claimed that poorly understood evaluation methods potentially result in poor use of evaluation findings. Therefore, the credibility of applied methodologies could have implications for the effective use of evaluation findings. Given this context, the role of evaluation enquiry in the transformation of society and its evolution cannot be marginalised.</p>
</sec>
<sec id="s0007">
<title>Types of approaches to indigenous evaluation</title>
<p>Africa-centric evaluation is appreciative of African knowledge systems, philosophies and value systems. Reaching this point in evaluation research, according to Chilisa (<xref ref-type="bibr" rid="CIT0011">2015</xref>:14), will entail the restructuring of power relations in how evaluation knowledge is constructed, &#x2018;such that African people can actively participate in the construction of what is evaluated, when it is evaluated, by whom and with what methodologies&#x2019;. The imbalance of power between the global north and south countries of the world has epitomised the north as the epicentre of knowledge and the southern countries, such as those in Africa, as the recipients of permanent tutelage from the enlightened Euro-Western metropole. Mamdani (<xref ref-type="bibr" rid="CIT0024">2016</xref>:70) argues that &#x2018;rather than acknowledge the plurality of experience and perspective, the universalism born of the European enlightenment sought to craft a world civilization as an expression of sameness&#x2019;. As a legacy of coloniality, indigenous knowledge systems have generally remained on the periphery of what is deemed as knowledge. The people of the Global South are left with the challenge of undoing the impact of the epistemic violence of imperialism (Spivak 1985:254). Therefore, the indigenous paradigm contests the Euro-western epistemic hegemony (Smith 1999).</p>
<p>&#x2018;Epistemological decolonization&#x2019; (Mamdani <xref ref-type="bibr" rid="CIT0024">2016</xref>:79) is critical in positioning active African participation and African voices in the construction of evaluation theory and practice. This conversation on decolonising evaluation continues to garner interest. Most recently the 9th AfrEA Conference held a decolonisation debate within its presidential strand that focused on the imperatives of Made in Africa evaluation. Key issues that were debated in this regard were on &#x2018;indigenous knowledge, metaphors, philosophies, relational ontology, reciprocity, epistemology, axiology&#x2019; amongst others (AfrEA <xref ref-type="bibr" rid="CIT0004">2019</xref>:14). A theoretical and conceptual understanding of a Made in Africa framework remain useful, the next step in this trajectory is the practical application of the concept. Given that Africa is a vast and diverse continent it is expected that such demonstration of application will vary as dictated by the contextual environment. In moving forward with the implementation of Made in Africa evaluation, firstly it is expected that practitioners will practically apply this theoretical thrust in evaluations that are planned or unfolding in African contexts, then proceed to document lessons learnt to further inform practice. Secondly as the proof of concept is strengthened, it is further anticipated that commissioners of evaluations will lucidly specify the need for a Made in Africa lens in their evaluation terms of reference. Finally, with the view towards advancing Africa and her people and the achievement of the sustainable development goals, there is an expectation that progressive development partners and funders adopt a longterm view on Made in Africa evaluation and progressively seek to promote specific donor-funded evaluations that adopt this African lens.</p>
<p>Examples of indigenisation of evaluation in the Global South and the pre-eminence of culturally relevant evaluation approaches from a global perspective have been documented (Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>; Chilisa, Major, Gaotlhobogwe &#x0026; Mokgolodi <xref ref-type="bibr" rid="CIT0010">2016</xref>). According to Chilisa (<xref ref-type="bibr" rid="CIT0011">2015</xref>), the indigenisation of evaluation is informed by three types of approaches, discussed below.</p>
<sec id="s20008">
<title>Least indigenised approach</title>
<p>The least indigenised approach in evaluation as characterised by Chilisa (<xref ref-type="bibr" rid="CIT0011">2015</xref>) has a dominance of a monolithic Euro-Western evaluation paradigm. These approaches have inherent predetermined standards and criteria and are uncritically transferred into African contexts. These lack substantive appropriate customisation in their implementation. Therefore, this approach lacks depth to qualify as African driven in any manner or approach (Chilisa &#x0026; Malunga <xref ref-type="bibr" rid="CIT0012">2012</xref>). It has been argued that the &#x2018;logical framework&#x2019; or &#x2018;logic model&#x2019; &#x2013; a staple instrument in development capacity building and evaluation &#x2013; is a typical example of this approach (Carden &#x0026; Alkin <xref ref-type="bibr" rid="CIT0008">2012</xref>:107), where &#x2018;standard evaluation frames or lenses are not adequately capturing the complexity and realities of the African context, and hence undermining the credibility of practice of evaluation&#x2019; (Bellagio Report 2013:47).</p>
</sec>
<sec id="s20009">
<title>Adaptive evaluation approach</title>
<p>The adaptive evaluation approach is moderate and rational in its approach to evaluation. It considers the adaptation of Euro-Western evaluation models, theories and instruments as value adding.</p>
<p>The overarching aim is adaptations rather than uncritical adoption. According to Carden and Alkin (<xref ref-type="bibr" rid="CIT0008">2012</xref>), most adaptive methodologies are overwhelmingly still developed by evaluators and theorists in the global north, with a view to application in the global south. Most of these methods have participatory philosophies which Rabie and Cloete (<xref ref-type="bibr" rid="CIT0043">2009</xref>:86) describe as &#x2018;lean [<italic>ing</italic>] towards a more applied social improvement approach to evaluation research with the general aim of development, empowerment and creating shared understanding of the programme between the evaluators, beneficiaries and decision-makers&#x2019;. Some examples of approaches that might be amenable to this include &#x2018;developmental evaluation&#x2019;, &#x2018;outcome mapping&#x2019;, &#x2018;democratic evaluation&#x2019; and &#x2018;most significant change&#x2019; evaluation approaches. However, the design and development of these are external from Africa. Therefore, the thought and intellectual leadership lie elsewhere, and active application is in Africa.</p>
<p>An Africa-centric evaluation approach would contest this epistemic hegemony. Beyond being bystanders or uncritical recipients of knowledge, African evaluators, beneficiaries and decision makers seek to pursue an explicit and active participatory role that demands a say in the entire evaluation process. This restructuring of epistemic power relations is only possible with active African voices, and our aim in this article is to argue that credible inclusivity of African voices as envisaged in the Made in Africa theoretical framework presents value and credibility for all stakeholders.</p>
</sec>
<sec id="s20010">
<title>Indigenous approach</title>
<p>The indigenous approach to evaluation is far reaching, profound and evolutionary in comparison to the first and second approaches. It can be viewed as a radical approach insofar as it demands deep-rooted and profound indigenous design and development of evaluation. The indigenous paradigm has at its core the ontological, knowledge and value systems that emanate from the cultures, histories and philosophies of those marginalised by colonialism (Cram, Tibbetts &#x0026; LaFrance <xref ref-type="bibr" rid="CIT0016">2018</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>; Chilisa, Major &#x0026; Khudu-Petersen 2017:327). Therefore, &#x2018;evaluation paradigms in this context transcend adaptation or adoption of prevailing methods. Rather they encompass evaluations whose methods, design, processes, systems and implementation are indigenous to Africa and its people in all respects&#x2019; (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:7). Chilisa and Malunga (<xref ref-type="bibr" rid="CIT0012">2012</xref>:32) further emphasise that &#x2018;African-driven evaluation theory and practice can draw from the evolving post-colonial indigenous paradigm to articulate epistemologies and values of an African-driven evaluation&#x2019;. Carden and Alkin (<xref ref-type="bibr" rid="CIT0008">2012</xref>:111) give an example of the African peer review mechanism, an approach of the New Partnership for African Development, as a demonstration of what is possible with an indigenous lens on evaluation &#x2018;because of the significant engagement of African agents and agencies in its design, implementation, critique, and evolution&#x2019;. These fundamentals and other African knowledge systems call for strong African engagement and leadership in the definition of appropriate and contextually relevant approaches in a quest to further expand the boundaries of knowledge and co-create evaluation theory (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:8). It has been suggested that key stakeholders in African contexts should visibly lead this effort of framing appropriate evaluation approaches (Carden &#x0026; Alkin <xref ref-type="bibr" rid="CIT0008">2012</xref>). The <italic>lekgotla</italic> explained in the next section is a good illustration of an African knowledge method that resonates with an indigenous approach.</p>
</sec>
<sec id="s20011">
<title>An African indigenous method &#x2013; the lekgotla</title>
<p>Chilisa (<xref ref-type="bibr" rid="CIT0011">2015</xref>:18) discusses how various African communities apply certain strategies that enable members of the community to engage constructively on key matters affecting the community and to reach consensus. In a Southern African context, a <italic>lekgotla</italic> is a democratic structure, a meeting where the public or members of a specific group may convene to discuss and resolve a specific issue or agenda. For example, the South African government often refers to &#x2018;cabinet lekgotla&#x2019; in reference to prolonged cabinet meetings (RSA 2020). Traditionally a <italic>lekgotla</italic> is usually a community gathering and deliberation on specific issues to reach consensus. According to Pienaar (<xref ref-type="bibr" rid="CIT0040">2015</xref>:58), the <italic>lekgotla</italic> is based on an &#x2018;indigenous practise of problem resolution&#x2019; and is an authentic research methodology leading to authentic research outcomes in African contexts. In a <italic>lekgotla</italic>, the local community actively engages in the entire research process from initiation to its ultimate resolution. Deeply held belief systems, cultural norms and standards and the community world view influence the research process. For example, a member of the community will bring an issue to the attention of the community. A <italic>lekgotla</italic> will be convened. The initiator will be given the platform to outline the issue. A community leader will then facilitate the proper framing of this problem amongst members of the community as each community member will take turns in articulating their understanding of the issue at hand. This deliberation will culminate in collective articulation and framing of the problem. Given this coherence and clarity, the community will deliberate on possible options. Some of the questions will relate to how such issues were dealt with in the past, given the set of circumstances at this time, and how the issue should be processed, given the cultural norms, values and attitudes of the community. Given this complexity, at the forefront of such deliberations will be the respected community elders who, through their wisdom, resilience and indigenous knowledge, are relied upon to shape the problem resolution towards sustainable outcome.</p>
<p>In a programme evaluation context, a <italic>lekgotla</italic> may build ownership, build trust between the evaluator and the community and this empowerment may enable the community &#x2018;to take charge and become the main authors of the research project and the researcher becomes the co-author through the experiences and eyes of the community&#x2019; (Pienaar <xref ref-type="bibr" rid="CIT0040">2015</xref>:58). Laher, Fynn and Kramer (<xref ref-type="bibr" rid="CIT0022">2019</xref>:398) draw our attention to the importance of demonstrating the appropriateness of research methods that are drawn from indigenous knowledge systems. It is argued that while a research focus group will have similar goals, a <italic>lekgotla</italic> will have more credibility as this process is managed with indigenous focus and a context-specific manner. Clearly a <italic>lekgotla</italic> is far more substantive than a typical research focus group which in typical evaluation process will assemble a purposeful sample of people and interview them on a pre-selected thematic topic. In a research focus group, the participant&#x2019;s involvement is specific and the group has not been involved in the entire evaluation design such as formulating the research question, whereas in a <italic>lekgotla</italic> &#x2018;the community is responsible for facilitating the research questions and reaching a resolution&#x2019; (Laher, Fynn &#x0026; Kramer <xref ref-type="bibr" rid="CIT0022">2019</xref>:397).</p>
<p>In general, therefore, it seems that there is abundant room for further progress in unearthing various evaluation tools or theories of evaluation emanating from African contexts that can shape evaluation theory and practice. Because the <italic>lekgotla</italic> &#x2018;underpins the principle of learning from the community, to resolve issues of the community, in the community&#x2019;s context&#x2019; (Pienaar <xref ref-type="bibr" rid="CIT0040">2015</xref>: 60), it is a data collection and analysis methodology that has potential as a useful research method with utility value for researchers and evaluators in a Southern African context. It is possible that variants of <italic>lekgotla</italic> are practiced elsewhere in Africa beyond Southern Africa with their own terminology. It is evident that other localised methods such as the one illustrated present potential value and there is a need for such methods to be defined and understood in the context of conducting evaluation with sensitivity and leveraging African knowledge systems.</p>
<p>We agree that originating unique evaluation practice and theories through authentic and indigenously African perspectives is the ideal. This long-term goal entails the formulation of a body of knowledge informed by African epistemology, ontology and axiology that engenders participatory, liberating and transformative evaluation practices. The first two approaches are incremental in nature since they are a continuum towards and indigenous approach. This is at best disempowering and self-limiting as as it a adopts an uncritical stance equally within the theory and practice of evaluation. On the extreme end, we are also of the view that the indigenous approach towards an Africa-centric approach, while it is possible, requires a long-term view.</p>
<p>The indigenous paradigm has at its core the ontological, knowledge and value systems that emanate from the cultures, histories and philosophies of those marginalised by colonialism (Chilisa, Major &#x0026; Khudu-Petersen 2017:327).</p>
<p>To foreground an indigenous African rooted evaluation will demand enhanced intellectual leadership in defining appropriate methodologies and approaches that enhance and push the boundaries of knowledge and contribute towards enhanced theory building. This is a critical contribution that must be made by Africans to frame evaluation methods that are authentic to their lived experiences. The Made in Africa evaluation discourse is firmly on the agenda and gaining momentum, its sustenance and foregrounding will demand a deliberate resolve from African evaluators, given the intrinsic power imbalance between the global north and global south (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:8). Such deliberate and purposeful action is critical, given that &#x2018;we are still facing an uphill task in translating these efforts into widespread practice, especially on the continent, as the evaluation knowledge and practice gatekeepers are still mostly from the North&#x2019; (Chilisa &#x0026; Malunga <xref ref-type="bibr" rid="CIT0012">2012</xref>:33).</p>
<p>An adaptive approach has limitations because the thought leadership, design and development of such evaluation models, theories and instruments largely remain outside of Africa, in this article we argue that insofar as some of these approaches address some of the requirements of the Made in Africa evaluation framework, their adaptation to African monitoring and evaluation conditions may equally prove useful where relevant.</p>
</sec>
</sec>
<sec id="s0012">
<title>An overview of the realist evaluation approach</title>
<p>In the explanation of how realist evaluation should be operationalised, Pawson and Tilley (<xref ref-type="bibr" rid="CIT0039">1995</xref>:23) argue, &#x2018;the success of programs will be highly conditional. Things work if the circumstances are right. Effects occur only if the conditions are right, and they may have to be very particular&#x2019;. Understanding the factors that generate this change is within the realist framework. Understanding this &#x2018;generative causation&#x2019; or &#x2018;generative mechanism&#x2019; of a programme is helpful because:</p>
<disp-quote>
<p>&#x2018;Realists conceive of causality in generative terms. Thus, instead of Y simply following X and that being the beginning and end of what can be said, realists consider the causal powers or causal potential that inherent in phenomena and that may be released in some circumstances to produce observable transformations&#x2019;. (Pawson and Tilley <xref ref-type="bibr" rid="CIT0039">1995</xref>:29)</p>
</disp-quote>
<p>The reasoning, norms, beliefs and actions of programme participants are the invisible change factors or mechanisms that lead participants to act in ways that result in the observed outcomes. While the implementation context of a programme might be a school, a hospital or a prison, the realist evaluation framework considers a programme&#x2019;s context in much broader terms. Programme context is an embodiment of &#x2018;prior set of social rules, norms, values and interrelationships&#x2019;, which influences the extent to which a programme will succeed (Pawson and Tilley <xref ref-type="bibr" rid="CIT0038">1997</xref>:70). Considering an Africa-centric evaluation lens, it is reasonable to consider that programme participants, based on some African contexts, might have African philosophical assumptions about phenomena, specific African worldviews unique to their contextual environments, hold specific traditional belief systems, ways of knowing about their lived realities and ways of doing thing. These underlying thought processes will essentially influence how these programme participants engage with any given intervention. Therefore, these contextual factors will inform observed outcomes. In this context, realist evaluation illustrates and exposes the importance of the value system of the programme participants, not simply those of the evaluator, in the success of the evaluation. This a critical value proposition of the realist evaluation framework insofar as it responds to the Africa-centric evaluation perspective.</p>
<p>The emphasis on the generative mechanism in our view, therefore, makes realist evaluation particularly attractive to Africa-centric evaluators. Realist philosophy considers that an intervention is effective because of the decision-making of programme participants. Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>) specify the main features of the realist evaluation technique. Firstly, it is the theory and hypothesis stage; secondly, the data collection stage; thirdly the data analysis stage and finally the theory testing and refinement stage.</p>
</sec>
<sec id="s0013">
<title>Stage 1: Theory and hypothesis</title>
<p>The idea of this initial stage is to formulate a theoretical proposition about what exactly works in an intervention, for whom does it work and critically why or how does it work. Pawson (<xref ref-type="bibr" rid="CIT0037">2006</xref>:25) emphasises that in realist evaluation, three components, namely, context, mechanism and outcome, are critical to facilitate a clear picture of how and why a programme works.</p>
<fig id="F0001">
<label>FIGURE 1</label>
<caption><p>The realist evaluation cycle.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="AEJ-8-508-g001.tif"/>
</fig>
<p>Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>:10&#x2013;11) argues that the cycle starts by &#x2018;eliciting and formalising the programme theories to be tested in CMO terms and what is involved is bringing the imagination to bear in &#x2018;thinking through&#x2019; how a programme works&#x2019;. The key aim is to have &#x2018;a clear understanding of the basic initial programme theory of change. Then various hypotheses of CMOs for potential testing are elicited through workshops with various stakeholders and programme source documents. These conjured hypotheses should at best meet the purpose and evaluation question to be answered&#x2019; (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:65).</p>
<p>In the context of a Made in Africa theoretical framework, this proposition is attractive, given the need for a counterbalance to the enduring tendency for theory and practice of evaluation to be largely centred on and derived from Euro-Western world views and perspectives. Furthermore, the evaluation design and approaches that focus on specific contextual evaluation needs of the continent have potential value.</p>
</sec>
<sec id="s0014">
<title>Stage 2: Data collection</title>
<p>It is claimed that &#x2018;The collection of data and the adopted research methods should be informed by the evaluation question at hand in order to test the theory and effectively answer the evaluation question&#x2019; (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:67). According to Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>:11), data are collected &#x2018;that will allow interrogation of these embryonic hypotheses&#x2019;. The stipulated key outcomes of the programme act as a basis for appropriate data collation on aspects of CMOs. These will include both qualitative and quantitative data. The &#x2018;data collection&#x2019; phase has been fully described elsewhere (see Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:67). In the context of a Made in Africa theoretical framework, the application of various African data collection methods including folklores, music, dance, oral traditions will have validity in answering the research question (Chilisa <xref ref-type="bibr" rid="CIT0011">2015</xref>:15).</p>
</sec>
<sec id="s0015">
<title>Stage 3: Data analysis</title>
<p>The &#x2018;data analysis&#x2019; phase fully described in Mbava (<xref ref-type="bibr" rid="CIT0026">2017</xref>:67) and Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>: 11), serves &#x2018;a whole package of CMOC hypotheses to systematic tests, using data sets assembled in stage 2&#x2019;. The aim is to explore key themes from the collected data. &#x2018;The data analysis aims to test the initial theory against the observed outcome patterns of the programme. These conjectured CMO configurations can be presented in the form of succinct storylines and graphic presentation to facilitate comparison&#x2019; (Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:67). Cognisant that the <italic>lekgotla</italic> supports the data collection and analysis methodology stage in a far more authentic and Africa-centred manner, it can bring the evaluation participants in credible ways to jointly interrogate the emerging outcomes.</p>
</sec>
<sec id="s0016">
<title>Stage 4: Theory testing and refinement</title>
<p>According to Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>:11), the last stage involves &#x2018;the assessment and interpretation of the analysis. Have the theories about how the programme worked been supported or refuted by the proceeding analysis? Based on the research findings, the CMO configurations can be revised and be subjected to a further round of theory testing until the results of the analysis explain the observed variations in outcome patterns&#x2019;. Pawson and Tilley (<xref ref-type="bibr" rid="CIT0036">2004</xref>: 11) emphasise that this phase is an &#x2018;iterative and continuous process that aims to ascertain and explain the specifics of programme mechanism&#x2019;. Having jointly interrogated the emerging outcomes, the evaluation participants in the context of an African <italic>lekgotla</italic> further engage in confirming or adapting the initial programme theory as informed by the evidence which credibly leverages African knowledge systems.</p>
</sec>
<sec id="s0017">
<title>Towards an adapted approach</title>
<p>The realist evaluation approach has notable strengths for the Africa-centric evaluator. Realist evaluation has the advantage of allowing the evaluator to use theory-based approaches to focus an evaluation on key generative mechanisms that explain why programmes work for some people in some contexts, and not for others. This emphasis on context, relationships and the broader social environment is fundamental to an Africa-centric approach.</p>
<p>Research has pointed to some limitations in the effective implementation of a realist evaluation in some African contexts where monitoring and evaluation systems are nascent. To enable its effective implementation, <italic>an adapted realist evaluation cycle</italic> reflected in <xref ref-type="fig" rid="F0002">Figure 2</xref> seeks to address these contextual challenges which are discussed subsequently.</p>
<fig id="F0002">
<label>FIGURE 2</label>
<caption><p>Adapted realist evaluation cycle.</p></caption>
<graphic xmlns:xlink="http://www.w3.org/1999/xlink" xlink:href="AEJ-8-508-g002.tif"/>
</fig>
</sec>
<sec id="s0018">
<title>Lack of quality baseline monitoring data</title>
<p>Firstly our own research indicated that in some African context, evaluations are not successfully realised because of a lack of useful baseline monitoring data (Mbava &#x0026; Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>; Mbava &#x0026; Rabie <xref ref-type="bibr" rid="CIT0029">2018</xref>; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>). Similarly, in many other African contexts, such as in North Africa and Central Africa, evaluations are not adequately implemented (Camron, Mishra &#x0026; Brown <xref ref-type="bibr" rid="CIT0009">2016</xref>:18). This may pose limitations to adequately implementing a realist framework. One sector expert we interviewed summarised this gap in the context of specific types of evaluation such as impact evaluations where it was found that these had some limitations (see Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>:120). To counter this limitation, we suggest as a first step, the integration and entrenchment of foundational monitoring and evaluation systems and processes to enable and rationalise the forthcoming evaluations. This is depicted in <xref ref-type="fig" rid="F0002">Figure 2</xref>.</p>
</sec>
<sec id="s0019">
<title>Differing views on sectoral intervention logic</title>
<p>&#x2018;A programme theory is a set of ideas or hypotheses that explain how and why an intervention will work, perhaps with a specification of why it works for a particular group of people in a particular context&#x2019; (Mbava &#x0026; Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>:3). In our research experience, we have found that while programme pathways to change are an inherent assumption in realist evaluation, at the level of practice there is often an evident &#x2018;lack of consensus about the pathways to change and programme mechanism&#x2019; &#x2013; specifically at public policy sectorial level (Mbava &#x0026; Dahler-Larsen <xref ref-type="bibr" rid="CIT0028">2019</xref>; Mbava &#x0026; Rabie <xref ref-type="bibr" rid="CIT0029">2018</xref>:124; Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>). One expert, for example, commented that &#x2018;Realist Evaluation makes assumptions about theories of change. It assumes that we agree on pathways; however, there is no agreement about intervention logic. There is equally no agreement on mechanism&#x2019; (see Mbava <xref ref-type="bibr" rid="CIT0026">2017</xref>).</p>
<p>In another exercise, we were contracted to assist in a diagnostic evaluation of some of the most important South African national policies and programmes supporting smallholder farmers since 1994 (DPME <xref ref-type="bibr" rid="CIT0019">2016</xref>). Five evaluation reports conducted by separate evaluation teams under the auspices of the National Evaluation Plan were reviewed during this process. The absence of a clearly defined theory of change was noted by the evaluation teams in all five of these reports &#x2013; a phenomenon which observers operating within the National Evaluation System indicated was widespread across sectors. Because of these tensions regarding an intervention logic within a specific policy sector, a sectoral <italic>lekgotla</italic>, which seeks consensus on what that entails, has potential value for prospective evaluation. The second stage of <xref ref-type="fig" rid="F0002">Figure 2</xref> depicts the suggested process to be adopted to achieve better clarity.</p>
<p>To enable its effective implementation and prior to any prospective evaluation, we suggest a prior stage of first embedding foundational systems as depicted in <xref ref-type="fig" rid="F0002">Figure 2</xref>. A second stage will be to convene a sectoral <italic>lekgotla</italic> to agree on that specific sector intervention logic. The <italic>lekgotla</italic> participants inclusive of programme beneficiaries, programme designers, implementers and policy decision makers will seek agreement on sectoral strategic priorities, desired outcomes, the sectoral intervention logic or theory of change and crucially sectoral outcome indicators. Other key participants in this lekgotla will be Parliament Portfolio Committees as these require the evaluative evidence for their oversight role and holding the executive to account. Research by Rabie (<xref ref-type="bibr" rid="CIT0042">2019</xref>) has illustrated the critical role played by Parliament Portfolio Committees in influencing the utilisation of evidence because their buy-in determines the extent of utilisation of evaluation reports.</p>
<p>Considering these findings an adapted realist evaluation cycle that could potentially be implemented in some African monitoring and evaluation contexts is depicted in <xref ref-type="fig" rid="F0002">Figure 2</xref>. We argue that these initial stages will go a long way in facilitating the seamless implementation of the realist evaluation cycle. Informed by the existing monitoring and evaluation conditions in a specific context, these two stages may prove necessary in fledgling monitoring and evaluation environments. On the other hand, where systems are resilient and foundational systems are embedded, these two stages may not be a requirement. Therefore, the application of the adapted model is not prescriptive and should rather be informed by practice.</p>
</sec>
<sec id="s0020">
<title>Implications and way forward</title>
<p>We propose that the adaptation of Euro-Western evaluation models, theories and instruments, as a continuum towards indigenising evaluation theory and practice from an African context, may prove useful where relevant. It is suggested that such adaptation is, however, only useful insofar as it addresses some of the requirements of the Made in Africa evaluation framework. The realist evaluation approach provides notable strengths for the Africa-centric evaluator to explain why programmes work for some people in some contexts, and not for others. This emphasis on context, relationships and the broader social environment addresses some of the requirements of the Made in Africa evaluation framework.</p>
<p>An important limitation and challenge is that the actual empirical application of this model has not yet been tested. This will be a priority for our own evaluation practice moving forward, and we encourage other evaluators working in African contexts to take up the challenge of putting this adapted realist evaluation research technique into practice. Such an illustrative application could further strengthen or point to further gaps of the proposed model.</p>
</sec>
</body>
<back>
<ack>
<title>Acknowledgements</title>
<sec id="s20021" sec-type="COI-statement">
<title>Competing interests</title>
<p>The authors have declared that no competing interest exists.</p>
</sec>
<sec id="s20022">
<title>Authors&#x2019; contributions</title>
<p>All authors contributed equally to this work.</p>
</sec>
<sec id="s20023">
<title>Funding information</title>
<p>This research received no specific grant from any funding agency in the public, commercial or not-for-profit sectors.</p>
</sec>
<sec id="s20024">
<title>Data availability statement</title>
<p>Data sharing is not applicable to this article as no new data were created or analysed in this study.</p>
</sec>
<sec id="s20025">
<title>Disclaimer</title>
<p>The views and opinions expressed in this article are those of the authors and do not necessarily reflect the official policy or position of any affiliated agency of the authors.</p>
</sec>
</ack>
<ref-list id="references">
<title>References</title>
<ref id="CIT0001"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Abrahams</surname>, <given-names>M.A</given-names></string-name>.</person-group>, <year>2015</year>, &#x2018;<article-title>A review of the growth of monitoring and evaluation in South Africa: Monitoring and evaluation as a profession, an industry and a governance tool</article-title>&#x2019;, <source><italic>African Evaluation Journal</italic></source> <volume>3</volume>(<issue>1</issue>), <comment>Art. #142, 8 pages. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/aej.v3i1.142">https://doi.org/10.4102/aej.v3i1.142</ext-link></comment></mixed-citation></ref>
<ref id="CIT0002"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Alkin</surname>, <given-names>M.C</given-names></string-name>.</person-group>, <year>1990</year>, <source><italic>Debates on evaluation</italic></source>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Newbury Park, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0003"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>African Evaluation Association</collab></person-group>, <year>2007</year>, <source><italic>Special stream statement</italic></source>, <comment>viewed n.d., from <ext-link ext-link-type="uri" xlink:href="http://vopetoolkit.ioce.net/sites/default/files/resources/3.8e3&#x0025;20PUB_Special&#x0025;20Stream&#x0025;20Statement.pdf">http://vopetoolkit.ioce.net/sites/default/files/resources/3.8e3&#x0025;20PUB_Special&#x0025;20Stream&#x0025;20Statement.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0004"><mixed-citation publication-type="web"><person-group person-group-type="author"><collab>African Evaluation Association</collab></person-group>, <year>2019</year>, <source><italic>9th African Evaluation Association international conference declaration</italic></source>, <comment>viewed n.d., from <ext-link ext-link-type="uri" xlink:href="https://afrea.org/2019conference/afrea-declaration/">https://afrea.org/2019conference/afrea-declaration/</ext-link></comment></mixed-citation></ref>
<ref id="CIT0005"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Bamberger</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>2008</year>, &#x2018;<chapter-title>Enhancing the utilization of evaluations for evidence-based policy-making</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><surname>Segone</surname>, <given-names>M</given-names></string-name>. (ed.)</person-group>, <source><italic>Bridging the gap: The role of monitoring and evaluation in evidence-based policy-making</italic></source> (<issue>120&#x2013;142</issue>). <comment>(Evaluation Working Paper #12)</comment>, <publisher-name>UNICEF</publisher-name>, New<publisher-loc> York, NY</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0006"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Briggs</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>2013</year>, &#x2018;<article-title>Indigenous knowledge: A false dawn for development theory and practice?</article-title>&#x2019; <source><italic>Progress in Development Studies</italic></source> <volume>13</volume>(<issue>3</issue>), <fpage>231</fpage>&#x2013;<lpage>243</lpage>.</mixed-citation></ref>
<ref id="CIT0007"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Bisgard</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>2017</year>, <source><italic>Demystifying monitoring and evaluation</italic></source>, <comment>viewed n.d., from <ext-link ext-link-type="uri" xlink:href="https://trialogue.co.za/demystifying-monitoring-and-evaluation/#">https://trialogue.co.za/demystifying-monitoring-and-evaluation/#</ext-link></comment></mixed-citation></ref>
<ref id="CIT0008"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Carden</surname>, <given-names>F</given-names></string-name>. &#x0026; <string-name><surname>Alkin</surname>, <given-names>M.C</given-names></string-name>.</person-group>, <year>2012</year>, &#x2018;<article-title>Evaluation roots: An international perspective</article-title>&#x2019;, <source><italic>Journal of Multi-Disciplinary Evaluation</italic></source>, <volume>8</volume>(<issue>17</issue>), <fpage>102</fpage>&#x2013;<lpage>118</lpage>.</mixed-citation></ref>
<ref id="CIT0009"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cameron</surname>, <given-names>D.B</given-names></string-name>., <string-name><surname>Mishra</surname>, <given-names>A</given-names></string-name>. &#x0026; <string-name><surname>Brown</surname>, <given-names>A.N</given-names></string-name>.</person-group>, <year>2016</year>, &#x2018;<article-title>The growth of impact evaluation for international development: how much have we learned?</article-title>&#x2019; <source><italic>Journal of Development Effectiveness</italic></source>, <volume>8</volume>(<issue>1</issue>), <fpage>1</fpage>&#x2013;<lpage>21</lpage>.</mixed-citation></ref>
<ref id="CIT0010"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chilisa</surname>, <given-names>B</given-names></string-name>., <string-name><surname>Major</surname>, <given-names>T.E</given-names></string-name>., <string-name><surname>Gaotlhobogwe</surname>, <given-names>M</given-names></string-name>. &#x0026; <string-name><surname>Mokgolodi</surname>, <given-names>H</given-names></string-name>.</person-group>, <year>2016</year>, &#x2018;<article-title>Decolonizing and indigenizing evaluation practice in Africa: Toward African relational evaluation approaches</article-title>&#x2019;, <source><italic>Canadian Journal of Program Evaluation</italic></source>, <volume>30</volume>(<issue>3</issue>), <fpage>313</fpage>&#x2013;<lpage>328</lpage>.</mixed-citation></ref>
<ref id="CIT0011"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Chilisa</surname>, <given-names>B</given-names></string-name>.</person-group>, <year>2015</year>, <source><italic>A synthesis paper on the Made in Africa evaluation concept: Commissioned by African Evaluation Association (AfrEA)</italic></source>, <comment>from <ext-link ext-link-type="uri" xlink:href="https://afrea.org/wp-content/uploads/2018/06/MAE2-Final-31st-august.pdf">https://afrea.org/wp-content/uploads/2018/06/MAE2-Final-31st-august.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0012"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Chilisa</surname>, <given-names>B</given-names></string-name>. &#x0026; <string-name><surname>Malunga</surname>, <given-names>C</given-names></string-name>.</person-group>, <year>2012</year>, <source><italic>Made in Africa evaluation: Uncovering African roots in evaluation theory and practice</italic></source>, <fpage>32</fpage>&#x2013;<lpage>38</lpage>. <comment>In Bellagio Report. 2013</comment>. <source><italic>The Bellagio Report</italic></source>. <comment>African Thought Leaders Forum on Evaluation and Development: Expanding Leadership in Africa</comment>. <publisher-name>The Bellagio Centre</publisher-name>, <comment>from <ext-link ext-link-type="uri" xlink:href="http://www.clear-aa.co.za/wp-content/uploads/2013/09/Bellagio-Report-Vs-Apr-14.pdf">http://www.clear-aa.co.za/wp-content/uploads/2013/09/Bellagio-Report-Vs-Apr-14.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0013"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Chilisa</surname>, <given-names>B</given-names></string-name>. &#x0026; <string-name><surname>Kawulich</surname>, <given-names>B.B</given-names></string-name>.</person-group>, <year>2012</year>, &#x2018;<chapter-title>Selecting a research approach: Paradigm, methodology and methods</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><surname>Wagner</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Kawulich</surname>, <given-names>B.B</given-names></string-name>. &#x0026; <string-name><surname>Garner</surname>, <given-names>M</given-names></string-name>. (eds.)</person-group>, <source><italic>Doing social research: A global context</italic></source> (pp. <fpage>51</fpage>&#x2013;<lpage>61</lpage>), <publisher-name>McGraw Hill</publisher-name>, <publisher-loc>London, UK</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0014"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Chouinard</surname>, <given-names>J.A</given-names></string-name> &#x0026; <string-name><surname>Hopson</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>2016</year>, &#x2018;<article-title>Critical exploration of culture in international development evaluation</article-title>&#x2019;, <source><italic>Canadian Journal of Program Evaluation</italic></source>, <volume>30</volume>(<issue>3</issue>), <fpage>248</fpage>&#x2013;<lpage>276</lpage>.</mixed-citation></ref>
<ref id="CIT0015"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cloete</surname>, <given-names>F</given-names></string-name>.</person-group>, <year>2016</year>, &#x2018;<article-title>Developing an Africa-rooted programme evaluation approach</article-title>&#x2019;, <source><italic>African Journal of Public Affairs</italic></source>, <volume>9</volume>(<issue>4</issue>), <fpage>55</fpage>&#x2013;<lpage>70</lpage>.</mixed-citation></ref>
<ref id="CIT0016"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Cram</surname>, <given-names>F</given-names></string-name>., <string-name><surname>Tibbetts</surname>, <given-names>K.A</given-names></string-name>. &#x0026; <string-name><surname>LaFrance</surname>, <given-names>J</given-names></string-name>.</person-group>, <year>2018</year>, &#x2018;<article-title>Editors&#x2019; notes: A stepping stone in indigenous evaluation</article-title>&#x2019;, <source><italic>Evaluation</italic></source>, <volume>2018</volume>: <fpage>7</fpage>&#x2013;<lpage>16</lpage>. doi:<pub-id pub-id-type="doi">10.1002/ev.20327</pub-id></mixed-citation></ref>
<ref id="CIT0017"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dahler-Larsen</surname>, <given-names>P</given-names></string-name>.</person-group>, <year>2019</year>, <source><italic>Quality: From Plato to performance</italic></source>. <publisher-name>Palgrave Macmillan</publisher-name>, <publisher-loc>London, United Kingdom</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0018"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Dahler-Larsen</surname>, <given-names>P</given-names></string-name>.</person-group>, <year>2011</year>, <source><italic>The evaluation society</italic></source>. <publisher-name>Stanford University Press</publisher-name>, <publisher-loc>Stanford, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0019"><mixed-citation publication-type="book"><person-group person-group-type="author"><collab>DPME</collab></person-group>, <year>2016</year>, <source><italic>Diagnostic evaluation of the government-supported smallholder farmer sector</italic></source>. <publisher-name>Department of Planning, Monitoring &#x0026; Evaluation</publisher-name>, <comment>viewed n.d., from <ext-link ext-link-type="uri" xlink:href="https://evaluations.dpme.gov.za/evaluations/520">https://evaluations.dpme.gov.za/evaluations/520</ext-link></comment></mixed-citation></ref>
<ref id="CIT0020"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Fournier</surname>, <given-names>D</given-names></string-name>.</person-group>, <year>2005</year>, &#x2018;<chapter-title>Evaluation</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>S.</given-names> <surname>Mathison</surname></string-name> (ed.)</person-group>, <source><italic>Encyclopaedia of Evaluation</italic></source>, pp <fpage>140</fpage>&#x2013;<lpage>141</lpage>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0021"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>House</surname>, <given-names>E</given-names></string-name>.</person-group>, <year>1993</year>, <source><italic>Professional evaluation: Social impact and political consequences</italic></source>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Newbury Park, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0022"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Laher</surname>, <given-names>S</given-names></string-name>., <string-name><surname>Fynn</surname>, <given-names>A</given-names></string-name>. &#x0026; <string-name><surname>Kramer</surname>, <given-names>S</given-names></string-name>.</person-group>, <year>2019</year>, &#x2018;<chapter-title>Transforming research methods in the social sciences: Case studies from South Africa</chapter-title>&#x2019;, <publisher-name>University of the Witwatersrand, Wits University Press</publisher-name>.</mixed-citation></ref>
<ref id="CIT0023"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Lincoln</surname>, <given-names>Y.S</given-names></string-name>. &#x0026; <string-name><surname>Guba</surname>, <given-names>E.G</given-names></string-name>.</person-group>, <year>1986</year>, &#x2018;<article-title>But is it rigorous? Trustworthiness and authenticity in naturalistic evaluation</article-title>&#x2019;, <source><italic>New Directions for Programme Evaluation</italic></source>, <volume>30</volume>, <fpage>73</fpage>&#x2013;<lpage>84</lpage>.</mixed-citation></ref>
<ref id="CIT0024"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mamdani</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>2016</year>, &#x2018;<article-title>Between the public intellectual and the scholar: Decolonization and some post-independence initiatives in African higher education</article-title>&#x2019;, <source><italic>Inter-Asia Cultural Studies</italic></source>, <volume>17</volume>(<issue>1</issue>), <fpage>68</fpage>&#x2013;<lpage>83</lpage>.</mixed-citation></ref>
<ref id="CIT0025"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mark</surname>, <given-names>M.M</given-names></string-name>., <string-name><surname>Henry</surname>, <given-names>G.T</given-names></string-name>. &#x0026; <string-name><surname>Julnes</surname>, <given-names>G</given-names></string-name>.</person-group>, <year>1999</year>, &#x2018;<article-title>Toward an integrative framework for evaluation practice</article-title>&#x2019;. <source><italic>American Journal of Evaluation</italic></source>, <volume>20</volume>(<issue>2</issue>), <fpage>177</fpage>&#x2013;<lpage>198</lpage>.</mixed-citation></ref>
<ref id="CIT0026"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Mbava</surname>, <given-names>P.N</given-names></string-name>.</person-group>, <year>2017</year>, &#x2018;<italic>The potential value of the realist evaluation method in programme impact evaluations in South Africa</italic>&#x2019;, <comment>Unpublished PhD dissertation</comment>, <publisher-name>Stellenbosch University</publisher-name>, <publisher-loc>Bellville</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0027"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Mbava</surname>, <given-names>N</given-names></string-name>.</person-group>, <year>2019</year>, &#x2018;<chapter-title>Shifting the status quo: Africa influencing global evaluation</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>J.</given-names> <surname>Musumba</surname></string-name> (ed.)</person-group>, <source><italic>Made in Africa Evaluations. Volume 1: Theoretical Approaches</italic></source>, pp. <fpage>12</fpage>&#x2013;<lpage>21</lpage>, <publisher-name>African Development Bank Evaluation Matters</publisher-name>, <comment>Quarter 3</comment>.</mixed-citation></ref>
<ref id="CIT0028"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mbava</surname>, <given-names>N.P</given-names></string-name>. &#x0026; <string-name><surname>Dahler-Larsen</surname>, <given-names>P</given-names></string-name>.</person-group>, <year>2019</year>, &#x2018;<article-title>Evaluation in African contexts: The promises of participatory approaches in theory-based evaluations</article-title>&#x2019;, <source><italic>African Evaluation Journal</italic></source> <volume>7</volume>(<issue>1</issue>), <fpage>a383</fpage>. <comment><ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/aej.v7i1.383">https://doi.org/10.4102/aej.v7i1.383</ext-link></comment></mixed-citation></ref>
<ref id="CIT0029"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Mbava</surname>, <given-names>P.N</given-names></string-name>. &#x0026; <string-name><surname>Rabie</surname>, <given-names>B</given-names></string-name>.</person-group>, <year>2018</year>, &#x2018;<article-title>Strengthening impact evaluations in the South African National evaluation system</article-title>&#x2019;, <source><italic>Administratio Publica</italic></source> <volume>92</volume>(<issue>26</issue>), <fpage>75</fpage>&#x2013;<lpage>98</lpage>.</mixed-citation></ref>
<ref id="CIT0030"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Mouton</surname>, <given-names>C</given-names></string-name>.</person-group>, <year>2010</year>, &#x2018;<article-title>The history of programme evaluation in South Africa</article-title>&#x2019;, <comment>Unpublished MPhil dissertation</comment>, <publisher-name>Stellenbosch University</publisher-name>, <publisher-loc>Bellville</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0031"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Mouton</surname>, <given-names>C</given-names></string-name>., <string-name><surname>Rabie</surname>, <given-names>B</given-names></string-name>., <string-name><surname>Cloete</surname>, <given-names>F</given-names></string-name>. &#x0026; <string-name><surname>De Coning</surname>, <given-names>C</given-names></string-name>.</person-group>, <year>2014</year>, &#x2018;<chapter-title>Historical development &#x0026; practice of evaluation</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>F.</given-names> <surname>Cloete</surname></string-name>, <string-name><given-names>B.</given-names> <surname>Rabie</surname></string-name> and <string-name><given-names>C.</given-names> <surname>De Coning</surname></string-name> (eds.)</person-group>, <source><italic>Evaluation Management in South Africa and Africa</italic></source>, <publisher-name>African Sun Media, Stellenbosch</publisher-name>, <publisher-loc>South Africa</publisher-loc>, pp. <fpage>28</fpage>&#x2013;<lpage>78</lpage>.</mixed-citation></ref>
<ref id="CIT0032"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ndlovu-Gatsheni</surname>, <given-names>S.J</given-names></string-name>.</person-group>, <year>2015</year>, &#x2018;<article-title>Genealogies of coloniality and implications for Africa&#x2019;s development</article-title>&#x2019;, <source><italic>Africa Development</italic></source>, <volume>XL</volume>(<issue>3</issue>), <fpage>13</fpage>&#x2013;<lpage>40</lpage>.</mixed-citation></ref>
<ref id="CIT0033"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Ofir</surname>, <given-names>Z</given-names></string-name>.</person-group>, <year>2013</year>, &#x2018;<article-title>Strengthening evaluation for development</article-title>&#x2019;, <source><italic>American Journal of Evaluation</italic></source>, <volume>34</volume>, <fpage>582</fpage>&#x2013;<lpage>586</lpage>.</mixed-citation></ref>
<ref id="CIT0034"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Ofir</surname>, <given-names>Z</given-names></string-name>. &#x0026; <string-name><surname>Kumar</surname>, <given-names>S</given-names></string-name>.</person-group>, <year>2013</year>, <chapter-title>Evaluation in developing countries: What makes it different?</chapter-title> In <person-group person-group-type="editor"><string-name><given-names>S.I.</given-names> <surname>Donaldson</surname></string-name>, <string-name><given-names>T.</given-names> <surname>Azzam</surname></string-name> &#x0026; <string-name><given-names>R.F.</given-names> <surname>Conner</surname></string-name> (eds.)</person-group>, <source><italic>Emerging practices in international development evaluation</italic></source>, pp. <fpage>11</fpage>&#x2013;<lpage>24</lpage>, <publisher-name>Information Age</publisher-name>, <publisher-loc>Charlotte, NC</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0035"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Patton</surname>, <given-names>M.Q</given-names></string-name>.</person-group>, <year>2008</year>, <source><italic>Utilization-focused evaluation</italic></source>, (<edition>4th</edition> ed.), <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0036"><mixed-citation publication-type="web"><person-group person-group-type="author"><string-name><surname>Pawson</surname>, <given-names>R</given-names></string-name>. &#x0026; <string-name><surname>Tilley</surname>, <given-names>N</given-names></string-name>.</person-group>, <year>2004</year>, <source><italic>Realist Evaluation</italic></source>, <comment>viewed 01 August 2016, from <ext-link ext-link-type="uri" xlink:href="http://www.communitymatters.com.au/RE_chapter.pdf">http://www.communitymatters.com.au/RE_chapter.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0037"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Pawson</surname>, <given-names>R</given-names></string-name>.</person-group>, <year>2006</year>, <source>Evidence-based policy: A realist perspective</source>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>London, UK</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0038"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Pawson</surname>, <given-names>R</given-names></string-name>. &#x0026; <string-name><surname>Tilley</surname>, <given-names>N</given-names></string-name>.</person-group>, <year>1997</year>, <source><italic>Realistic evaluation</italic></source>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>London, UK</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0039"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Pawson</surname>, <given-names>R</given-names></string-name>. &#x0026; <string-name><surname>Tilley</surname>, <given-names>N</given-names></string-name>.</person-group>, <year>1995</year>, &#x2018;<article-title>Whither (European) evaluation methodology?</article-title>&#x2019;, <source><italic>Knowledge and Policy: The International Journal of Knowledge Transfer and Utilization</italic></source>, <volume>8</volume>(<issue>3</issue>), <fpage>20</fpage>&#x2013;<lpage>33</lpage>.</mixed-citation></ref>
<ref id="CIT0040"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Pienaar</surname>, <given-names>A.J</given-names></string-name>.</person-group>, <year>2015</year>, &#x2018;<chapter-title>African indigenous methodology in qualitative research: The lekgotla &#x2013; a holistic approach of data collection and analysis intertwined</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>M.</given-names> <surname>de Chesnay</surname></string-name> (ed.)</person-group>, <source>Nursing research using data analysis: Qualitative designs and methods in nursing</source>, pp. <fpage>57</fpage>&#x2013;<lpage>67</lpage>, <publisher-name>Springer</publisher-name>, <publisher-loc>New York, NY</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0041"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Porter</surname>, <given-names>S</given-names></string-name>. &#x0026; <string-name><surname>Goldman</surname>, <given-names>I</given-names></string-name>.</person-group>, <year>2013</year>, &#x2018;<article-title>A growing demand for monitoring and evaluation in Africa</article-title>&#x2019;, <source><italic>African Evaluation Journal</italic></source> <volume>1</volume>(<issue>1</issue>), <fpage>10</fpage>&#x2013;<lpage>18</lpage>.</mixed-citation></ref>
<ref id="CIT0042"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rabie</surname>, <given-names>B</given-names></string-name>.</person-group>, <year>2019</year>, &#x2018;<article-title>The most influential decision-making criteria in South African Parliamentary Committees</article-title>&#x2019;, <source><italic>Administratio Publica</italic></source> <volume>27</volume>(<issue>4</issue>), <fpage>26</fpage>&#x2013;<lpage>46</lpage>.</mixed-citation></ref>
<ref id="CIT0043"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Rabie</surname>, <given-names>B</given-names></string-name>. &#x0026; <string-name><surname>Cloete</surname>, <given-names>F</given-names></string-name>.</person-group>, <year>2009</year>, &#x2018;<article-title>A new typology of monitoring and evaluation approaches</article-title>&#x2019;, <source><italic>Administratio Publica</italic></source> <volume>17</volume>(<issue>3</issue>), <fpage>76</fpage>&#x2013;<lpage>97</lpage>.</mixed-citation></ref>
<ref id="CIT0044"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Rossi</surname>, <given-names>P.H</given-names></string-name>., <string-name><surname>Freeman</surname>, <given-names>H.E</given-names></string-name>. &#x0026; <string-name><surname>Lipsey</surname>, <given-names>M.W</given-names></string-name>.</person-group>, <year>2004</year>, <source><italic>Evaluation: A systematic approach</italic></source>, <edition>7th</edition> edition, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0045"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Rossi</surname>, <given-names>P.H</given-names></string-name>. &#x0026; <string-name><surname>Freeman</surname>, <given-names>H.E</given-names></string-name>.</person-group>, <year>1993</year>, <source><italic>Evaluation: A systematic approach</italic></source> (<edition>5th</edition> ed.), <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Newbury Park, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0046"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Shadish</surname>, <given-names>W.R</given-names></string-name>. &#x0026; <string-name><surname>Luellen</surname>, <given-names>J.K</given-names></string-name>.</person-group>, <year>2011</year>, <source><italic>History of evaluation</italic></source>, in <person-group person-group-type="editor"><string-name><given-names>S.</given-names> <surname>Mathison</surname></string-name> (ed.)</person-group>, <source><italic>Encyclopedia of evaluation</italic></source>, pp. <fpage>184</fpage>&#x2013;<lpage>186</lpage>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0047"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Scriven</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>1997</year>, &#x2018;<chapter-title>Truth and objectivity in evaluation</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>E.</given-names> <surname>Chelimsky</surname></string-name> &#x0026; <string-name><given-names>W.R.</given-names> <surname>Shadish</surname></string-name> (eds.)</person-group>, <source><italic>Evaluation for the 21st century: A handbook</italic></source>, pp. <fpage>477</fpage>&#x2013;<lpage>501</lpage>, <publisher-name>Sage Publications</publisher-name>, <publisher-loc>Thousand Oaks, CA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0048"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Scriven</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>1999</year>, &#x2018;<article-title>The fine line between evaluation and explanation</article-title>&#x2019;, <source><italic>Research on Social Work Practice</italic></source> <volume>9</volume>(<issue>4</issue>), <fpage>521</fpage>&#x2013;<lpage>524</lpage>.</mixed-citation></ref>
<ref id="CIT0049"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Scriven</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>2003</year>, &#x2018;<article-title>Michael Scriven on the differences between Evaluation and Social Science Research</article-title>&#x2019;, <source><italic>The Evaluation Exchange</italic></source>, <volume>IX</volume>(<issue>4</issue>), <fpage>7</fpage>, <comment>viewed n.d., from <ext-link ext-link-type="uri" xlink:href="https://archive.globalfrp.org/var/hfrp/storage/original/application/f1be9c61c5a4011b6637bb5d1a3190ed.pdf">https://archive.globalfrp.org/var/hfrp/storage/original/application/f1be9c61c5a4011b6637bb5d1a3190ed.pdf</ext-link></comment></mixed-citation></ref>
<ref id="CIT0050"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>SenGupta</surname>, <given-names>S</given-names></string-name>., <string-name><surname>Hopson</surname>, <given-names>R</given-names></string-name>. &#x0026; <string-name><surname>Thompson-Robinson</surname>, <given-names>M</given-names></string-name>.</person-group>, <year>2004</year>, <article-title>Cultural competence in evaluation: An overview</article-title>&#x2019;, <source><italic>New Directions for Evaluation</italic></source> <volume>102</volume>, <fpage>5</fpage>&#x2013;<lpage>19</lpage>.</mixed-citation></ref>
<ref id="CIT0051"><mixed-citation publication-type="journal"><person-group person-group-type="author"><string-name><surname>Stufflebeam</surname>, <given-names>D.L</given-names></string-name>.</person-group>, <year>2001</year>, &#x2018;<article-title>Evaluation models</article-title>&#x2019;, <source><italic>New Direction for Evaluation</italic></source> <volume>89</volume>, <fpage>7</fpage>&#x2013;<lpage>98</lpage>.</mixed-citation></ref>
<ref id="CIT0052"><mixed-citation publication-type="book"><person-group person-group-type="author"><string-name><surname>Weiss</surname>, <given-names>C.H</given-names></string-name>.</person-group>, <year>2004</year>, &#x2018;<chapter-title>Rooting for evaluation: A cliff notes version of my work</chapter-title>&#x2019;, in <person-group person-group-type="editor"><string-name><given-names>M.C.</given-names> <surname>Alkin</surname></string-name> (ed.)</person-group>. <source><italic>Evaluation roots: Tracing theorists&#x2019; views and influences</italic></source>, pp. <fpage>154</fpage>&#x2013;<lpage>169</lpage>, <publisher-name>Sage Publications, University of California</publisher-name>, <publisher-loc>LA</publisher-loc>.</mixed-citation></ref>
<ref id="CIT0053"><mixed-citation publication-type="thesis"><person-group person-group-type="author"><string-name><surname>Wildschut</surname>, <given-names>L.P</given-names></string-name>.</person-group>, <year>2014</year>, <source><italic>Theory-based evaluation, logic modelling and the experience of SA non-governmental organisations</italic></source> <comment>(PhD dissertation)</comment>, <publisher-name>Stellenbosch University</publisher-name>, <publisher-loc>Bellville</publisher-loc>.</mixed-citation></ref>
</ref-list>
<fn-group>
<fn><p><bold>How to cite this article:</bold> Mbava, N.P. &#x0026; Chapman, S., 2020, &#x2018;Adapting realist evaluation for Made in Africa evaluation criteria&#x2019;, <italic>African Evaluation Journal</italic> 8(1), a508. <ext-link ext-link-type="uri" xlink:href="https://doi.org/10.4102/aej.v8i1.508">https://doi.org/10.4102/aej.v8i1.508</ext-link></p></fn>
</fn-group>
</back>
</article>