In response to the enduring social, economic and environmental challenges facing the African continent and its population, development interventions are evolving to embrace new approaches, new partnerships and new means of achieving impact. One such area of heightened innovation and growing activity is impact investing. Impact investing is defined as investments made with the intention of generating both financial return and social or environmental impact. As this momentum in impact investing grows, a complementary area of activity has started to put down roots in Africa – social impact measurement.
Genesis Analytics curated and managed the Innovations in Evaluation strand at the recent African Evaluation Association Conference, convened in Uganda in March 2017. This strand was supported by the Rockefeller Foundation and aimed to ignite conversations between impact investment stakeholders and evaluators focused on the African experience with social impact measurement.
This article presents themes emerging from the presentations and conversations within the Innovations in Evaluation strand. The article begins with a brief explanation of the rise of impact investing, globally and within Africa, and then goes on to explain the structure of the Innovations in Evaluation strand. This strand included small group discussions and a think tank, which enabled sharing of ideas and experiences between strand participants. The article, therefore, documents the issues emerging during these discussions, including exploration of the concept of impact measurement and how this understanding differs across stakeholders, the currency of impact measurement and emerging practice.
The article concludes with presenting what stakeholders and evaluators need to jointly explore to ensure that the African experience is well represented as the impact measurement movement continues to gain momentum globally.
The 2017 African Evaluation Association (AfrEA) Conference’s theme centred on the ‘Evaluation of the Sustainable Development Goals (SDGs): Opportunities and Challenges for Africa’. Genesis Analytics, supported by the Rockefeller Foundation, curated the Innovations in Evaluation strand at the conference, which aimed to explore the emergence of social impact measurement, as well as to facilitate dialogue between evaluators, investors and other practitioners working within impact investing.
The challenges on the African continent have been exacerbated by multiple crises: widespread unemployment, political instability, food insecurity and natural disasters resulting from increasing climate change. While these challenges have persisted for multiple decades, development interventions, over time, have become more cognisant of this complexity. As a result, the nature of poverty alleviation interventions across Africa often involves multiple components, multiple levels of implementation, multiple implementing agencies with multiple agendas and long causal chains with many intermediate outcomes. As a result, the complexity of evaluating such interventions is being increasingly acknowledged by members of the evaluation community, and hence there is more frequent engagement with systems thinking and complexity theory.
In addition, development interventions have evolved to embrace new approaches, new partnerships and new means of achieving impact (KPMG International
The Innovations in Evaluation strand at the 8th AfrEA Conference
The New Forces in Development substrand highlighted the emergence of impact investing in Africa and how this new trend combines market forces with social goals in a traditional ‘developmental’ context. Financing the ambitious new global development agenda of the SDGs requires a significant increase in resources; further, the mobilisation of the required resources is far beyond what could be allocated via development assistance (IDEAS
Moreover, over the last decade, the role of the private sector, the value of systemic impact and the potential of impact investing have deepened in importance. While these developments are by no means new, there is a growing recognition that despite the need for measurement and evaluation within these kinds of interventions, conventional evaluation approaches are slow to respond (Innovations for Poverty Action
As the impact investing landscape in Africa evolves and matures, it is accompanied by increasing diversity of instruments in use and market players involved. Through this maturation process, there is still further growth needed for social impact measurement that is creative, nimble and ‘fit for purpose’. This offers opportunities for evaluators to begin to explore African perspectives and experiences with social impact measurement. A discussion on impact investing, hybrid funds, co-mingling funds, social impact bonds and public–private partnerships (PPPs) brought attention to how these new forces are entirely compatible and complementary. Through four parallel sessions, participants explored impact investing, complexity, market systems innovation and PPPs, as well as the measurement and evaluation of these approaches.
This article begins by defining
As a result of mounting social challenges in today’s world, coupled with dwindling public funds, new and innovative approaches are needed to address social and environmental challenges (OECD
Within impact investing, non-traditional market players, such as impact investors, are investing in companies, organisations and funds with the intention to generate social and environmental impact alongside a financial return. It is helpful to look at impact investing and its relationship to both traditional investing and traditional philanthropy in the context of a two-by-two matrix, along the dimensions of financial return and social impact (
Impact investing in the context of desired outcomes.
Impact investing solutions include the use of financing mechanisms to mobilise private sector capital in new and more efficient ways for projects to create a more resilient and inclusive world. They are not meant to replace but rather to complement traditional resource flows such as aid, foreign direct investment and remittances. Impact investing therefore has the ability to mobilise the additional resources needed for eliminating poverty, raising living standards and protecting the environment.
In the last decade and across the globe, there has been an exponential increase in the number of impact investors and the pool of funds available for social impact. In Africa, impact investment as a practice remains nascent, and as the total pool of funds available for social impact continues to rise, it is beginning to significantly contribute to the continent’s economic growth and development objectives (United Nations Development Programme
In the financial year of 2017, over $400 billion in financial assets were directed to investing for impact across Southern Africa, East Africa and West Africa (
Total pool of funds directed to impact investing in Africa.
As the volumes for impact investing have grown over time, discussions about the importance of social performance measurement alongside financial indicators have accelerated (Rockefeller Foundation
Industry observers So and Staskevicius amplified the need to strengthen the measurement of impact investing when they stated:
We believe that informal, inconsistent, and weak impact measurement methods could be a real constraint to the growth of the impact investing sector and its prospects to create real social change … we also believe that the term ‘impact investing’ runs the risk of being diluted and used as a marketing tool if a certain level of rigor in impact measurement is not established in the industry. (So & Staskevicius
The increase in the volume of funds available for social impact also indicates the growing importance of the impact investing market because of its unprecedented focus on impact measurement amongst non-traditional market players. This focus is based on the recognition that there is a need to understand the financial and social return on these investments; because impact investing is a relatively new industry, data on activity and performance can play an important role in developing and growing the industry (OECD
Moreover, just like traditional approaches to measuring financial performance, it is imperative for impact investors to measure their social impact rigorously. Social impact measurement is important for the legitimacy and advancement of the field of impact investing: not only will rigorous measurement allow the organisations to understand the impact of their work against the social and environmental goals they set, as a means of holding themselves accountable towards those goals, but it is also needed to allow the organisation to utilise this data to drive value creation at the level of the investee, the investor (and their boards) and the broader market (Mudaliar et al.
In addition to this, social impact measurement is needed for improved investment management amongst existing investors and to attract new investors (McCreless et al.
The impacting investing community has made significant strides towards developing tools for assessing social impact (Bannick & Goldman
The current practice of social impact measurement is extremely varied and further complicated by a myriad of approaches, methods and tools, reflecting the diverse needs of stakeholders (Costa & Pesci
How social impact measurement tools and methods fit into a theory of change.
In order to capitalise on the currency of social impact measurement, there is a need to bridge the gap between investors and development practitioners or evaluators where the ideas from each of these fields can be shared with one another. These ideas can then be adapted and contextualised to be useful and take impact investing to the next level, where not only can impact be measured but investments can be targeted effectively and appropriately.
Broadly, impact measurement is concerned with collecting, analysing and communicating the environmental and social impact of an impact investment. However, in line with the literature on social impact measurement, it has become clear that the conceptual definition of
Despite these differences in the definition of impact between stakeholder groups, there is considerable agreement amongst them that it is important to measure impact. A case in point is that, when the Aspen Network of Development Entrepreneurs (ANDE)
Khatuchi Khasandi, presenting on behalf of ANDE, described how ANDE seeks to measure impact to fulfil three main objectives:
ANDE often hears from their member organisations that evaluation is expensive and time-consuming. However, ANDE carried out a survey amongst their member organisations and found that while 80% of them collect data, only 20% of them actually analyse this data. As a result, ANDE is pushing its members to move away from collecting large volumes of data towards collecting the right data, particularly data relating to the changes experienced in people’s lives using consistent metrics like IRIS (Khatuchi Khasandi, presenting at the 8th AfrEA Conference
ANDE argues that there is a need for knowledge sharing between evaluators and investors on how impact can be measured. For instance, some impact investors may think that the only option to evaluate impact is through randomised control trials (RCTs). Given the cost, scale and potential drawbacks of having to withhold interventions (e.g. in the form of products and services) from a group of people who would make up the control group or counterfactual, RCTs are not easily implemented in most impact investment portfolios. The misinformation that RCTs are the most rigorous option may prevent investors from embracing social impact measurement, especially where it is unethical or undesirable to randomly select a treatment and control group (Khatuchi Khasandi, presenting at the 8th AfrEA Conference
Innovations in Evaluation strand participant Susan de Witt is the Impact Bond Project Manager at the Bertha Centre for Social Innovation and Entrepreneurship,
A theme emerging through De Witt’s presentation is that social impact measurement has the potential to influence the allocation of capital by improving on information asymmetries related to positive and negative externalities produced through investments. As social impact measurement produces evidence concerning these externalities, it is anticipated that investors will become more knowledgeable and more persuaded to invest capital to maximise financial, social and environmental returns jointly. In this way, social impact measurement has the power to catalyse and scale social impact, align public and private interest, and more effectively distribute capital.
However, in order for this potential to be realised, the Bertha Centre has identified the following four key issues that need to be addressed when designing and implementing innovative finance instruments (Bertha Centre for Social Innovation and Entrepreneurship
In order to fill the $2.5 trillion funding gap to accomplish the SDGs, the need to attract higher amounts of private capital is greater than ever. There is therefore a need for real systemic shifts in how capital is allocated. In the realm of innovative finance, there are several mechanisms that can integrate social impact measurement into investment decisions and management. This occurs when the returns are dependent on the achievement of specific output and outcomes targets and the measurement of progress and achievement then triggers payments and return profiles; therefore, in this way, the investment of the management of the performance is entirely dependent on impact measurement. Therefore, these instruments are designed not to treat impact as a side effect but as a core component of capital allocation by changing the cost of capital and return, screening out potential participants, enabling outcomes to trigger payments and putting monetary value to outcomes that were previously not valued (Bertha Centre for Social Innovation and Entrepreneurship
De Witt discussed two possible instruments (Susan de Witt presenting at the 8th AfrEA Conference
Independent third-party standards that are used by businesses, investors and institutions for defining, measuring and comparing positive social and environmental impact allow users to manage their impact, as well as the impact of the businesses with whom they work, thereby enabling attraction of mainstream capital (Honeyman
During the Innovations in Evaluation strand, Olivia Muiru, the director for B Lab East Africa,
Moreover, without such standards, there exists a lack of a standard common language to talk about results, the lack of transparency and credibility in how funds define, track and report the social and environmental performance of impact investors’ portfolios, or the ability of investors to compare investments and aggregate information across a portfolio. The market is faced with a scarcity of consistent, credible non-financial performance information, which also inhibits comparisons between impact investing opportunities, development of social and environmental performance benchmarks, and other aggregate industry analyses.
One such standard is the B Impact Assessment
customers
governance
workers
community
environment.
Once a company has scored a minimum of 80 out of 200 on the B Impact Assessment, they then become Certified B Corporations.
Through the B Impact Assessment, B Lab provides the impact standards and rating system necessary to facilitate a scalable and transparent marketplace for institutional investors, financial services intermediaries and companies seeking mission-aligned growth capital. Through the development and use of such third-party assessments, transparency, credibility and accountability will be supported in impact measurement practices across the impact investing industry.
Khatuchi Khasandi, of ANDE, demonstrated the role that SGBs play in the economic growth of a country. Small and growing businesses are defined by ANDE as commercially viable businesses, with 5–250 employees, that have significant potential, and ambition, for growth. Typically, SGBs seek growth capital from $20 000 to $2 million (ANDE
According to ANDE, as SGBs attain investments, their growth results in the creation of jobs, thus generating a multiplier effect on the local economy through wages and training. In addition to this, SGBs have the potential to provide goods and services to communities that otherwise were not able to access or afford them. Small and growing businesses are therefore seen by many impact investors (and indeed policymakers) as perfectly positioned to stimulate long-term economic growth, produce environmental and social benefits and ultimately lift countries out of poverty.
Given this focus on SGBs amongst impact investors, it is important that impact measurement approaches are designed with their specific characteristics, capacity and interests in mind. For instance, impact measurement has to be ‘right sized’ to be feasible for businesses that are likely to have a small target client market and small-scale operations. This means that data collection efforts cannot be too expensive or time intensive or impact measurement will not be practical.
Additionally, because SGBs face barriers in accessing knowledge resources that are useful for growth, a clear value proposition for impact measurement is the use of information produced through their activities for their internal learning in order to improve operations or scale the business. As an example, an impact study for an SGB concerning the ways that clients use their products and what kind of changes clients experience might assist them with business intelligence that can be applied to their sales or marketing strategy – while also communicating their impact to stakeholders on the communities that they operate in. In this way, if there is a clear value proposition it might be possible to improve the buy-in amongst SGBs to contribute to and facilitate impact measurement activities.
Expanding on the theme of ‘evaluation that creates value for participants’ that was forthcoming during discussions around the SGBs, it is also important that this value not be diminished by over-scoped impact measurement activities.
Ashely Speyer, from Acumen’s Lean Data team,
Research conducted by the Harvard Business School in 2015 (So & Staskevicius
limited time and resources that are needed to allocate to extensive impact measurement
the recognition of survey fatigue amongst beneficiaries
for those social enterprises that do have some measurement in place, their main focus is maximising their financial return while meeting the impact threshold, and therefore they do not value robust measurement.
Research was undertaken by ANDE in 2014, and again in 2017, in order to better understand measurement practices in the SGB sector and to help organisations benchmark themselves against their peers. During this research, 30 ANDE members were surveyed about their measurement practices. The findings of the survey were captured in a report titled
Given these challenges and constraints faced by social enterprises, including their lack of technical capacity in impact measurement, and the fact that one of the primary functions involved in measuring impact is the collection of data, impact investors need to continue to develop their understanding of how their investments are affecting households and how to better allocate capital, while at the same time recognising these challenges. As a result, by applying the lean philosophy framework to monitoring results and information management, Acumen
Acumen is encouraging their investees to adopt Lean Data and collect data on their impact by leveraging mobile phones and associated technologies; applying rapid survey questionnaires; and integrating the collection, analysis and use of data into the enterprises internal processes. Specifically, through the Lean Data approach, measurement amongst entrepreneurs is moving from:
Through the Lean Data initiative, Acumen hopes that all data within an organisation’s information landscape will in some way be linked to creating value for the end customer and the organisation’s objectives – whether this is revenue maximisation, cost reduction or something else. Therefore, Lean Data can be suited to social enterprises that face the dual pressure of time and cash constraints but still need real data to know that they are delivering on their social, environmental and financial objectives.
Understanding the needs of customers is critical in the pursuit of social impact. Without better information on the positive or negative impact of a product or service, an enterprise’s ability to maximise its impact is limited (Adams, Ripley & Speyer
There is therefore a need for client-centric evaluation, or evaluation that provides a way for practitioners to balance their commitment to holding themselves accountable to their mission and commitment to embody values of equality, empathy and mutual respect for the disadvantaged populations with whom they work.
An example of good practice of client-centric evaluation is that which is conducted by Root Capital
Root Capital’s results chain maps the outcomes they intend their investments to achieve (
Root Capital’s theory of change.
The primary hypotheses that Root Capital seeks to test are that agricultural businesses enable farmers to achieve higher and more stable incomes over the long term through increased prices for their crop, improved farm productivity and increased stability of market access. In return, these farmers provide a reliable supply of high quality, sustainably produced agricultural product to the businesses, and ultimately to consumers.
Root Capital conducts deep-dive studies with a subset of investees representative of their global portfolio in order to evaluate whether and how their client agricultural businesses support farmers’ livelihoods. While conducting these deep-dive studies, Root Capital’s guiding principle is ‘client-centric evaluation’, which seeks to generate the impact data needed on small-scale farmers in order to create value both for the farmers and for the enterprise. This means that rather than measuring impact as impartial outside observers, Root Capital seeks to observe and measure impact as value-added partners who help farmers and enterprises to increase the value provided to the other.
However, the client-centric approach to evaluation is not without its trade-offs, and, for example, it has the disadvantage of being less objective than experimental evaluations. Yet, for some clients for whom experimental evaluations are operationally infeasible or are simply too costly, a client-centric approach enables the engagement of clients that might not otherwise participate in impact evaluations. In cases where experimental evaluations are possible, on the other hand, a client-centric approach maximises the chance that a potentially interested client will feel comfortable proceeding as a research object. Moreover, a client-centric approach may also improve the quality of the impact data that can be obtained by focusing the study design on issues that are of true importance to the participants and their communities and thereby increasing the commitment level of these participants. This means that client-centricity is more likely to elicit honest and representative responses from clients.
In addition to the deep-dive studies, Root Capital assesses impact through social and environmental scorecards. These scorecards are portfolio-wide measurements based on data from the social and environmental due diligence that is conducted with all of their clients (potential and existing) to ensure their clients’ objectives are aligned to Root Capital’s vision. The scorecards act as both a negative screen for harmful social and environmental practices, as well as a positive screen to establish potential impact using proxies that Root Capital corroborates during impact studies. The social and environmental scorecards act as a loan-level decision-making through impact rating (combining social and environmental metrics) and to assess investment and the financial return of loans.
While impact investors and measurement and social sector actors share the same overarching goals, specifically the contribution to positive social change, the measurement practices of these stakeholders are independent – as two parallel streams with little crossover (Reisman, Gienapp & Kelly
In the development space, there is a premium placed on collecting and conducting analysis of data around meaningful changes in life, and the evidence of outcomes and impact on people’s lives. On the other hand, investors’ measurement is focused on the number of lives touched or people reached and is limited to the output level. In addition to this, the measurement has been at the pre-investment phase and hence the focus has been on measuring the potential for impact.
The group identified that impact investors seem to be more quantitative in their approach to social impact measurement, which is why it is often difficult for them to define outcomes and impact. While the field of development evaluation continues to place a premium on attribution, as the field has matured there is a greater appreciation amongst development practitioners as well as impact investors around the fact that understanding attribution is hard, costly and seldom possible. As a result, there is a greater acceptance of information about contribution, as demonstrated by the case of Root Capital.
Development evaluation has become a mature field, with an older, experienced membership. Evaluators have therefore spent a lot of time developing and using various tools and approaches to evaluation. Impact measurement, on the other hand, is an early stage area of practice with younger members, technology-driven tools and a market-oriented stance. Impact investors, who are new to this space, recognise that evaluation is often costly and difficult. Therefore, there is opportunity for complementarity, synergy and collaboration between these two groups of stakeholders, and evaluative tools and approaches need to be made available and accessible so that they can be incorporated into design in the measurement of impact investing efforts.
Given this environment, evaluators can offer their useful and exciting tools, including strong qualitative data collection and analysis skills, with a particular view to exposing negative or unintended consequences of a programme or product, to impact investors, that go beyond a narrow focus of RCTs, which were identified by participants in the strand as the ‘gold standard’ for achieving the rigour of attributing impact above any other forms of impact measurement method.
Lastly, participants in the Innovations in Evaluation strand identified what investors and evaluators can agree on and came up with the following:
Impact investors and evaluators need to learn about one another’s context.
Clarity of the different concepts is also needed: what is an outcome? What is impact?
The need for more engagement and continued dialogue between impact investors and evaluators was also identified; consistent dialogue is important to know what issues are hampering the two groups of stakeholders from converging.
Impact investing, defined as investments made into companies, organisations and funds with the intention to generate social and environmental impact alongside a financial return, is an emerging field that has grown rapidly in the last few years, outside international development. This growth has produced an unprecedented focus on measuring the social impact resulting from these investments, based on the recognition that there is a need to understand the financial and social return of innovative finance; because this is a relatively new industry, data on activity and performance can play an important role in developing and helping to grow the industry.
The Innovations in Evaluation strand at AfrEA enabled a breadth and depth of conversation between stakeholders in the impact investing space in Africa and allowed for convergence between these stakeholders. This article reported on these conversations and provided examples of organisations practising social impact measurement methods, each of which contribute to building evidence about impact measurement, both globally and on the African continent. A discussion on the need for social impact measurement to feature voices of their beneficiaries or customers and the broader communities within which they operate was also undertaken.
Lastly, this article promoted a convergence of methods, building from both the impact investment and evaluation fields. There was consensus amongst participants in the strand that the evaluation profession has much to offer to overcome the challenges inherent in social impact measurement, in order for the field to accelerate further. However, in order for this to be realised, there needs to be continued conversations, deep understanding of the interests of various stakeholders and the skills and willingness to explore customisation and innovation of existing evaluation approaches and methods. It is important that, as the discussions and efforts to strengthen the evidence base for impact investing take place, the African impact investing landscape is represented and the experiences of stakeholders in Africa are included in these conversations and platforms that aim to solve fragmentation and support the social impact measurement, for example the GIIN’s Impact Toolkit and the Impact Management Programme. This is important to consider cultural and contextual factors that are specific to the African continent and hence local solutions for local challenges to impact measurement. With the global focus on impact investing, which must be founded on social impact measurement, the drive to develop measurement further is also likely to continue, or accelerate.
A key stakeholder voice that was missing during the Innovations in Evaluation strand at the AfrEA conference was that of investors and, as a result, investors’ perspectives were included in the strand based on evaluation practitioners’ experiences. Therefore, more needs to be done to encourage the convergence of impact investors and investees, such as through neutral convening spaces like ANDE’s Learning Labs.
We declare that we have no financial or personal relationships that may have inappropriately influenced us in writing this article.
A.C. and M.T. contributed equally to this article.
GIIRS conducts third-party assessments of the social and environmental impact of companies and funds.
IRIS metrics are designed to measure the social, environmental and financial performance of an investment for a particular focus (
ANDE is a global network of organisations that propel entrepreneurship in emerging markets by providing critical financial, educational and business support services to SGBs.
The Bertha Centre was established as a specialised unit at the University of Cape Town’s (UCT) Graduate School of Business in late 2011, in partnership with the Bertha Foundation, a family foundation that works with inspiring leaders who are catalysts for social and economic change.
The B Impact Assessment was created by an independent Standards Advisory Council, staffed by B Lab, which is formed of a group of independent experts in business and academia who are also responsible for revising the standards. The assessment is updated every 2 years in order to accommodate new and innovative practices, respond to the feedback of its users and to more accurately assess the impact of all types of businesses.
The ‘B’ in ‘B Corporations’ stands for
Acumen is an impact investing fund that was founded in 2001 that invests patient capital in enterprises across Africa, Asia, Latin America and Northern America.
Root Capital’s lending facility makes loans to rural grass-roots enterprises, such as organic coffee and cocoa cooperatives, handcraft associations, wild-harvested nut producers and ecotourism businesses.