HRIA Tool/Instrument: Institutionalizing impact evaluation within the framework of a monitoring and evaluations system
Author(s): Michael Bamberger
Publisher: 2009, World Bank Independent Evaluation Group and the Thematic Group for Poverty Analysis, Monitoring and Evaluation
This guide reviews the institutionalisation of Impact Evaluation (IE) in order to draw lessons on the benefits of an institutionalised approach to IE, the conditions that favour it, the challenges limiting progress and some of the important steps in the process of developing such an approach.
IE looks at the magnitude and distribution of change linked to a project, programme or policy, and is done using outcome and impact indicators. The central impact evaluation question is what would have happened to those receiving the intervention if they had not in fact received the program.
This guide describes the transition from individual IE studies to building a systematic approach to identifying, implementing and using evaluations at sector and national level. IE is applied as a tool to improve budgetary planning, policy formulation, management and accountability.
The institutionalization of IE has been achieved in a relatively small number of developing countries. Nonetheless progress toward institutionalization of IE can be assessed in terms of the following characteristics:
- Country led: institutionalization.
- Strong “buy-in” from key stakeholders.
- Existence of legislation or strong administrative directives requiring program evaluation.
- Well-defined procedures and methodologies.
- IE that is integrated into sector and national monitoring and evaluation (M&E) systems that generate much of the data used in the IE studies.
- IE that is integrated into national budget formulation and development planning.
- Openness and accountability.
- Independence of the evaluation function.
- Evaluation capacity development.
Institutionalizing IE happens at state or at a major sectoral agency level and will vary from country to country. Impact Evaluation is not an evaluation system that stands on its own; when it is to be institutionalized it must be part of a well functioning monitoring and evaluation.
HRIA Eight Step Approach
The Eight Step Approach is a comprehensive HRIA framework that provides a cyclic approach to policy development and project management.
This toolset covers the following steps: