The IPC-IG and SCC hold an Impact Evaluation Workshop in Cairo
Brasilia, 7 July 2014: From June 7 to 19, 2014, The Social Contract Advisory, Monitoring and Coordination Centre (SCC) and the IPC-IG organized a workshop dedicated to techniques of monitoring and impact evaluation of social protection programmes for policy makers in Cairo, Egypt. The SCC is a UNDP initiative established within the Egyptian Cabinet’s Information and Decision Support Centre (IDSC), in the aims of promoting public dialogue, strengthening monitoring of development progress and defining a vision of a new social contract in Egypt. The Egyptian government recognises the need to conduct social protection programmes based on scientific rigour in order to maximise and expand development. Therefore the IPC-IG has been working closely with UNDP Egypt and the Egyptian government to strengthen monitoring and impact evaluation of their development policies and programmes for over five years. Rafael Ribas (University of Amsterdam), Carolyn J. Heinrich (Sid Richardson Professor of Public Affairs; Director of the Center for Health and Social Policy), Guilherme Hirata (PUC-Rio) and Dimitri Silva (Associate Researcher, the IPC-IG) performed lectures at the workshop.
The workshop commenced with a look into the issue of causality as a fundamental challenge of impact evaluation. It was emphasised how impact evaluation always attempts to estimate a causal relation between a policy and its outcomes. Experimental evaluation methods (randomized control trials – RCT’s) were also introduced together with a discussion concerning clustering. Discussions relating to sampling and sample size were explored, as they are of crucial concern for those interested in running a RCT.
After learning about experimental methods of evaluation and related issues, workshop participants had the opportunity to learn about so-called quasi-experimental methods of impact evaluation. The participants were first introduced to matching and its variants as well as instrumental variables, difference-in-differences, and regression discontinuity design. Together, the presented methods exposed various tools that are appropriate for evaluating an array of policies in order to estimate their impact. Workshop sessions on interval validity, external validity and cost-effectiveness were also carried out.
During the workshop participants were introduced to a multitude of rigorous empirical studies, employing the various econometric methods of evaluation introduced to them. This provided real-world insight into the application of the methods learned. The afternoon sessions involved practical lessons on how to utilise the econometric techniques in combination with Data Analysis and Statistical Software (STATA).
The SCC’s evaluation sheet of the workshop established that participants hope to find reliable data concerning social protection in Egypt in order to apply the methods they learned from the workshop to the Egyptian case.
See more of the IPC-IG’s impact evaluation related research here:
Working Paper #101 – Analytical Framework for Evaluating the Productive Impact of Cash Transfer Programmes on Household Behaviour – Methodological Guidelines for the From Protection to Production Project
Working Paper #99 – A Methodology for Local Economy-Wide Impact Evaluation (LEWIE) of Cash Transfers
Author: Ashleigh Kate Slingsby
Short URL: http://pressroom.ipc-undp.org/?p=16447