Impact Evaluations are just one of many important tools to improve “adaptive capacity.” To improve implementation, they need to be integrated with monitoring and decision support systems, methods to understand mechanisms of change, and efforts to build feedback loops that pay attention both to everyday and long-term learning. While there has been some scholarly writing and advocacy on this point, it has been more talk than action.
When I start working on a new impact evaluation, I often begin with a workshop in the country where the study will be conducted. The workshop brings together government officials, both at the central level and from the regions and provinces where the intervention will take place, other stakeholders such as NGOs or other UN organizations, and representatives of the research institution that will implement the survey. Part of the workshop is devoted to teaching or refreshing memories about evaluation techniques. This usually includes a section on randomization which we try to make interactive by doing a randomization game with the participants.
- Visa lottery evidence on the impact of high-skilled immigration on jobs for US workers – Vox covers new work by Giovanni Peri and co-authors – they find cities which were unlucky in the H1-B lottery experience slower job growth for American workers in the tech sector without college degrees,