Co-authors: Evan Thomas and German Sturzenegger
Technological innovations have the potential to revitalize the global partnership for sustainable development—if we rise responsibly to the challenge of measuring their impact.
Fifteen years is a long time for technology. In 2003 the “World Wide Web” was pervasive by 1986 standards. Yet today, the web of 2003 may very well have been spun by a single spider.
It’s been over two years since the United Nations introduced the Sustainable Development Goals. How can we better monitor progress toward them? This month, the World Bank Group and the InterAmerican Development Bank, along with collaborators from partnering institutions, published an overview of innovations in the monitoring of water supply, sanitation, and hygiene (WASH) impact measures, directly tied to SDG #6: “Ensure availability and sustainable management of water and sanitation for all.” The authors explore the potential of new measurement technologies to “revitalize the global partnership for sustainable development in the sector,” one of the hopes pinned to the SDG framework.
Co-authors: Evan Thomas and German Sturzenegger
Conflict and violence are shrinking the space for development at a time when donors are scaling up their presence. To reconcile the conflicting objectives of staff safety with a need to do more (or a greater volume of investment), and doing it better (through higher quality projects), many development workers have started to rely on third party monitoring by outside agents, an approach that is costly and not always effective.The case of Mali demonstrates that alternatives exist.
Less than a decade ago Bank staff could travel freely around in Mali, even to the most remote communities in the country. But today, a mix of terrorism and armed violence renders field supervision of projects impossible in many locations.
To address this challenge—and in the wake of the 2013/14 security crisis in northern Mali—a monitoring system was designed that is light, low cost, and suited for monitoring in insecure areas, but also problem oriented and able to facilitate improvements in project implementation.
India is the world’s largest producer as well as consumer of milk and milk products. India nevertheless faces a shortage of milk and milk products due to increasing demand from the fast growing middle class in the country.
The National Dairy Plan Phase I (NDP-I), a Central Sector Scheme of the Government of India, which is supported by National Dairy Support Project (NDSP), aim to increase milk productivity and market access for milk producers, which are both necessary to meet the growing demand for milk. NDP-I is being implemented with a total investment of about US$350 Million, out of which the Bank has extended a Credit of US$219 Million through the NDSP.
The National Dairy Development Board (NDDB) is the main implementing agency for the NDP-I. At the decentralized level, NDP-I is being implemented by about 150 end‐implementing agencies (EIAs) scattered over the country.
The Project involves some innovative procurement practices and improvements in upstream milk supply chain, which are described below:
Selilah stares out over a landscape she has inhabited for 70 years. In the valley below, deep gullies scar the slopes where rains have carried away the soil. Living with three of her four sons, she is struggling to make ends meet in this part of Sidama Zone, Ethiopia, where, she says, there used to be a forest more than 40 years ago.
Now most trees have been felled and water is scarce. Selilah spends two hours a day collecting her two jerrycans (50 liters) from a neighboring kebele (neighborhood), but when that source fails she has to buy water from a vendor at ETB 6 (30 US Cents) per a jerrycan, a huge cut into her income.
In the last 10 years, she says, the rains have changed – they are lighter than before and more infrequent. As a result, production from her meager plot – just 0.25 ha – is declining. After her husband died more than a decade ago, she now only makes ends meet through the daily wage-labor income of her sons. Like many others, Selilah is on the frontline of climate change in a landscape under increasing pressure.
Despite insecurity, development must continue. But how can donors be confident their money is well spent if locations are inaccessible?
Last month, insurgents killed more than 60 people in north-east Kenya. This is only the latest in a wave of violent incidents heightening insecurity along the remote Somali-Kenyan border.
The north-east is one of the poorest regions in Kenya. Weak infrastructure and limited public services are exacerbated by banditry and insurgency. The national primary school enrolment rate is over 90%, but in the north-east it is below 40%.
It is clear that despite insecurity, development and investment must continue. But how can donors be confident their money is well spent if locations are inaccessible to most implementing partners? If donors can’t see results, they are unlikely to reinvest.
I have recently been involved in discussions with three countries that are considering *huge* new investments to introduce lots of new technologies in their primary and secondary education systems. Such discussions typically focus quite a bit on what technologies will be purchased; what additional products, services and support will need to be provided if the technology is to be used effectively; and how to pay for everything. Increasingly (and encouragingly), there is also talk of how to measure the impact of these sorts of investments. To measure 'impact' (however you choose to define it), you of course need to know what has actually happened (or not happened). When you are putting computers in all schools, or rolling out lots of new digital learning content, or training lots of teachers, how do you know that these sorts of things are actually taking place?
Today the world seems to hold its breath again amidst the sudden hike in food prices caused by a historical drought in the US and lack of rain in Eastern Europe. It is a thorny task to predict whether the very recent increases in food prices will unfold into magnitude of the crises seen in 2007-08 and again in 2010-2011: differences between now and then in the price of energy, a critical driver of food prices, give a reason for optimism; as does the hope that governments now better understand the painful consequences of some panic policies that have been put in place during previous episodes. On the other hand, months of volatility in global food prices, low food stocks and food security crisis alerts in parts of East and West Africa all paint a gloomy picture.
I am in the midst of a trip working on impact evaluations in Ghana and Tanzania and these have really brought home the potential and pitfalls of working with program’s monitoring data.
In many evaluations, the promise is significant. In some cases, you can even do the whole impact evaluation with program monitoring data (for example when a specific intervention is tried out with a subset of a program’s clients). However, in most cases a combination of monitoring and survey data is required.
In 2006-07, a procurement review carried out on the Technical Education Quality Improvement Project (TEQIP) in India shocked and surprised project authorities as well as the World Bank. Even in the third year of implementation, participating Engineering institutes were unable to follow the agreed processes and procedures. That situation eventually lead to the development of web based PMSS (Procurement management Support System) currently being used in TEQIP Phase 2 program.
The procurement Review Consultants reported an astonishing 56% variation and resulting non compliance of procedures in the sample of reviewed contracts. A series of further assessments and introspection brought out the main issues that plagued the procurement system. These were:
(i) Geography: challenges of ensuring consistency and adherence to agreed procedures in projects that covered a wide area between hundreds of institutions as seen institutions in different states following their respective procedures , using inappropriate methods of selection, etc.
An on-going series in the New York Times ('Grading the digital school') is exploring the impact of educational technology programs in U.S. schools. One recent article in this series noted that "Hope and enthusiasm are soaring here. But not test scores." This phenomenon is not limited to schools in rich countries like the United States, of course:
"Although the government has invested resources in ensuring the broad use of ICT in education, the results of this use in meeting the goals and targets of educational programs are, however, virtually unknown."
This statement, which could apply to scores of countries around the world, can be found near the very start of TIC Educação 2010 ("ICT Education 2010"), a fascinating new survey on the use of ICTs in Brazilian schools.