Syndicate content

A rant on the external validity double double-standard

David McKenzie's picture

Concerns about external validity are a common critique of micro work in development, especially experimental work. While not denying that it is useful to learn what works in a variety of different settings, there seems to be two forms of double-standard (or a double double-standard) going on: first, economic journals and economists in general seem to apply it to work on developing countries more than they do to other forms of research; and second, this concern seems to be expressed about experiments more than other micro work in development.  

Measuring consumption (through survey)

Jed Friedman's picture

Markus’ s post yesterday is the first on what will be one recurring blog theme here- measurement. I’ll continue the trend today with a focus on one of the most fundamental welfare constructs in economics: consumption. Specifically, how might the development researcher accurately measure household consumption through survey?

Measuring secrets

Markus Goldstein's picture

One of the things I learned in my first field work experience was that keeping interviews private was critical if you wanted unbiased information.   Why? I guess at the time it should have been kind of obvious to me – there are certain questions that a person will answer differently depending on whom else is in the room. We were doing a socio-economic survey of rural households in Ghana, and we thought that income, in particular, would be sensitive, since spouses tended to share information on this selectively and perhaps in a strategic way.  

Banerjee and Duflo’s Poor Economics: Micro-steps towards a quiet revolution?

David McKenzie's picture

Hot on the heels of More than good Intentions comes an outstanding new book by two of the most prominent leaders of the recent push for more rigorous evaluation – Abhijit Banerjee and Esther Duflo’s Poor Economics: A Radical Rethinking of the way to Fight Global Poverty

Build a casino to help understand the consequences of poverty

Jed Friedman's picture

As a PhD student in the late 90s, randomized field trials were not yet common place in empirical development economics. Certain quasi-experimental methods such as regression discontinuity were also fairly exotic. It was the era of the “natural experiment”, when fellow PhD students scoured county newspapers at the university library for research leads. These students were looking for news of policy changes that might plausibly introduce some exogenous variation in the local market environment.

What is success, anyhow?

Markus Goldstein's picture

As a fair number of impact evaluations I work on are programs designed by governments or NGOs, I often initially have to have a tricky discussion when it comes time to do the power calculations to design the impact evaluation.   The subject of this conversation is the anticipated effect size.   This is a key parameter – if it’s too optimistic you run the risk of an impact evaluation with no effect even when the program had worked to some (lesser) degree, if it’s too pessimistic, then you are wasting money and people’s time in your survey. 

Fundamentally unknowable? Can we learn whether our firm policies in Africa are working?

David McKenzie's picture

Millions of dollars are spent each year trying to improve the productivity of firms in Africa (and those in other developing countries), yet we have very little rigorous evidence as to what works. In a new working paper I look at whether it is even possible to learn whether such policies even work, and what can be done to make progress.

Small number of firms + Large heterogeneity = Not much power

Pages