Syndicate content

survey methods

How hard are they working?

Markus Goldstein's picture
I was at a conference a couple of years ago and a senior colleague, one who I deeply respect, summarized the conversation as: “our labor data are crap.”   I think he meant that we have a general problem when looking at labor productivity (for agriculture in this case) both in terms of the heroic recall of days and tasks we are asking survey respondents for, but also we aren’t doing a good job of measuring effort. 

Is it possible to re-interview participants in a survey conducted by someone else?

David McKenzie's picture

I recently received an email from a researcher who was interested in trying to re-interview participants in one of my experiments to test several theories about whether that intervention had impacts on political participation and other political outcomes. I get these requests infrequently, but this is by no means the first. Another example in the last year was someone who had done in-depth qualitative interviews on participants in a different experiment of mine, and then wanted to be able to link their responses on my surveys to their responses on his. I imagine I am not alone in getting such requests, and I don’t think there is a one-size-fits-all response to when this can be possible, so thought I would set out some thoughts about the issues here, and see if others can also share their thoughts/experiences.

Confidentiality and Informed Consent: typically when participants are invited to respond to a survey or participate in a study they are told i) that the purpose of the survey is X ,and will perhaps involve a baseline survey and several follow-ups; and ii) all responses they provide will be kept confidential and used for research purposes only. These factors make it hard to then hand over identifying information about respondents to another researcher.
However, I think this can be addressed via the following system:

Dialing for Data: Enterprise Edition

Markus Goldstein's picture
Surveys are expensive.   And, in sub-Saharan Africa in particular, a big part of that cost is logistics – fuel, car-hire and the like.   So with the increasing mobile phone coverage more folks are thinking about, and actually using, phones in lieu of in person interviews to complete surveys.   The question is: what does that do to data quality?  

When bad people do good surveys

Markus Goldstein's picture
So there I was, a graduate student doing my PhD fieldwork.    In the rather hot office at the University of Ghana, I was going through questionnaire after questionnaire checking for consistency, missed questions and other dimensions of quality.   All of a sudden I saw a pattern:  in the time allocation questions, men in one village seemed to be doing the exact same things, for the same amount of time, on two very different days of the week.  
 

Getting to better data: Talking to strangers

Markus Goldstein's picture
About 15 years ago, when I was doing my dissertation research with a professor with experience in fieldwork, we did a 15 round survey with households in Ghana.   Given the frequency of the visits, we based the enumerators in the village.  But we were careful to hire enumerators from nearby big towns -- not the villages in which we were working.  This was partly for skills, but mostly to make sure that the enumerators wouldn't be asking sensitive questions of people they knew.   

Pages