Syndicate content

Recent comments

  • Reply to: Where the Rubber Meets the Road: Impact Evaluation in Transport   3 days 20 hours ago

    Thanks for your blog on impact evaluation. You point that more could be done on impact evaluation is well taken. However, the arguments you present in terms on 'factoring in returns on investment' and various examples on 'measuring the amount of investments we are making in this sector' seem to confuse evidence related to “return on investment” (which we typically do in terms of cost benefit analysis to approve transport projects) and evidence on outcomes of transport projects on poverty and other development goals (which are indeed more complex to undertake, costlier and technically more difficult – often primarily because there limited availability of data). It is not the same exercise to measure the cost of trading over a unit distance than it is to measure by how much income have risen because a road was upgraded. Bringing more balance in terms of what other studies have clearly shown in terms of pitfalls and difficulties in doing the latter would also be welcome.

  • Reply to: The strange case of missing textbook impacts   4 days 13 hours ago

    Did you ask the headteachers why they kept them in storage?

  • Reply to: The strange case of missing textbook impacts   5 days 13 hours ago

    Interesting finding, as well as the way it has been associated with theoretical explanation from a different field ,,, it seems we have to revisit all empirics which concluded observed behaviors as irrational!

  • Reply to: Notes from the field: The danger of programs that pay for performance   5 days 15 hours ago
    Michael,
    Many thanks for the thoughtful comments.   I would agree entirely that with enough forethought we can combine the best of pay for performance with impact evaluation -- and it's the forethought I am trying to argue for.   As it stands now, with the increase in pay for performance, and a lack of forethought, my concern is that an impact evaluation is harder to fit into the program post-contract than if the program were not pay for performance.    But forethought would fix this. 
  • Reply to: Notes from the field: The danger of programs that pay for performance   5 days 15 hours ago
    Excellent point -- thanks Tania -- the time horizon is key, particularly if we are going to write contracts against the impacts/higher level outcomes that the impact evaluation will measure.  And to measure these impacts in an attributable way, then the impact evaluation would have to be built in.   Which then raises a sharp question on how to maintain the integrity of the impact evaluation.    And even if you go with a third party contract to maintain the impartiality of the evaluation, there will likely be issues on the precision of the final estimates and which set you want to use my friend Dan Gilligan was pointing out to me today.