Syndicate content

Add new comment

A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology

David McKenzie's picture

Rather than the usual list of Friday links, this week I thought I’d follow up on our post by Guido Imbens yesterday on clustering and post earlier this week by Dave Evans on Hawthorne effects with a curated list of our technical postings, to serve as a one-stop shop for your technical reading. I’ve focused here on our posts on methodological issues in impact evaluation – we also have a whole lot of posts on how to conduct surveys and measure certain concepts that I’ll leave for another time.
Random Assignment, Registration and Reporting
Doing stratified randomization with uneven numbers in the Strata
How to randomize using many baseline variables
Public randomization ceremonies
Designing experiments to measure spillover effects
Mechanism experiments and opening up the black box
Sample weights and RCT design
A pre-analysis plan check-list
The New Trial Registries
What isn’t reported in impact evaluations but maybe should be
Propensity Score Matching
Guido Imbens on clustering standard errors with matching
Testing different matching estimators as applied to job training programs
The covariate balanced propensity score
Difference-in-Differences
The often unspoken assumptions behind diff-in-diff
Other Evaluation Methods
The synthetic control method, as applied to regulatory reforms
Regression discontinuity with an implicit index
Using spatial variation in program performance to identify impacts
Small n impact evaluation methods
Can we trust shoestring evaluations?
Analysis
Regression adjustment in randomized experiments (part one, part two)
When to use survey weights in analysis
Adjustments for multiple hypothesis testing
Bounding approaches to deal with attrition
Linear probability models versus probits
Dealing with multiple lotteries
Estimating standard errors with small clusters (part one, part two)
Decomposition methods
Estimation of treatment effects with incomplete compliance
Power Calculations and Improving Power
Does the intra-cluster correlation matter for power calculations if I am going to cluster my standard errors?
Power calculations for propensity score matching
Power calculations 101: dealing with incomplete take-up
Collecting more rounds of data to boost power
Improving power in small samples
On External Validity
Weighting for external validity
Will that successful intervention over there get results here?
Learn to live without external validity
Why the external validity of regression estimates can be less than you think
Why similarity is the wrong concept for external validity
A rant on the external validity double standard
Jargony Terms in Impact Evaluations
The Hawthorne Effect
The John Henry Effect
Placebo effects
Clinical Equipoise
Stata Tricks
Graphing impacts with Standard Error Bars
Calculating the intra-cluster correlation