## A Curated List of Our Postings on Technical Topics – Your One-Stop Shop for Methodology

*Updated August 20, 2015.*

**Random Assignment**

Allocating treatment and control with multiple applications per applicant and ranked choices [1]

Is optimization just re-randomization redux? Thoughts on the "don't randomize, optimize" papers [2]

Be an optimista, not a randomista, when you have small samples [3]

Tips for randomization in the wild: adding a waitlist [4]

How to randomize in the field [5]

Stratified randomization and the FIFA world cup [6]

Doing stratified randomization with uneven numbers in the Strata [7]

How to randomize using many baseline variables [8]

Public randomization ceremonies [9]

Designing experiments to measure spillover effects [10]

Mechanism experiments [11] and opening up the black box [12]

Sample weights and RCT design [13]

**Pre-analysis plans and reporting**

Pre-registration of studies to avoid fishing and allow transparent discovery [14]

A joint test of orthogonality when testing for baseline balance [15]

A pre-analysis plan check-list [16]

The New Trial Registries [17]

What isn’t reported in impact evaluations but maybe should be [18]

Randomization checks: testing for joint orthogonality [15]

**Propensity Score Matching**

Guido Imbens on clustering standard errors with matching [19]

Testing different matching estimators as applied to job training programs [20]

The covariate balanced propensity score [21]

**Difference-in-Differences**

The often unspoken assumptions behind diff-in-diff [22]

**Regression Discontinuity**

Curves in all the wrong places: Gelman and Imbens on why not to use higher-order polynomials in RD [23]

Regression discontinuity with an implicit index [24]

**Other Evaluation Methods**

Evaluating an Argentine tourism policy using synthetic controls: tan linda que enamora? [25]

Impact as narrative [26]

The synthetic control method [27], as applied to regulatory reforms

Using spatial variation [28] in program performance to identify impacts

Small n impact evaluation methods [29]

Can we trust shoestring evaluations? [30]

**Analysis**

Another reason to prefer Ancova: dealing with measurement changes between baseline and follow-up [31]

Endogenous stratification: the surprisingly easy way to bias your heterogeneous treatment effects and what to do instead [32]

Why is difference-in-difference estimation still so popular in experimental analysis? [33]

Regression adjustment in randomized experiments (part one [34], part two [35])

When to use survey weights [36] in analysis

Adjustments for multiple hypothesis testing [37]

Bounding approaches to deal with attrition [38]

Linear probability models versus probits [39]

Dealing with multiple lotteries [40]

Estimating standard errors with small clusters (part one [41], part two [42])

Decomposition methods [43]

Estimation of treatment effects with incomplete compliance [44]

**Power Calculations and Improving Power**

Should I work with only a subsample of my control group if I have take-up problems? [45]

Power calculations: what software should I use? [46]

Does the intra-cluster correlation matter for power calculations if I am going to cluster my standard errors? [47]

Power calculations for propensity score matching [48]

Power calculations 101: dealing with incomplete take-up [49]

Collecting more rounds of data to boost power [50]

Improving power in small samples [51]

**On External Validity**

Getting beyond the mirage of external validity [52]

All those external validity issues with impacts? They apply to costs too [53]

External validity as seen from other quantitative social sciences and the gaps in our practices [54]

Towards a more systematic approach to external validity: understanding site selection bias [55]

Weighting for external validity [56]

Will that successful intervention over there get results here? [57]

Learn to live without external validity [58]

Why the external validity of regression estimates can be less than you think [59]

Why similarity is the wrong concept for external validity [60]

A rant on the external validity double standard [61]

**Jargony Terms in Impact Evaluations**

A proposed taxonomy of behavioral responses to evaluation [62]

Quantifying the Hawthorne effect [63]

The Hawthorne Effect [64]

The John Henry Effect [65]

Placebo effects [66]

Clinical Equipoise [67]

**Stata Tricks**

Generating regression and summary statistics tables in Stata [68]

Graphing impacts with Standard Error Bars [69]

Calculating the intra-cluster correlation [70]

Generating regression and summary statistics tables in Stata: A checklist and code [68]

**Replication**

Worm wars: the anthology [71]

Worm wars: a review of the reanalysis of the Miguel and Kremer deworming study [72]

Response to Brown and Wood's response [73]

Brown and Woods response on "how scientific are scientific replications" [74]

how scientific are scientific replications? [75]

**Systematic reviews and meta-analysis**

how systematic is that systematic review? The case of learning outcomes [76]

How standard is a standard deviation? A cautionary note on using SDs to compare across impact evaluations [77]

should we give up on SDs for measuring effect size? [78]

What do 600 papers on 20 types of interventions tell us about what types of interventions generalize? [79]

- Tags:
- Difference-in-difference [80]
- statistical power [81]
- propensity score [82]
- external validity [83]
- randomization [84]
- Life the Universe and Everything [85]