Generalizability of heterogeneous treatment effect estimates across samples Article Swipe

PDF

Related Concepts

generalizability theory replication (statistics) homogeneity (statistics) econometrics treatment effect statistics selection bias sample (material) selection (genetic algorithm) sample size determination psychology mathematics biology medicine computer science artificial intelligence traditional medicine chromatography chemistry

Alexander Coppock , Thomas J. Leeper , Kevin Mullinix ·

YOU? · · 2018 · Open Access · · DOI: https://doi.org/10.1073/pnas.1808083115 · OA: W2901206377

Significance In experiments, the degree to which results generalize to other populations depends critically on the degree of treatment effect heterogeneity. We replicated 27 survey experiments (encompassing 101,745 individual survey responses) originally conducted on nationally representative samples using online convenience samples, finding very high correspondence despite obvious differences in sample composition. We contend this pattern is due to low treatment effect heterogeneity in these types of standard social science survey experiments.