Wednesday, March 14, 2018

The Internal and External Validity of the Regression Discontinuity Design: A Meta-Analysis of 15 Within-Study-Comparisons | JPAM Featured Article

Regression discontinuity (RD) is generally acknowledged as the most rigorous non-experimental method for obtaining internally valid impact estimates. The study tests the efficacy of RD by comparing RD causal estimates at the treatment cutoff to those from Randomized Control Trials also estimated at this same cutoff. The study identifies 15 previously completed within-study-comparisons that explicitly examined this issue by assuming the RCT results are unbiased and comparing them to RD results.


What Works Best and When: Accounting for Multiple Sources of Pureselection Bias in Program Evaluations

July 24, 2014 09:00 AM

Most evaluations are still quasi-experimental and most recent quasi-experimental methodological research has focused on various types of propensity score matching to minimize conventional selection bias on observables. Although these methods create better-matched treatment and comparison groups on observables, the issue of selection on unobservables still looms large. Thus, in the absence of being able to run randomized controlled trials (RCTs) or natural experiments, it is important to understand how well different regression-based estimators perform in terms of minimizing pure selection bias, that is, selection on unobservables.

Authors Haeil Jung and Maureen Pirog examine the relative magnitudes of three sources of pure selection bias: heterogeneous response bias, time-invariant individual heterogeneity (fixed effects [FEs]), and intertemporal dependence (autoregressive process of order one [AR(1)]). Because the relative magnitude of each source of pure selection bias may vary in different policy contexts, it is important to understand how well different regression-based estimators handle each source of selection bias.

Read the full article in the Summer 2014 JPAM or at WileyOnline.


« Back

Association for Public Policy Analysis and Management (APPAM)
NEW ADDRESS! 1100 Vermont Avenue, NW, Suite 650 Washington, DC 20005
Phone: 202.496.0130 | Fax: 202.496.0134
Twitter Facebook LinkedIn Subscribe to me on YouTube

Home|About APPAM|Membership|Public Policy News|Conference & Events|Publications| Awards|Careers & Education|Members Only

Web site design and web site development by

© 2018 Association for Public Policy Analysis & Management. All Rights Reserved.
Site Map | Privacy Policy | Terms of Use | Events | Add Your Event