Child Care and Early Education Research Connections

Skip to main content

On the feasibility of extending social experiments to wider applications

Background: When deciding how to allocate limited funds for social programs, policymakers and program managers increasingly ask for evidence of effectiveness based on studies that rely on solid methodology, providing credible scientific evidence. The basic claim for the "social experiment"--that the "coin flip" of randomization creates two statistically equivalent groups that do not diverge except through an intervention's effects--makes resulting estimates unbiased. Despite the transparency and conceptual strength of the experimental strategy for revealing the causal connection between an intervention and the outcomes of its participants, the wisdom or feasibility of conducting social experiments is often questioned on a variety of grounds. Purpose: This article defines 15 common concerns about the viability and policy reliability of social experiments, in order to assess how much these issues need constrain the use of the method in providing policy evidence. Setting: NA Intervention: NA Research Design: The research uses the authors' experience designing and conducting dozens of social experiments to examine the basis for and soundness of each concern. It provides examples from the scholarly literature and evaluations in practice of both the problems posed and responses to each issue. Data Collection and Analysis: NA Findings: We conclude that none of the 15 concerns precludes substantially extending the use of randomized experiments as a means of evaluating the impacts of government and foundation social policies and programs. (author abstract)
Resource Type:

- You May Also Like

These resources share similarities with the current selection. They are found by comparing the topic, author, and resource type of the currently selected resource to the rest of the library’s publications.

NSECE Downloadable Presentation I: Overall study design and sampling approach [PowerPoint slides]


Tips on developing surveys of child care providers


Designing studies to test causal questions about early math: The development of Making Pre-K Count