When Congressionally-authorized federal programs are evaluated in randomized controlled trials, most fall short. Reform is needed.
Highlights: In the history of U.S. social policy, the federal government has commissioned 13 large randomized controlled trials (RCTs) to evaluate the effectiveness of ongoing, Congressionally-authorized federal programs, such as Head Start, Job Corps, Abstinence...KIPP charter schools—strong, replicated evidence of sizable effects on student achievement
Having just published two Straight Talk reports on the pattern of disappointing effects for most rigorously-evaluated programs, we focus this report on a compelling positive example of demonstrated effectiveness. The example we showcase is the Knowledge is Power...How to solve U.S. social problems when most rigorous program evaluations find disappointing effects (part two – a proposed solution)
Highlights: As discussed in our previous Straight Talk report, the pattern of disappointing effects in most rigorous program evaluations is compelling and needs to be taken seriously if we hope to make progress in solving social problems. We suggest that policymakers,...How to solve U.S. social problems when most rigorous program evaluations find disappointing effects (part one in a series)
Highlights: The ultimate goal of evidence-based policy is to improve people’s lives. This report discusses what we see as the key challenge in achieving that goal: When rigorously evaluated, most social programs and practices are found not to produce the hoped-for...Unreliable findings, published in Pediatrics, regarding the effects of a home visiting program on child obesity
Highlights: We review an article published in this month’s issue of Pediatrics, a leading scientific journal, that reported findings from a randomized controlled trial of an early childhood home visiting program called Minding the Baby. The key reported finding is...Programs that increase college attendance and completion by low-income students: Recent RCT findings
Highlights: In recent years, there has been a dramatic increase in the number of high-quality randomized controlled trials (RCTs) of programs aimed at helping low-income young adults attend and complete college. A key driver of this growth in postsecondary RCTs has...An important—but fixable—flaw in the What Works Clearinghouse that can make ineffective programs appear effective (part three in a series)
Highlights: This report, like the previous one, offers constructive criticism of the What Works Clearinghouse (WWC), a widely-cited repository of evidence on “what works” in education that has successfully advanced rigorous evidence standards but also has flaws that...How What Works Clearinghouse reviews sometimes make ineffective education programs appear effective (part two in a series)
Highlights: The Institute of Education Sciences’ (IES) What Works Clearinghouse (WWC) is a widely-cited repository of evidence on “what works” in education. Since its launch in 2003, the WWC has played a central role in advancing rigorous evaluation methods in the...How “official” evidence reviews can make ineffective programs appear effective (part one in a series)
Highlights: A recent Department of Health and Human Services (HHS) report reviews existing evidence on the long-term effects of four home visiting program models for families with young children. Report findings include: (i) “all four… models have found improvements...Showing 10 of 38 Reviews