How to solve U.S. social problems when most rigorous program evaluations find disappointing effects (part one in a series)
Highlights: The ultimate goal of evidence-based policy is to improve people’s lives. This report discusses what we see as the key challenge in achieving that goal: When rigorously evaluated, most social programs and practices are found not to produce the hoped-for...Unreliable findings, published in Pediatrics, regarding the effects of a home visiting program on child obesity
Highlights: We review an article published in this month’s issue of Pediatrics, a leading scientific journal, that reported findings from a randomized controlled trial of an early childhood home visiting program called Minding the Baby. The key reported finding is...Programs that increase college attendance and completion by low-income students: Recent RCT findings
Highlights: In recent years, there has been a dramatic increase in the number of high-quality randomized controlled trials (RCTs) of programs aimed at helping low-income young adults attend and complete college. A key driver of this growth in postsecondary RCTs has...An important—but fixable—flaw in the What Works Clearinghouse that can make ineffective programs appear effective (part three in a series)
Highlights: This report, like the previous one, offers constructive criticism of the What Works Clearinghouse (WWC), a widely-cited repository of evidence on “what works” in education that has successfully advanced rigorous evidence standards but also has flaws that...How What Works Clearinghouse reviews sometimes make ineffective education programs appear effective (part two in a series)
Highlights: The Institute of Education Sciences’ (IES) What Works Clearinghouse (WWC) is a widely-cited repository of evidence on “what works” in education. Since its launch in 2003, the WWC has played a central role in advancing rigorous evaluation methods in the...How “official” evidence reviews can make ineffective programs appear effective (part one in a series)
Highlights: A recent Department of Health and Human Services (HHS) report reviews existing evidence on the long-term effects of four home visiting program models for families with young children. Report findings include: (i) “all four… models have found improvements...Yes, some blockbuster RCT findings successfully replicate: Per Scholas employment/training produces major earnings gains for low-income workers
Highlights: In social policy as in medicine, many positive initial research findings for a program or treatment are not reproduced in subsequent rigorous evaluations. The good news is that some important positive findings do reproduce. This report highlights a recent...Credible, actionable evidence on how to prevent sexual assault on university campuses
Highlights: We highlight recent results of a randomized controlled trial (RCT) of a sexual assault resistance program for first-year female university students. The RCT found that the program nearly halved the incidence of rape over a 12-month period, from 9.8 percent...Overstated findings, published in Science, on long-term health effects of a well-known early childhood program
Highlights: We review an article, published in a leading scientific journal (Science), that reported on long-term health effects of the Abecedarian early childhood program as measured in a randomized trial. The article reported that the program, which provided...Showing 10 of 35 Reviews