Fighting for Reliable Evidence

Evidence-based policy is in vogue, but “evidence” can mean different things and be of very different quality. Ideally, policy decisions should be based on “reliable” evidence, but is it possible to get such evidence on important policy options? Can this be done in the real world? Will people be able to distinguish high quality evidence from hype? Will it be privileged as not just one other form of advocacy, amidst the cacophony of contentious policy debate? Can it make a difference in policy and practice? The book, Fighting for Reliable Evidence, by Judith M. Gueron and Howard Rolston, tells the story of the 45 year fight that produced positive answers to these questions. Summary: Do social programs and policies, educational curricula and other government actions actually improve targeted outcomes? This is often a difficult question to answer, but if government is to be made more effective, it is vital to figure out what works and what does not. This book tells how a diverse group of people – public officials, researchers, activists, and leaders in philanthropy – worked together over 45 years to find a way to do just that. It describes a relentless struggle – in the face of skepticism and sometimes bitter name-calling – to show that social experiments are feasible and ethical, can answer important questions, and can produce evidence that is so cut-and-dry, and so hard to fudge, that it was widely believed by Republicans and Democrats as a way to bring truth to politically and ideologically charged debates. The book focuses on welfare reform, one of the most contentious areas of social policy. In it, two insiders tell how this method was transformed from an academic idea into the gold standard for assessing real world programs. The findings, which surprised liberals and conservatives and influenced Congress and the states, included lessons specific to welfare policy and relevant to people interested in learning what works in other areas. In this story of scientific and policy innovation, allies and heroes emerge in unexpected places: social innovators in foundations seeking to produce a legacy and leverage change; civil servants determined to protect the federal treasury and maintain momentum when a new administration takes over in Washington; state officials who joined a relentless and risky fight to find out whether their own reforms paid off; researchers who pioneered a new method, before it became fashionable; and people in advocacy organizations who saw rigorous evidence as ultimately serving their constituency. Overall, the message is optimistic. Though the studies find no quick fixes to complex social problems and many questions remain unanswered, they provide a convincing antidote to cynicism. Rigorous evidence, sustained by a coalition of people of good will, helped forge a consensus for change.A description of the book can be found at the Russell Sage website.