How policy makers view evidence lessons from the rwjf synthesis project
1 / 16

How Policy-Makers View Evidence: Lessons from the RWJF Synthesis Project - PowerPoint PPT Presentation

  • Uploaded on

How Policy-Makers View Evidence: Lessons from the RWJF Synthesis Project. Claudia Williams AZA Consulting June 25, 2006. Why aren’t research results better used by policy-makers?. Policy-makers are in information overload Research does not pass the “so what” test

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about 'How Policy-Makers View Evidence: Lessons from the RWJF Synthesis Project' - joanne

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
How policy makers view evidence lessons from the rwjf synthesis project

How Policy-Makers View Evidence: Lessons from the RWJF Synthesis Project

Claudia Williams

AZA Consulting

June 25, 2006

Why aren t research results better used by policy makers
Why aren’t research results better used by policy-makers? Synthesis Project

  • Policy-makers are in information overload

  • Research does not pass the “so what” test

  • Research results are not translated for policy decisions

    • Too technical and indirect

    • Isolated findings that have not been synthesized

  • Results are not fed into best channels

Mismatch between policy and research Synthesis Project

Opinion leaders, lobbyists and press

Use people not paper

Often need basic information

Won’t read long reports

Skim for “story line” and conclusions







Level of



Journals and research conferences

Peer-reviewed journals

Information is technical and sophisticated

Reports often 50+ pages

Lead with methodology and background. Results last.

Joseph nye expressed it well
Joseph Nye expressed it well Synthesis Project

“It's a totally different world, government, from academics. In academic life, there's no premium on time, the premium is on getting it just right. In government, if you haven't got the right answer by four o'clock this afternoon when the president meets with the prime minister, that perfect paper you get in a little bit late is an "F.” The idea that I would have time to read a thirty page paper -- ! I used to write them, and I found that I couldn't read them (when I worked in government)…

So this problem of how do you take chaotic reality and try to shape the right questions, even before you get answers, is very different in the government setting than in the academic setting. Because in the academic setting there's a luxury, there's no time limit. You can sort your way through it, figure it out; if you don't have the answer you go back to the library and look up more data and so forth. In government you either solve the problem or get the right answer quickly or it doesn't happen at all. And it's quite a different set of skills. The premium we put on time makes a huge difference.”

Joseph Nye, Dean of the Kennedy School of Government

1997 University of California at Berkeley Interview

Synthesis strategies
Synthesis strategies Synthesis Project

  • Choose topics carefully

  • Create meaning not noise

  • Synthesize bodies of information

  • Pair research with policy expertise

  • Use active dissemination

Choose topics carefully
Choose topics carefully Synthesis Project

  • Select perennial “thorn in the side” issues

  • Solicit topic ideas from policy audience

    • Start with “what is on their plates”

    • Make sure topics pass “so what” test

  • Certain policy decisions—often big ideological questions—are not answered or addressed through better information

  • Work with advisory group to narrow and select best topics

Create meaning not noise
Create meaning not noise Synthesis Project

  • Help organize and manage information, addressing not aggravating information overload

  • Make synthesis visual and skimmable, leading with conclusions and telling a story

  • Policy questions drive the information, not the intricacies of the research

  • Use multiple layers so users can read at different levels

Synthesize bodies of information
Synthesize bodies of information Synthesis Project

  • Synthesize bodies of evidence instead of producing isolated findings

  • Organize, structure and make sense of information, putting it into understandable frameworks

  • Bring diverse findings onto the same footing

    • Compare and weigh findings

    • Reach conclusions based on best evidence

Pair research with policy expertise
Pair research with policy expertise Synthesis Project

  • This approach does not come easily to many researchers

  • Best known researcher often not best synthesizer

  • Requires a team approach

  • The process is iterative and intense

Use active dissemination
Use active dissemination Synthesis Project

  • Goals of dissemination: share findings and foster discussion and dialogue

  • Researchers need a way to communicate more directly with policy-makers

  • Partner with knowledge broker and convening organizations

Methodological issues
Methodological issues Synthesis Project

  • Started with notion of a clear bar…but weaker literature sometimes needs to be discussed

  • Policy staff want to reach their own conclusions about research findings

  • Synthesis should not mask details on the approach, methodologies and bias of underlying evidence

    • Compare results

    • Evaluate methods

    • Technical information separated out

Synthesis framework

The Problem

Use Results to Improve


The Synthesis Solution


  • Foster dialogue

  • Actively engage

  • Get press attention


  • Build conceptual frameworks

  • Construct bridges

  • Organize around policy issues




  • Tracking function

  • Credible review

  • Advisory group


  • Short and skimmable

  • Objective and balanced

  • Provocative

  • Links to other resources


Synthesis framework

Rules to live by
Rules to live by Synthesis Project

  • Government “think tank” staff are ideal audience

  • Syntheses should lay out areas where the evidence points to a clear conclusion as well as areas where there is debate

  • Syntheses need policy as well as research input throughout

  • Syntheses should be candid, objective and credible

Contact information
Contact information Synthesis Project


email [email protected]

web site

David Colby, RWJF

Claudia Williams, AZA Consulting

phone 571.641.3030

email [email protected]