Trying it out review of effectiveness of government pilots
This presentation is the property of its rightful owner.
Sponsored Links
1 / 8

‘Trying it out’ Review of effectiveness of government pilots PowerPoint PPT Presentation


  • 48 Views
  • Uploaded on
  • Presentation posted in: General

‘Trying it out’ Review of effectiveness of government pilots. Roger Jowell Centre for Comparative Social Surveys City University, London with Annette King, Government Chief Social Researcher’s Office, Cabinet Office 1 July 2004.

Download Presentation

‘Trying it out’ Review of effectiveness of government pilots

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -

Presentation Transcript


Trying it out review of effectiveness of government pilots

‘Trying it out’ Review of effectiveness of government pilots

Roger Jowell

Centre for Comparative Social Surveys

City University, London

with Annette King, Government Chief Social Researcher’s Office, Cabinet Office

1 July 2004


Panel of enquiry

Roger Jowell (Chair), City UWaqar Ahmad, DETRSue Duncan, PM’s Strategy UnitJohn Fox, DoHEdward Page, LSEMichael Richardson, DWPJudy Sebba, DfESAnn Taggart, HM TreasuryRobert Walker, Nottingham UPaul Wiles, Home Office

CABINET OFFICE TEAM:

Phil DaviesAnnette KingRebecca StanleyTess RidgeLucy Woodward

Panel of Enquiry


Components of the review

Components of the Review

Expert Workshop

Literature Review

Postal survey of 11 Departments

Interviews with senior civil servants

Interviews with selected ministers

Case studies


Advantages of policy pilots

Advantages of policy pilots

Evidence-informed policy and delivery

Prior assessment of risks and benefits

Identifying fault-lines and potentially expensive failures

Promoting innovation


Forms of evaluation

Forms of evaluation

Summative and formative

Systematic Reviews

Before-and-after studies

Quasi-experimental designs

Randomised controlled trials – of individuals or areas


Obstacles

Obstacles

Issues of ‘clinical equipoise’

Election cycles and legislative time frames

Lack of resources

Hazards of false positives/negatives


Consequences of present practice

Consequences of present practice

Pilots that aren’t pilots

Insufficient planning and training

Overlooking what is already known

Inadequate rigour


Conclusions

Conclusions

27 recommendations, adding up to case for …

  • greater use of ‘genuine’ pilots across government

  • early discussion of ethical and practical difficulties

  • pilots as part of continuous policy evaluation

  • pilots must run their course

  • distinction between negative results & failures

  • more rigour, more RCTs, more independence, more time, more resources

  • “an indispensable tool of modern government”


  • Login