The application of “Value Engineering” tools to risk assess the outputs of an NSI
Download
1 / 16

The application of “Value Engineering” tools to risk assess the outputs of an NSI - PowerPoint PPT Presentation


  • 106 Views
  • Uploaded on

The application of “Value Engineering” tools to risk assess the outputs of an NSI. Graham Sharp Manager, Continuous Improvement Zone ONS, UK [email protected] 0044 1633 456742. Problem & goal statements. Problem Statement No consistent means of assessing the risks of our

loader
I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
capcha
Download Presentation

PowerPoint Slideshow about ' The application of “Value Engineering” tools to risk assess the outputs of an NSI' - makya


An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.


- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript

The application of “Value Engineering” tools to risk assess the outputs of an NSI

Graham Sharp

Manager, Continuous Improvement Zone

ONS, UK

[email protected]

0044 1633 456742


Problem goal statements
Problem & goal statements assess the outputs of an NSI

Problem Statement

  • No consistent means of assessing the risks of our

    statistical outputs in a standardised way

  • Need a strategic approach to be taken to prioritise

    improvements

    Goal Statement

    To develop a risk assessment methodology and deliver a scored risk assessment of ONS statistical outputs by the end of 2012.


Scope solution requirements
Scope & solution requirements assess the outputs of an NSI

  • In Scope:

  • Evaluate all statistical outputs and the statistical

  • system(s)/tool(s) which are used to produce them

  • Consider the entire GSBPM

  • Consider a number of dimensions of risk

  • Solution requirements:

  • Measure the risk of each ONS output

  • Outputs to be compared against each other

  • Allow drill down capabilities to identify root causes of scores

  • Simple to apply

  • Capable of self-assessment by output managers


High level project stages
High level project stages assess the outputs of an NSI

  • Agree coverage/scope of project with Directors

  • Communication with staff

  • Design solution dimensions and weighting

  • Set up solution template

  • Pilot with business areas

  • Refine tool if necessary

  • Collect information from all business areas

  • Collate into template tool and produce RAG status per system/output

  • QA results

  • Produce analysis output


Value engineering
Value Engineering assess the outputs of an NSI

Wikipedia Definition:

“Value engineering (VE) is a systematic method to improve the "value" of goods or products and services by using an examination of function”

Applied to statistical outputs, it provides a systematic risk assessment against a number of dimensions


Dimensions are they fit for purpose
Dimensions – Are they ‘fit for purpose’? assess the outputs of an NSI

Census data

Admin data

Survey data

Data acquisition /Questionnaire design; Coverage of data; Processing, edit & imputation; Analysis; Disclosure

System named and reason for red/amber provided

Data collection & preparation; Results & analysis

European dimensions of Relevance; Accuracy; Timeliness & Punctuality; Accessibility & Clarity; Comparability; Coherence

User feedback;

Future user needs;

Reputation

Are there sufficient skilled and trained people working on the output?


Process for first implementation
Process for first implementation assess the outputs of an NSI

  • Review of template with each Deputy Director (DD)

  • 3 pilot sessions with outputs managers

  • Updated template

  • Self assessment by output managers

  • Quality assured by DD, data collection areas and Methodologists

  • Importance weights reviewed by Directors

  • Challenges responded to by output managers/DDs

  • Results collated


Scoring process
Scoring process assess the outputs of an NSI

DD to complete:

Confirm the relative importance of the output to users and the impact to ONS reputation if results were erroneous.

Low =1

Med = 2

High =3


Overall assessment
Overall assessment assess the outputs of an NSI

Data collection carried out in November 2012 and again in November 2013

Baseline measure of ‘% red overall’ used as a KPI in ONS business planning


Highest scoring outputs
Highest scoring outputs assess the outputs of an NSI

Analysis of scores in November 2012 and November 2013 allowed identification of top ten scoring outputs – i.e. highest risk

Reasons for movements over the year also analysed to identify existing mitigating actions and identification of what remains to be addressed


Analyse boxplots
Analyse - assess the outputs of an NSIBoxplots

  • Comparison of scores after 1 year

  • Identify improvements made

  • Confirm new candidate surveys for improvement

  • Review cause of outliers and corrective action required


Findings by dimensions processes
Findings by Dimensions - Processes assess the outputs of an NSI

Percentage of outputs scoring RAG by category

Number of red outputs by Division for this category

Percentage of RAG outputs for each Division for this category


Use of analysis to date 1
Use of analysis to date (1) assess the outputs of an NSI

  • Prioritisation of National Statistics Quality Reviews

  • Input to survey action plans - identifying and prioritising key improvements required

  • Identifying local continuous improvement initiatives

  • Prioritising developments and influencing budget allocations

  • Sense checking where we are currently investing in developments


Use of analysis to date 2
Use of analysis to date (2) assess the outputs of an NSI

  • Deploying our skilled people to reduce risks in key areas

  • Improving communications on outputs

  • Highlighting where we need careful stakeholder handling


Conclusion
Conclusion assess the outputs of an NSI

  • Model meets the intended purpose

  • Gaining in popularity and application

  • Has become a key tool in the risk assessment of ONS outputs

  • Need to be aware that this is based on self assessment, but mitigating actions in place

  • Should be used as part of a wider range of risk & quality assessment tools


Questions assess the outputs of an NSI


ad