Acquisition executive board aeb v v working group status
1 / 21

Acquisition Executive Board (AEB) V&V Working Group Status - PowerPoint PPT Presentation

  • Uploaded on

Acquisition Executive Board (AEB) V&V Working Group Status. V&V Summit 2010 Presented by: John Frederick (AJP-7C2) Date: 10/14/10. Briefing Topics. Objectives and Philosophy Criticality of Useful Data Accomplishments Focus Areas Next Steps. AEB V&V Working Group.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about ' Acquisition Executive Board (AEB) V&V Working Group Status' - jeb

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
Acquisition executive board aeb v v working group status

AcquisitionExecutive Board (AEB)V&V Working Group Status

V&V Summit 2010

Presented by: John Frederick (AJP-7C2)

Date: 10/14/10

Briefing topics
Briefing Topics

  • Objectives and Philosophy

  • Criticality of Useful Data

  • Accomplishments

  • Focus Areas

  • Next Steps

Aeb v v working group
AEB V&V Working Group

Who: FAA V&V experts under the AEB

Mission: Establish a common V&V philosophy

  • Across the AMS lifecycle (MA, IA, SI, ISM)

    Objectives: Recommend V&V policy changes and improvements

  • Identify and define V&V improvement opportunities in MA, IA, SI, and ISM

  • Identify and define FAA V&V best practices

When would the data be most useful answer in time to safely and efficiently act on it

How important is the data?

When would the data be most useful?Answer: In time to safely and efficiently act on it.

The value of data relative cost to fix
The Value of Data: Relative Cost to Fix

* Boehm 1981

V v data for decision support

Decision Elements

  • Operational mission

  • Operational concepts

  • Available technologies

  • Solution sets

  • Requirements

  • Design

  • System performance

  • Implementation plans

  • Criteria for deployment

  • Criteria for operations

V&V Data for Decision Support

V&V Data is Needed to Support Decision Elements Throughout the “V”

Elements of successful v v
Elements of successful V&V

  • Culture and organization that embraces the discipline

  • Policies and processes that support the discipline

  • Methods, test beds, and tools that enable the discipline

  • Responsible agents that oversee, maintain, and sustain the discipline

Nextgen challenges to v v elements
NextGen Challenges to V&V Elements

  • Capabilities go across domains/services

    (i.e. a system-of-systems)


    • V&V approach will need to be integrated

    • Programs will have increased variables and complexity

  • Operational concepts dramatically different

    (For pilot, automation, controller, NAS, and aircraft)


    • Operational concepts will be fluid and evolving

    • Larger NAS environment to validate (validation of the collective)

    • New simulation and modeling requirements

  • Increasing emphasis on v v
    Increasing Emphasis on V&V

    • JPDO

      • Essential to delivering NextGen Capabilities

      • NASA Aviation Safety Research V&V Program

      • JPDO 2010 Work Plan priority initiative

    • Industry Focus

      • DOD

      • International (e.g. ITEA)

    • FAA

      • V&V is a key element to the Tech Center’s mission and line of business responsibilities

      • AEB V&V Working Group established

    V v working group accomplishments
    V&V Working Group Accomplishments

    • Lifecycle V&V Philosophy Whitepaper- 4/3/09

    • Conducted V&V Stakeholders meeting – 10/21/09

    • V&V policy changes incorporated into AMS - 01/2010

    • V&V Guidelines developed/posted to FAST - 01/2010

    • V&V philosophy is addressed in other guidelines

      • Investment Analysis Guidance

      • Service Analysis and Concept and Requirements Definition Guidelines Document

    Current focus of v v working group
    Current Focus of V&V Working Group

    • Provide V&V tools for applying V&V practices

      • Practical (value added) standards, checklists, and guidance

      • Tools that help to ensure the success of programs

    • Integrate into AMS

      • Address V&V in the FAST standards and tools

      • Ensure V&V and policy align

    V v tools checklists
    V&V Tools: Checklists

    • Provide checklists for each critical AMS work product (document)

    • Supports assurance:

      • Quality documents that comply with standards and requirements

      • The work product supports and fulfills needs

    • V&V Checklist Status

      • PRD V&V Checklist - Complete

      • ISPD V&V Checklist - Under development

      • Planned/Proposed: Con Ops, EA Views, APB, TEMP, System Spec, SIR

    V v tools define critical performance requirements cprs in ams
    V&V Tools: Define Critical Performance Requirements (CPRs) in AMS

    • Replaces Key Performance Parameters (KPPs)

      • Primary/Must-have requirements

        • Represents attributes or characteristics essential to meeting the mission needs

        • Standardize the terminology and use of CPRs across AMS

        • Documented in the APB and PRD

        • Part of the total program requirements (assessed throughout lifecycle)

    • Status

      • Description by the V&V Working Group

      • Reviewing CPR approach with Systems Engineering

      • Plan to replace KPPs with CPRs in AMS

      • Need to assess and integrate with policy and guidance

    V v tools critical operational issues
    V&V Tools: Critical Operational Issues

    • Key operational capabilities

      • Measured to affirm that a product meets the needs

      • Ensure capability is ready for operations

    • Assessing AMS COI policies and guidance

      • Looking at best practices (e.g. DOD) for potential improvements

    • Status

      • COI standards and definitions working draft complete

      • The V&V Working Group will provide COI standards and definitions for AMS policy/guidance

    Reinstitute test and evaluation master plans temp
    Reinstitute:Test and Evaluation Master Plans (TEMP)

    • Establish baseline T&E plans and strategies before Final Investment Decision

      • T&E baselines should be managed by the program throughout the lifecycle

    • Propose a Test and Evaluation Master Plan (TEMP) be required for all programs

      • Tailored based on program size and criticality

      • Revised/updated (as required)

      • Required TEMPs align with DOD best practices

    • Status

      • The V&V Working Group has a TEMP definition, process description, and template developed and under review

    Goal balanced v v that supports the success of the programs
    Goal: Balanced V&V that Supports the Successof the Programs

    Program Costs


    Sufficiency of V&V

    Operational Risks

    V v working group the way ahead
    V&V Working Group: The Way Ahead

    • Develop and implement focus items into AMS Policy and FAST

      • V&V Checklists

      • COIs

      • CPRs

      • Formalized TEMP

    • Enhance V&V

      • Modify associated FAA policies, guidelines, and activities

    • Improve V&V practices to prepare for NextGen

    Summary of v v philosophy
    Summary of V&V Philosophy

    • Verification ensures that a product is built right (according to specifications)

    • Validation ensures that the right product is built (to fulfill its intended use)

    • Products are:

      • Verified against requirements

      • Validated against needs

      • The basis for V&V of future work products

    • V&V supports key program decisions and risk mitigation

    • Emphasis is on work products developed early in the AMS lifecycle