1 / 15

Developmental Test and Evaluation Committee

Developmental Test and Evaluation Committee. Beth Wilson, Raytheon Steve Scukanec, Northrop Grumman Industry Co-Chairs February 2013. DT&E Committee Focus 2013. DT&E Committee - 2013 Task Plan Projects Working Group. Proposed 2013 Tasks :

kalb
Download Presentation

Developmental Test and Evaluation Committee

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Developmental Test and EvaluationCommittee Beth Wilson, Raytheon Steve Scukanec, Northrop Grumman Industry Co-Chairs February 2013

  2. DT&E Committee Focus2013

  3. DT&E Committee - 2013 Task PlanProjects Working Group • Proposed 2013 Tasks: • Scientific Test and Analysis Techniques (including DOE) • Joint Meeting with Modeling and Simulation • Test as a Stakeholder for Architecture • Additional 2013 Tasks: • Better test strategy for reliability (collaborate with IEEE Reliability Society) • Provide more information on proposed leading indicators • Deliverables/Products • Scientific Test and Analysis Techniques: • White paper • Thread at T&E conference • Results at SE conference • Joint Meetings with SED committees • Modeling and Simulation • Architecture • Schedule / Resources • STAT White Paper: weekly progress tag-up • Conference threads: • T&E February 2013 [CANCELLED] • SE October 2013 • Joint meetings: TBD • Resources: • DT&E committee members • STAT white paper sub-committee • Issues / Concerns: • Resource availability

  4. DT&EStatistical Test Optimization • 2012 SE Conference summit/workshop thread • Tutorials on Monday 10/22 • Presentations on Wednesday 10/24 • Synthesis Panel on Wednesday 10/24 • Define an implementation framework • Define attributes of successful application • Identify framework for implementation • Provide amalgamation of success examples T&E Conference CANCELLED February 2013 SE Conference Report October 2013

  5. NDIA DT&E Committee Summary of Accomplishments 2006 – 2012

  6. DT&E Committee Current Structure Since 2010 OSD SE OSD OT&E/ LFT&E OSD DT&E NDIA Systems Engineering Division NDIA Test and Evaluation Division Issues Identified Issues Identified White Papers SED Committee Collaborative Projects T&E Themes For Conferences NDIA Industrial Committee on Test and Evaluation (ICOTE) Discussion NDIA DT&E Committee White Papers, Journal Articles & Workshops Project Results DT&E Themes T&E Themes & Issues NDIA Systems Engineering Conference (Q4), Collaborative Projects NDIA Test and Evaluation Annual Conference (Q1), Periodic T&E Committee-Focused Conferences, Cooperation with other NDIA Divisions DT&E Committee Focus: T&E initiatives aligned with SE, DT&E

  7. Summary ofDT&E Committee Efforts

  8. DoD T&E Policy Study • August 2006: DT&E Committee Kickoff • Policy Study: • “Improving T&E in the DoD Acquisition Process” • Industry T&E policy recommendations • Workshops: • August 2007 • January 2008 • Focus Areas: • 1. Earlier contractor and tester involvement • 2. Integrated DT/OT and DT operational relevance • 3. Suitability • April 2008: Report Summarized Results: • 10 Findings • 15 Recommendations 2006-2008

  9. Integrated Testing (CT/DT/OT) Implementation Framework 2008-2010

  10. Software Test and EvaluationSoftware Summit 2009

  11. RFP Language Industry Comments for Update: Incorporating Test and Evaluation Into Department of Defense Acquisition Contracts Recommendations from SW Summit 2010-2011

  12. Test and Evaluation forSystems of Systems 2009: “Sleepless Nights” List of Issues 2010: “Sominex” Resulting Initiatives 2010: Workshop 2011: Best Practices Wave Model 2012: Final Report 2009-2012

  13. Effective Use of Modeling and Simulation for Test and Evaluation • Joint Meeting in August 2011 • Distributed Testing, the Joint Mission Environment Test Capability (JMETC) and the Test and Training Enabling Architecture (TENA) • DoD M&S Community of Interest Data Management Working Group • LVC Architecture Roadmap Implementation (LVCAR‐I) Gateways Effort Applicability to T&E • OSD T&E Working Group • Raytheon Presentation on M&S for T&E • Potential Topics for November AMSWG Meeting 2011

  14. Modeling & Simulation CollaborationDistributed Testing • Benefits: • Find integration issues earlier • Test to learn in ‘safe’ environment • Protect proprietary information • Facilitate DT to OT transition • Increase performance testing range in operating environments • Support end to end studies throughout the program • Barriers: • Security • Lack of persistent network • Early consideration of technical issues • Perceived value • Disconnect between the communities (M&S and T&E) • Recommendations: • Harmonize the standards for M&S and Test for the life cycle perspective (HLA, TENA, Metadata) • Create a framework for reusing and repurposing M&S through the product model • Establish M&S as part of statistical test design • Determine what tests are conducted to acquire data for model validation. • Fewer test events with better models. • Recommend the use of M&S to do I&T • Recommend establishment of JMETC as a persistent node for industry to engage in MBDI&T Joint Meeting August 2012 Joint Track SE Conference October 2012 2012

  15. Metrics CollaborationLeading Indicators for T&E Workshop October 22, 2012 Follow-on workshop with System Performance Measurement WG Focused on other information needs not addressed in first report 2012 http://www.ndia.org/Divisions/Divisions/SystemsEngineering/Documents/Studies/NDIA%20System%20Develpopment%20Performance%20Measurement%20Report.pdf

More Related