1 / 17

TEST and EVALUATION in the DoD ACQUISITION PROCESS

TEST and EVALUATION in the DoD ACQUISITION PROCESS. DOD TEST AND EVALUATION ORGANIZATION. SECRETARY OF DEFENSE. UNDER SECRETARY OF DEFENSE (ACQ, TECH & LOG) (USD[AT&L]). ASS'T SECRETARY OF DEFENSE (C3I) (ASD[C3I]). Dir, Defense Systems. DIRECTOR, OPERATIONAL TEST AND EVALUATION.

tanith
Download Presentation

TEST and EVALUATION in the DoD ACQUISITION PROCESS

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. TEST and EVALUATION in the DoD ACQUISITION PROCESS

  2. DOD TEST AND EVALUATION ORGANIZATION SECRETARY OF DEFENSE UNDER SECRETARY OF DEFENSE (ACQ, TECH & LOG) (USD[AT&L]) ASS'T SECRETARY OF DEFENSE (C3I) (ASD[C3I]) Dir, Defense Systems DIRECTOR, OPERATIONAL TEST AND EVALUATION DISA DEPUTY DIRECTOR, DEVELOPMENT TEST & EVALUATION, SE DTRMC JOINT INTEROPERABILITY TEST CMD (JITC) SECRETARY OF THE NAVY SECRETARY OF THE AIR FORCE CHIEF OF STAFF OF THE AIR FORCE SECRETARY OF THE ARMY ASA (RD&A) ASN (RD&A) ASAF (A) DUSA(OR) CHIEF OF NAVAL OPERATIONS COMMANDANT OF THE MARINE CORPS CHIEF OF STAFF OF THE ARMY TEMA AF/TE N091 ARMY MATERIEL COMMAND (AMC) ARMY TEST AND EVALUATION COMMAND (ATEC) DTC OTC AEC MARINE CORPS SYSTEMS COMMAND (MCSC) MARINE CORPS OPERATIONAL TEST AND EVALUATION ACTIVITY (MCOTEA) NAVY SYSTEMS COMMANDS SPAWAR NAVAIR NAVSEA OPERATIONAL TEST AND EVALUATION FORCE (OPTEVFOR) AIR FORCE MATERIEL COMMAND (AFMC) AIR FORCE OPERATIONAL TEST AND EVALUATION CENTER (AFOTEC)

  3. TEST AND EVALUATION GUIDANCE DOCUMENTS DODD 5000.1 THE DEFENSE ACQUISITION SYSTEM (Draft) DODI 5000.2 OPERATION OF THE DEFENSE ACQ SYSTEM Interim Defense Acquisition Guidebook DODD 4630.8 Compatibility, Interoperability, and Integration of Command, Control, Communications, and Intelligence (C3I) Systems CJCSI 3170.01D Joint Capabilities Integration and Development System (JCIDS) CJCSM 3170.01 Operation of the JCIDS CJCSI 6212.01C Interoperability and Supportability of IT & NTL Sec Sys DoD SERVICE ARMY AR73-1 TEST AND EVALUATION POLICY DA PAMPHLET 73-1 TEST AND EVALUATION SECNAVINST 5000.2B IMPLEMENTATION OF MANDATORY PROCEDURES USMC ORDER 5000.11B TESTING AND EVALUATION OF SYSTEMS AND EQUIPMENT FOR THE MARINE CORPS AFR 800-2 ACQUISITION PROGRAM MANAGEMENT AF POLICY DIR 99-1 TEST AND EVALUATION AFI 99-103 CAPABILITIES BASED T&E NAVY USMC AIR FORCE

  4. Program Initiation IOC FOC Operations & Support Concept Refinement Production & Deployment Pre-Systems Acquisition Systems Acquisition Technology Development System Development & Demonstration Sustainment A Concept Decision FRP Decision Review LRIP/ IOTE DRR C B TE in an Evolutionary Acquisition Process Increment 1 ICD TEST STRAT CDD, TEMP ---------M&S--STEP---CPD, TEMP TEMP Prototype DT EDM DEMO LRIP PROD EOA EOA OA IOTE BLIP FOTE LRIP Qty LFTE LFTE LFTE Waiver RPT FIX Increment 2 Increment 3, n

  5. MILITARY NEEDS ORD ANALYSIS of ALTERNATIVES PROTOTYPES SYSTEM DESIGN PERFORMANCE SPECIFICATION PRODUCTION ARTICLES THREATS/TARGETS SOFTWARE UPDATES MAJOR MODS DoD TEST & EVALUATION PROCESS OVERVIEW PRE-TEST ANALYSIS EVALUATION PLAN ID CRITICAL ISSUES AND DATA RQMTS ISSUE TO BE DECIDED E X P E C T E D O U T C O M E S F E E D B A C K - M E A S U R E D O U T C O M E S STEP 1 STEP 2 TEST PLANNING RUN SIMULATION CONDUCT TEST GATHER DATA ANALYZE DATA TEST REPORT STEP 3 STEP 4 BALANCE T&E RESULTS WITH OTHER PROGRAM INFO POST-TEST SYNTHESIS COMPARE RESULTS/PREDICTIONS EVALUATION REPORT DECISION STEP 5 MODELING and SIMULATION

  6. SIMULATION DURING DEVELOPMENT N u m b e r o f T r i a l s Digital Computer Simulators Hybrid Simulators Computer Simulation Types of Simulators Used Integration Laboratories Digital/Hybrids Free-Space Simulators Hardware-in-the-loop Test Facilities Installed Test Facilities Open Air Ranges Measurement Facilities Time

  7. Model-Test-Model Approach to Development predict test results, rehearse mission, define instrumentation, ID critical tests MODEL (Pre-test) TEST TEST (Live Simulation) (System development) requirements update & design updates collect data for test results & validation of model (Post-Test) MODEL Validate model Update model

  8. Prior SECDEF Themes (to OTAs) 1. Early Involvement TEMPS, TEP, TE IPT, RFPs 2. Use Models and Simulations Effectively Models with real physical underpinning in a lifetime plan 3. Combine Tests Where Possible DT/OT: OT + OT 4. Combine Tests and Training Cmd Post Ex, NTC, large scale field exer, an increasing trend 5. Do This for All Programs Including ACTDs User field operations with OTAs

  9. Trends • Incremental Fielding • More P3I/COTS/NDI/MODs • Budget Constraints (CAIV) • Changes in Missions & Requirements • ACTD Evaluations • More Emphasis on Evaluation vs Testing

  10. ISSUES IN T&E • INDEPENDENCE OF EVALUATIONS- more integrated T&E • WHAT TO TEST- New requirements process • DOTE OVERSIGHT: Interop, Waivers • CONGRESSIONAL INTEREST-DTRMC, T&E Workforce • TEST FACILITY CONSOLIDATIONS • LOSS OF T&E INFRASTRUCTURE • INCREASED USE OF M&S

  11. TEST & EVALUATION RESOURCES Pre-Systems Acquisition System Development & Demonstration Production & Deployment Operations & Support MODELING AND SIMULATION MEASUREMENT FACILITY/LABORATORY INTEGRATION LABORATORY Prototype- HARDWARE IN THE LOOP Engr Dev Model- INSTALLED SYSTEM TEST/TRAINING RANGE

  12. DEFENSE TEST RESOURCE MANAGEMENT CENTER • Established by Ntl Def Auth Act, FY03 • Direct report to USD(AT&L), coord with DOTE • Three Star or SES Director • Review/Oversight of T&E facility/MRTFB budgets • Administer Central T&E Investment & DoD T&E S&T Programs (PBD # 203, 6Dec02, $243.7m plus up, T&E S&T, FY04-09) • Biennial Strategic Plan-ten year period • Report->SecDef->Congress: Certify Adequacy of budgets vice Strategic Plan • USD (Comptroller)-Common MRTFB Financial Mgt & Actg System • Fully Fund MRTFB Institutional Budget by 2006 DepSecDef Memo, 20 Dec 2002

  13. Test and Evaluation Workforce Improvements • Established by Ntl Def Auth Act, FY03 • USD(AT&L) report to Congress NLT 15Mar03 • Assess capabilities of T&E workforce, next ten years • Adequate size, necessary expertise, right mix • How to respond to future retirement bubble • Recommend solutions

  14. Compliance w/Testing Requirements • Established by Ntl Def Auth Act, FY03 • Additional Issue for DOTE Annual OT&E Report to Congress • An assessment of “Waivers of and Deviations from Requirements in TEMP “ • Concerns over effects of Waiver/Deviation • Actions Planned or Taken

  15. Prep for Next BRAC Starts • Next BRAC Round Scheduled 2005 • Communities for “Edwards Community Alliance • Save Edwards AFB and AF Plant 42 • Lobby lawmakers • Minimize civilian encroachment • Workforce of 12,000 with $2B budget at Edwards plus 7000 at Plant 42

  16. SUMMARY “T&E IS THE CONSCIENCE OF ACQUISITION.” Secretary of Defense

More Related