Military Flight Operations & Quality Assurance (MFOQA)

1. Military Flight Operations & Quality Assurance(MFOQA) “Achievement through Collaboration” Susan Whitley 9 April 2013

2. NAVAL AVIATION MISHAPS HISTORY USN/USMC, FY50-10 45 aircraft destroyed & 59 fatalities in 2004-2005 Angled decks Aviation Safety Center Naval Aviation Maintenance Program (NAMP), 1959 RAG concept initiated NATOPS Program, 1961 Squadron Safety program ACT MFOQA/ASAP ORM Why MFOQAClose the Gap AVERAGE COST FOR CLASS “A” MISHAP Class A Mishap Rate (Rate/100k Flt Hrs) FY03: 2.44 FY04: 2.21 FY05: 1.66 FY06: 1.48 FY07: 1.24 FY08: 1.72 FY09: 1.23 FY10: 0.91 FY11: 1.31 776 aircraft destroyed in 1954 AVERAGE COST PER MISHAP (NAVY & MARINES) 11 Class A mishaps in FY10 NAVAL AVIATION CLASS “A” MISHAPS (USN SAFETY CENTER STATISTICS) AVERAGE COST FOR CLASS “A” MISHAPS PER FY Costs per mishap are increasing at an average of $10 million per mishap every 7 years Despite intervention initiatives, such as ACT and ORM, our mishap rate has essentially flat lined MFOQAwill save $$$ by identifying, correcting, and preventing hazardous trends and tendencies while improving maintenance practices and improving training efficiencies

3. Why MFOQA Old vs New Paradigm Old Paradigm New Paradigm Identify predictive indicators and trends by analyzing existing data on a regular basis…not just after the mishap or incident Implement behavior, policy & procedure changes Break the chain of causal factor events and eliminate the mishap before it happens • “Pick up the pieces” after a crash or incident; then analyze the data to determine what went wrong • Results of analyses used to implement corrective actions to prevent future mishaps MFOQA - A New Paradigm

4. Why MFOQAA Knowledge Management Tool • Provides the full circle of knowledge management tools: • Provides detection tools for identifying human error after each flight • Provides a source of tangible information to support Maintenance, Operations, Safety and Training decisions and process efficiencies • Provides a feedback loop to measure the effectiveness of ORM and other intervention strategies B&C Reported/Analyzed HAZREP Command Aware Personally Aware Unaware ORM ORM & MFOQA MFOQA provides tangible information to identify and reduce human error

5. Why MFOQA • MFOQA is mandated by SECDEF and SECNAV • SECDEF memorandum (19 May 03): Mandate to reduce mishaps by at least 50% • SECDEF memorandum (11 Oct 05): Mandate to implement MFOQA • SECNAV memorandum (2 Feb 06): MFOQA Implementation Process for DON aircraft • OPNAVINST 13210.1A (3 Sep 09): DON Policy on the incorporation & installation of required avionics safety systems in Navy & Marine Corps aircraft

6. What is MFOQAM.O.S.T • A knowledge management software tool hosted on DoD computers (NMCI seats) and servers (AME, IMDS, etc.) • Provides leadership, aircrew and maintenance personnel a software tool to analyze and assess aircraft data • Identify unsafe aircrew trends • Identify failing material components • Leadership can proactively implement change and “break the link” before an aircraft mishap or maintenance failure occurs Maintenance Operations MFOQA Safety Training

7. MFOQA Operational Concept (M)SHARP Servers Phase 1 CD-RW (class & unclass) (~70 flights) MFOQA Folder on AME Server (compressed H5s) MFOQA Folder (flight repository) on NMCI Seat AME Site Server (temp storage) NMCI Seats (MFOQA app host) Phase 2 • Content • Flight Data Files • Report & Query Templates • Supplemental Data • NAVFLIR • Events • Statistics • System/error/process logs • Output reports PEMA (stripping station) GIG – Network (unclass) Leadership, Pilots, & Maintainers (class) PCMCIA (raw flight data) • MFOQA App Imports Flights • Uncompresses HDF5 files • Copies HDF5 files to destination drive • Processes NAVFLIR • Processes Events

8. Other F/A-18 Data UNCLASSIFIED SECRET SECRET Maintenance Data Card Mission Data Card Solid State Recorder (SSR) USB Removable Memory Module (RMM)

9. Squadron Level Application NMCI Seats Leadership • Morning Report • Policy Feedback AME Server Aircraft Data Safety • Risk Mitigation • Monitor ORM Training • Gold Standard • Focused Training Maintenance • AMATS & Trending • Focused Troubleshooting Operations • PMAD & Trending • Visualization Reports can be tailored to meet the user’s information needs

10. Squadron-Level Benefits • The Commanding Officer needs the right information at the right time • MFOQA will capture all available data, filter the results, and synthesize tailored reports within minutes of the flight. • Assessments are based on specific, comprehensive information. • Hazards can be identified • Training plan adjusted to accomplish mission effectively and safely. • The Commanding Officer has a feedback loop to measure ORM effectiveness of policies and risk mitigation steps • The Maintenance Officer has data analysis to validate discrepancies • Troubleshoot discrepancies • View any recorded parameter that was exceeded • View MSP codes • Identify potential problems and trends • Maintenance data analysis to validate discrepancies • View any recorded parameter that was exceeded • View MSP codes • Troubleshoot and find trends to identify potential problems OSD Memo 11 Oct 2005: Data generated from the MFOQA process shall not be used for monitoring aircrew performance to initiate punitive or adverse action.

11. Fielding & Product Support • Program of Record (POR) – IOC Feb 2014 • Software push by NMCI to client workstations (NMCI and SIPR) • One external hard drive and CDs for each squadron • One-time buy by the POR; Squadrons will refresh/replenish • CDs for data transfer; external drive hosts large repository of flight data for trending/analysis • Initial cadre training with squadron personnel during activation • Training materials and System User Manual available for on-going support • Help desk support available, and product support website with feedback mechanism • Software Support Activity provides software fixes/enhancements • Training will be incorporated into schoolhouses by CNATT

12. Ms. Susan Whitley MFOQA Integrated Program Team Lead susan.whitley@navy.mil, (301) 757-6706 Mr. Mark Warner MFOQA Lead Engineer mark.warner1@navy.mil, (301) 757-7693 Ms. Lisa Quade MFOQA System Engineer lisa.r.quade@navy.mil, (301) 757-6649 Ms. Carla Jackson MFOQA Test and Evaluation Carla.jackson@navy.mil, (301) 757-6744 Mr. Don Wright MFOQA Deputy Integrated Program POR Lead donald.a.wright@navy.mil, (301) 757-6654 Mr. Dave Vennemann MFOQA Software Engineer david.vennemann@navy.mil, (301) 757-6652 Mr. Rizwan Tanvir MFOQA Software Engineer rizwan.tanvir@navy.mil, (301) 757-6586 Ms. Nancy Miedzinski MFOQA Deputy Assistant Program Manager for Logistics nancy.miedzinski@navy.mil, (301) 757-6666 ATCS Jason Simmons, USN MFOQA Deputy Assistant Program Manager for Logistics jason.simmons@navy.mil, (301) 757-7792 MFOQA Points of Contact

13. AME/IMDS vs. MFOQA Automated Maintenance Environments (AME) / Integrated Mechanical Diagnostics System (IMDS) Military Flight Operations Quality Assurance (MFOQA) A knowledge management system designed to identify potential human error and other causal factors before they lead to mishaps; provides timely, tangible information on aircrew and aircraft system performance following every flight Maintenance – Augments existing platform maintenance systems; provides maintainers a tool for troubleshooting, especially gripes that are hard to duplicate or require visualization of flight data. Operations – Presents a dynamic simulation of aircraft data to include single and multi-ship visualization with 3-D animation, event detection, trend analysis, reporting, etc. Safety – Aircrew Debrief, Flight Safety, Data Trending Training – Reporting, policy monitoring, and performance trending • AME designed to support the O-Level maintenance activity by providing maintainers enhanced procedural and technical tools and improved data collection for performance analysis and trending • Maintenance centric – Diagnostics, Health-monitoring, Reporting, Trending • Unique tool for each Weapon system: • F/A-18 – FAME • H1, H60, H53 – IMDS/HUMS • F-35 – ALIS • V-22 - CAMEO