9101 2009 revision workshop
1 / 16

9101:2009 Revision Workshop - PowerPoint PPT Presentation

  • Uploaded on

9101:2009 Revision Workshop. Quality Management Systems Audit Requirements for Aviation, Space, and Defense Organizations. “ It’s All About Performing”. Tony Marino The Boeing Company. Other Party (OP) Assessor Workshop San Diego, CA January 19, 2012. 9101 Team Charter.

I am the owner, or an agent authorized to act on behalf of the owner, of the copyrighted work described.
Download Presentation

PowerPoint Slideshow about '9101:2009 Revision Workshop' - kuper

An Image/Link below is provided (as is) to download presentation

Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author.While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server.

- - - - - - - - - - - - - - - - - - - - - - - - - - E N D - - - - - - - - - - - - - - - - - - - - - - - - - -
Presentation Transcript
9101 2009 revision workshop

9101:2009 Revision Workshop

Quality Management Systems Audit Requirements for Aviation, Space, and Defense Organizations

“It’s All About Performing”

Tony MarinoThe Boeing Company

Other Party (OP) Assessor Workshop

San Diego, CA

January 19, 2012

9101 team charter
9101 Team Charter

“Revise 9101 to align with the next revision of 9100 and upcoming ISO 17021, review scope and identify any additional stakeholder needs and restructure the standard for a more process-based assessment approach to auditing an organization’s quality management system.”

13 Members on the 9101 Team representing:

Americas, Europe, and Asia-Pacific IAQG Sectors

6 Different Countries

8 IAQG member companies

4 Certification Bodies

IAQG Initiative Study dated 30 Sept 2006 and presented at the IAQG meeting in Seville, Spain on 5 Oct 06.


Development model for process based auditing 9101

Process Approach





Process-Based Auditing







Performance Focused

Evidence of effectiveness

Evidence of conformity

Development Model for Process Based Auditing - 9101

What has not changed
What has not Changed

  • Determining conformity to the standards.

  • Nonconformitiesdiscovered during the audit are to be documented.

  • Based on information collected during the audit, the lead auditor will have to draw conclusions on conformity and effectiveness of the organizations quality management system.

What is the effectiveness of an organization
What is the Effectiveness of anOrganization?

  • Process not implemented; planned results are not achieved?

  • Process implemented; planned results are not achieved and appropriate actions not taken?

  • Process implemented; planned results are not achieved, but appropriate actions being taken?

  • Process implemented; planned results are achieved?

What is effectiveness
What is Effectiveness?

Extent to which planned activities are realized and planned results achieved

(Reference ISO 9000Quality management systems – Fundamentals and


What will this mean to the auditor
What will this Mean to the Auditor?

Will use client and client customer performance data to plan audit


Review and examine an organization’s “Effectiveness” from:

  • The customer viewpoint; Satisfaction and performance.

  • Organizational leadership goals and objectives.

  • Operational processes of the organization.

    Construct and follow “audit trails”.

What will this mean to an organization
What will this Mean to an Organization?

A QMS Organization should be able to…

  • Demonstrate conformity of the QMS Organization to the standard.

  • Show process mapping (identified, sequence and interaction).

  • Explain process measures identified:

    • Who reviews the data?

    • Targets defined?

    • Targets are met?

    • Are the measures actionable?

    • How is the data used?

  • Show actions taken when product quality and on-time delivery performance targets are not met.

    The ultimate measure of a QMS Organizational effectiveness –

    Customer Satisfaction

As an op assessor you will see change in the auditor s planning conduct and results
As an OP Assessor You will See Change in the Auditor’s Planning, Conduct and Results

Influences in the planning of the audit. (9101 4.2.1)

Knowledge of the client processes, sequence and interaction. (9101

Looking at organizational and process performance. (9101

Testing defined measures (targets defined and are they actionable).

Appropriate actions taken when defined measures are not met. (9101

Development of audit trails based on data and performance (9101

Make up of the audit package. (9101 Appendices)


Opportunity for improvement question
Opportunity for Improvement Question? Planning, Conduct and Results

Are 9101 audit methodologies being used:

Customer focus

Organizational Leadership

Process management

Process performance

Continual Improvement


Exercise Planning, Conduct and Results

Witness Audit

Auditor is evaluating metric/scorecard package for Management Review. You (OP Assessor) observe a scorecard for 3 programs from customer “X” reflects Red in quality for each program for the past 3 months. Auditor makes inquiry about frequency of Management Reviews, minutes and action logs. No questions regarding customer “X” asked at this moment in time. Thanks the MR and moves on the next part of the audit plan. No further inquiry is made throughout the course of the audit. Audit concluded with no NCR’s.

As an observer, what issue might be here?


Exercise Planning, Conduct and Results

Witness Audit

During the opening meeting, auditor followed opening meeting protocols except didn’t discuss/explain PEAR’s. During the closing meeting, PEAR evaluation and conclusions were not covered with the client.

As an observer, what issue might be here?


Exercise Planning, Conduct and Results

Witness Audit - AS9110

During the audit the auditor wrote an NC as follows:

Statement of Nonconformity: No provisions for disposition of out-of-scope defects discovered during maintenance.

Objective Evidence: Business Systems Manual/Processes/Document/Work Instructions do not provide a method/process of disposition of out-of-scope.

NC classified as Minor

As an observer, what issue might be here?


9101 2009 revision workshop

9101 SUMMARY Planning, Conduct and Results

  • 9101D represents a significant change to aviation, space and defense auditing. Although auditing for effectiveness has always been an expectation of the standard and to customers, the reality is that most auditors focus on process conformity to procedural requirements overlooking process results.

  • This change sets a stage for a new journey and as with any journey, there will be challenges and continual improvement. We must stay on course.

9101 2009 revision workshop

9101 SUMMARY continued… Planning, Conduct and Results

  • Updates and Improvements are in work:

    • ISO 17021 and 9104/1 changes

    • Incorporate FAQ’s

    • Documentation and Records

      • Define Audit Package requirements (single, multi, campus, complex)

      • OER

      • PEAR

      • Move requirements our document instruction to the requirements writing

    • OPMT Audit Package Review feedback

      • We have issues that need to be addressed

      • Auditor Guidance Development - Priority

9101 2009 revision workshop

QUESTIONS Planning, Conduct and Results