A Mini Assessment Method For The CMMI or CMM Stephen Gristock, Reuters

1. A Mini Assessment Method For The CMMI (or CMM)Stephen Gristock, Reuters

2. Session Objectives To establish the principles behind assessments and provide an understanding of various assessment options To establish why (and how) a smaller scale, less formal, assessment methodology should be used To provide an overview of a proven Mini Assessment method

3. Back To Basics!

4. Capability Maturity Model Integrated Collaborative effort between Software Engineering Institute (SEI) and Industry bodies Platform representing multiple disciplines: SW, SE, IPPD, SA Two representations (Staged and Continuous) Launched Aug�00 V1.1 Current

5. CMMI Maturity Levels & Process Areas (PA)

6. Assessment Principles What is an Assessment? Objective snapshot against model Support Process Improvement Confidential & Collaborative Provides organizational focus for improvement

7. SEI Appraisal Method Definitions SW-CMM CAF CMM Appraisal Framework CBA-IPI CMM Based Appraisal for Internal Process Improvement CMMI ARC Assessment Requirements for CMMI SCAMPI Standard CMMI Assessment Method for Process Improvement

8. ARC Assessment Requirements CMMI Broad descriptions across Assm lifecycle Provides Classes of assessments: A CLASS (Full- SCAMPI) B CLASS (Initial/incremental-Mini) C CLASS (Quick check/self)

9. Applying CMMI During Assessment REQUIRED Specific/Generic Goals EXPECTED Specific/Generic Practices INFORMATIVE Sub-practices

10. CMMI Mini Assessment Method(stand by for action!)

11. SCAMPI vs. MINI Greater rigor/depth Wider scope Detailed plan Team (Lead Assessor +4) Stringent rules of evidence Mandatory opening, draft Final presentation to all staff Ratings and Findings Registered with SEI Minimally Invasive/duration Narrow focus (model/org) Basic Plan Smaller Team Relaxed rules of evidence Optional opening, draft Shorter interviews Concise data consolidation Presentation to affected staff PA Calc used Scores Findings Not registered with SEI

12. CMMI Mini Assessment Assets CMMI PA Calculator CMMI Scoring Criteria CMMI Assessment Guidelines (Conforms to ARC Class B)

13. Basic Assessment Steps

14. Assessment Preparation LOGISTICS Team (composition, mix, training) Schedule, facilities, travel, briefings SCOPING Planning Info Gathering- project spreadsheet, orgchart CMMI Levels/PAs, sample projects, interviewees, evidence requirements

15. Data Gathering DOCUMENT REVIEWS Online Hard-copy INTERVIEWS Cross section disciplines/functions Question strategy Survey COLLECTION Mini charts

16. Data Consolidation SEQUENCE Notes Rules of evidence CMMI Mini Chart (Observations) Findings

17. Deliverables PA Scores PA Calculator : Spreadsheet reflecting CMMI (Staged Representation) L2-L5 Scoring and Comment Fields Scores (0-10) based on approach & deployment Presentation/Report Scores, findings, actions, managers slide, reflect survey results, next steps

18. Scoring Scheme

19. In Practice: A Case Study

20. REUTERS Global Media & Information ~21,000 Employees Founded 1851 140 Countries Corporate PI (CMM since 1996) North American CMMI Pilot

21. The Reuters Experience 24 North American groups (predominantly development) baselined 2 Mini assessments per group p.a. Reinforced commitment & awareness Provided focus for change Provides a mechanism for the exchange of best practice/tools Enabled identification of centers of excellence

22. Benefits vs. Hazards Benefits: Less consumptive (assessors & org) Enables increased frequency of assessments (sustained focus) Provides granular score rather than binary rating Hazards: Less extensive review Unhealthy focus on scores?

23. Key Points MINI ASSESSMENTS ARE: Internal Limited in scope and impact Smaller duration, teams & sample set Use a sub-set of the SEI assm methods augmented by additional techniques Use PA Calculator scoring Not used to rate or re-rate Potentially, performed more frequently to assess progress and stimulate PI activity

24. Questions? Stephen.gristock@reuters.com