The Future of CMMI

8/13/2019 The Future of CMMI

1/28

2007 Carnegie Mellon University

The Future of CMMI

Jay Douglass

Software Engineering Institute

Carnegie Mellon University

Pittsburgh, PA 15213

March 19, 2007


2/28

2Update 2007 Carnegie Mellon University

Transition from V1.1 to V1.2 StatusAs reported to the SEI as of 12-31-062

Introduction to CMMI Students

Registered for Upgrade Training 1275

Upgrades Complete 717

Lead Appraisers and Instructors

Registered for Upgrade training 621

Upgrade Complete 419


3/28


CMMI Adoption Trends

CMMI Web pages views in September2006

360K/month

Exceeded 24K/day

The following were the most

downloaded files on the SEI Web site in

September 2006:

CMMI-DEV, V1.2 (PDF Version)

CMMI V1.1 Overview Presentation

CMMI V1.2 Overview Presentation

CMMI-DEV, V1.2 (Word Version)

CMMI V1.2 Model ChangesPresentation


4/28


Training

Introduction to CMMI 59,434 trained

Intermediate CMMI 2,367 trained

Introduction to CMMI Instructors 477

SCAMPI Lead Appraisers 684 trained

SCAMPI B&C-Only Team Lead -- 33

Authorized

Introduction to CMMI V1.1/1.2 Instructors 408/314

SCAMPI V1.1/1.2 Lead Appraisers 455/328

SCAMPI B&C Team Leads -- 456

CMMI Transition Status 12/31/06


5/28


Number of SCAMPI v1.1 Class A Appraisals Conducted by Quarter

Reported as of 31 August 2006

0

25

50

75

100

125

150

175

200

225

250

275

300

Q2/02 Q3/02 Q4/02 Q1/03 Q2/03 Q3/03 Q4/03 Q1/04 Q2/04 Q3/04 Q4/04 Q1/05 Q2/05 Q3/05 Q4/05 Q1/06 Q2/06


6/28


Number of SCAMPI v1.1/v1.2 Class A Appraisals

Conducted by Quarter

Reported as of 31 December 2006

0

25

50

75

100

125

150

175

200

225

250

275

300

Q2/02 Q3/02 Q4/02 Q1/03 Q2/03 Q3/03 Q4/03 Q1/04 Q2/04 Q3/04 Q4/04 Q1/05 Q2/05 Q3/05 Q4/05 Q1/06 Q2/06 Q3/06 Q4/06


7/28


Countries where Appraisals have beenPerformed and Reported to the SEI

Argentina Australia Austria Bahrain Belarus Belgium Brazil Canada

Chile China Colombia C zech Republic Denmark Dominican RepublicEgypt Finland

France Germany Hong Kong India Indonesia Ireland Israel ItalyJapan Korea, Republic of Latvia Malaysia Mauritius Mexico Morocco Netherlands

New Zealand Pakistan Philippines Portugal Russia Singapore Slovakia South Africa

Spain Sweden Switzerland Taiwan Thailand Turkey Ukraine United Kingdom

United States Vietnam Red country name: New additions with this reporting


8/28


Number of Appraisals and Maturity LevelsReported to the SEI by Country

Country

Number of

Appraisals

Maturity

Level 1

Reported

Maturity

Level 2

Reported

Maturity

Level 3

Reported

Maturity

Level 4

Reported

Maturity

Level 5

Reported Country

Number of

Appraisals

Maturity

Level 1

Reported

Maturity

Level 2

Reported

Maturity

Level 3

Reported

Maturity

Level 4

Reported

Maturity

Level 5

Reported

Argentina 15 No Yes Yes Yes Yes Korea, Republic of 56 Yes Yes Yes Yes Yes

Australia 23 Yes Yes Yes Yes Yes Latvia 10 or fewer

Austria 10 or fewer Malaysia 15 No No Yes No Yes

Bahrain 10 or fewer Mauritius 10 or fewer

Belarus 10 or fewer Mexico 10 or fewer

Belgium 10 or fewer Morocco 10 or fewer

Brazil 39 No Yes Yes Yes Yes Netherlands 10 or fewer

Canada 18 No Yes Yes No Yes New Zealand 10 or fewer

Chile 10 or fewer Pakistan 10 or fewer

China 158 Yes Yes Yes Yes Yes Philippines 14 No Yes Yes No Yes

Colombia 10 or fewer Portugal 10 or fewer

Czech Republic 10 or fewer Russia 10 or fewer

Denmark 10 or fewer Singapore 10 or fewer

Dominican Republic 10 or fewer Slovakia 10 or fewer

Egypt 10 South Africa 10 or fewer

Finland 10 or fewer Spain 25 No Yes Yes No Yes

France 65 Yes Yes Yes Yes Yes Sweden 10 or fewer

Germany 28 Yes Yes Yes Yes Yes Switzerland 10 or fewer

Hong Kong 10 or fewer Taiwan 31 No Yes Yes No No

India 177 No Yes Yes Yes Yes Thailand 10 or fewer

Indonesia 10 or fewer Turkey 10 or fewer Ireland 10 or fewer Ukraine 10 or fewer

Israel 10 or fewer United Kingdom 42 Yes Yes Yes Yes No

Italy 10 or fewer United States 598 Yes Yes Yes Yes Yes

Japan 155 Yes Yes Yes Yes Yes Vietnam 10 or fewer


9/28


Combined Appraisal Opportunities

Current ISO 9001

ISO 9001ISO 9001

IAIA

Current CMMI

SCAMPISCAMPI

AA

SCAMPI A&

ISO 9001

SCAMPI A

Visit

Report

Rating letter

indicating level

achieved

continues to

demonstrate

compliance withISO 9001:2000

no behaviours

inconsistent with

operating at level X

(Combined ISO Surveillance

using Cat C appraisal)

(Cat C appraisal)

Rating letter & or certificate

with scope indicating

in accordance with Level X


10/28


Performance Results Summary

27.7 : 12 : 1144.8 : 1Return on Investment

55%-4%614%Customer Satisfaction

132%29%1850%Quality

255%11%1667%Productivity

90%2%1937%Schedule

87%3%2120%Cost

HighLow

# ofdata

pointsMedianImprovements

N = 25, as of 15 December 2005

Organizations with results expressed as change over time


11/28


CMMI Today

Version 1.1 CMMI Product Suite was released January 2002.

CMMI Web site visits average 20,000/day

Over 59,000 people have been trained

Over 1600 class A appraisals have been reported to the SEI

Now we want to continuously improve


12/28


CMMI Books

A Guide to the CMMI: Second Edition

CMMI: A Framework

CMMI Assessments

CMMI Distilled: Second Edition

CMMI SCAMPI Distilled

CMMI Survival Guide

CMMI: Un Itinraire Flch: Second Edition

De kleine CMMI

Interpreting the CMMI

Making Process Improvement Work

Practical Insight into CMMI

Real Process Improvement Using the CMMI

Systematic Process Improvement Using ISO 9001:2000 and CMMI


13/28


How about SEI Publications?

Technical notes and special reports:

Interpreting CMMI:

for Operational Organizations

for COTS Based Systems

for Service Organizations

for Marketing (in progress)

Using CMMI with:

Earned Value Management

Product Line Practices

Six Sigma

Supplementing CMMI for Safety Critical Development (in progress) Demonstrating the Impact and Benefits of CMMI (and web pages

www.sei.cmu.edu/cmmi/results)


14/28

2007 Carnegie Mellon University

CMMI V1.2and Beyond


15/28


Major Themes

Reduce complexity & size

Increase coverage

Increase confidence in appraisal results


16/28


CMMI Model Combinations

CMMI Core

SERelated

Examples

Integrated Product andProcess Development

SupplierSourcing

SWRelated

Examples

V 1.1

CMMI Core (now includes SS)

SERelated

Examples

IPPD

SWRelated

Examples

HWRelated

Examples

V 1.2

Organizational Goal(OPD)

Project Goal (IPM)


17/28


Su

pport

PAs

Process

Mgt

PAs

ProjectM

anagementPAs

IPM

IPPD Changes

SG1

SG2

SG3

SG4

IPM

SG1

SG2

SG3

ITSG1

SG2

SG3 = ApplyIPPD principles

OEI SG1

SG2

OPDSG1

SG2 SG2 = EnableIPPD principles

V1.1 V1.2


18/28


SCAMPI A Changes for V1.2

Method implementation clarifications

interviews in virtual organizations

practice characterization rules

organizational unit sampling options

Appraisal Disclosure Statement (ADS) improvements

reduce redundancy with other appraisal documents improve usability for sponsor and government

require sponsors signature on the ADS

require all team members to show agreement on findings

Both V1,1 and V1.2 ADS will reflect these as of Nov 2006

Lead Appraisers must be certified to lead high maturity appraisalsMaturity level and capability level shelf life 3 years, given 1 year of V1.2availability


19/28


Published Appraisal Results


20/28


CMMI V1.2 Schedules

Version 1.2 CMMI Product Suiterelease

Update material available

Upgrade course available on-line

First Lead Appraiser face to

faceFirst high maturity oral exam

V1.2 ADS required for all

SCAMPIs

Last V1.1 Intro training

First expiration of V1.1appraisals (3 year validity)

Last V1.1 appraisal

August 25, 2006

August 25, 2006

August 25, 2006

October, 2006

October, 2006

November, 2006

December, 2006

August 25, 2007

August 31, 2007


21/28


Beyond V1.2

Improved architecture will allow post-V1.2 expansion.

Extensions of the life cycle (Services,

Outsourcing/Acquisition) could expand use of a common

organizational framework:

allows coverage of more of the enterprise or potential

partnering organizations adapts model features to fit non-developmental efforts

(e.g., CMMI Services, CMMI Acquisition)


22/28


3 Complementary Constellations

CMMI SVC

CMMI DEV

CMMI-Servicesprovides guidance forthose providingservices within

organizations and toexternal customers

CMMI CQ

CMMI-ACQprovides

guidance toenable

informed anddecisive

acquisitionleadership

CMMI-Devprovides

guidance formeasuring,

monitoring andmanaging

developmentprocesses

16 CoreProcess Areas,common to all


23/28


Acquirer/Supplier Mismatch

Acquir

er

Supplier

Mismatch

Mismatch

mature acquirermentorslow maturity supplier

outcome not predictable

immatureacquirer

Customer

encourages shortcuts.

Matchedacquirer and supplierare both high maturity

highest probability ofsuccess

Disasterno disciplineno processno product

Technical &Management Skill

Low

Lo

w

High

High

maturesupplier


24/28


Initial CMMI-ACQ Key Acquisition Processes*

AcquisitionRequirement

s

Development

Solicitation &

SupplierAgreement

Development

AcquisitionTechnical

Solution

Acquisition

Management

Project

Management

Acquisition

Validation

Acquisition

Verification

Core

Processes

*based on initial CMMI-ACQ model developed by General Motors/SEI


25/28


Acquisition Improvement is needed.

Acquirers cannot ensure thatmature processes are applied to

their programs

Acquirers need more internalprocess focus

PMO

Contractor

Mismatch

Mismatch

mature acquirermentorslow maturity supplier

less mature acquirerderails mature supplier;encourages short cuts

Matchedacquirer and supplierare both high maturity

Disasterno disciplineno process

Technical& Management Skill

Low

Low

High

High

outcome notpredictable highest probabilityof success

no productsupplier compromises

processes

XYZ Corp.

Division

A

Project1

Project2

Project3

Division B Division N

Project5

Project6

Project7

Projectx

Projecty

Projectz

Project4

MLs usually

apply HEREbased upon

appraisals of

THESE

but your

project isHERE orHERE


26/28


Guidebook Concept

Provide a process toolbox for the acquirer Include practical guidance on how to recognize the real

practitioners

Encourage the use of capability and maturity profiles vice "singlelevel" approach

Improve acquisition organizations' understanding of the meaningof high maturity (levels 4 and 5) and equivalent staging

Include multiple tools and guidance that may be usedthroughout the acquisition lifecycle


27/28


Planned Sequence of Models

SA-CMM

GM ITSourcing

CMMI-DEV V1.2

CMMI-ACQ

CMMI-SVC

CMMI V1.1

CMMI-AM


28/28


Contact Information

Jay Douglass

[email protected]

Direct +1 412 268 6834

Cell: +1 412 260 2445Pittsburgh, Pennsylvania 15213

Documents

The Future of CMMI