Nuclear Knowledge Management

Maturity Assessment

KM Assessment

•To understand existing KM strengths & development

areas in the organisation

•To help prioritize areas for action

•To support the implementation of an IAEA KM expert

mission

2

The main purpose of KM assessment is:

KM assessment exercise can be also used as a tool for measuring a

progress in the development of the organizational knowledge

management system.

KM Self-Assessment

•To understand existing KM strengths & development

areas in the organisation

•To help prioritize areas for action

3

The main purpose of KM assessment is:

The KM maturity self-assessment can be considered as a strategic

internal benchmarking exercise, allowing to detect maturity gaps in

some areas, discover good practice in others and to prioritize KM areas

for improvement

“I found the KM self-assessment useful as it helps to identify what

exactly is missing and where steps are most urgently needed. We

should repeat it once in a while to ensure that we are making progress”

Birgit Kainz, OHCHR

When to Use KM Assessment

• To assess the current status in knowledge

management, whether as a starting point for

work on KM or as an evaluation tool to assess

progress

• To help prioritizing areas where progress in KM

is needed

• To identify areas of good practice (where we

can learn from others)

Main Elements of KM Assessment Models

The majority of methods and models which were

developed for analysis and (self-) assessment of

knowledge management maturity are based on the

following elements:

•Matrices and attributes grouped by categories;

• Simple assessment scale – for measuring each category

(most knowledge management maturity models use 5

maturity levels);

• Questions simplifying dialog with and discussion among

staff of organization.

Main Phases of KM Assessment

1. Assessing the current status of organization

for each maturity model area

2. Constructing the visioning of organization for

each maturity model area

3. Visualizing the results

4. Defining gaps and areas in need for

improvement

5. Repeating this exercise periodically to see

progress

KM Assessment Models

7

1. EFQM Model

2. Collinson & Parcell’s KM self-assessment

Model

3. Siemens AG KMMM

4. TATA Consulting 5iKM3 Model

5. IAEA KM Maturity self-assessment method

6. InfoSys KM Maturity Model

7. European Model of KM Assessment

8. David Skyrme’ Model

9. TKCI KMmm

IAEA KM Self-Assessment Model

The IAEA has developed KM self assessment

models for 3 types of organizations:

1.Nuclear Power Plants (described in the IAEA

TECDOC 1586)

2.Research and Development Organizations

(described in the IAEA TECDOC 1675)

3.Nuclear Educational Organizations

The IAEA has also developed corresponding tools for

maturity assessment of these types of organizations

IAEA Self Assessment Metrics/Scoring

Rating Exists in my organization

Important for my organization

0 Not utilized at all Not utilized at all

1 To a little extent To a little extent

2 To some extent To some extent

3 To a great extent To a great extent

4 To a very great extent To a very great extent

9

Categories of IAEA KM SA Model for NPPs

10

Categories of IAEA KM SA Model for R&D

11

Categories of IAEA KM SA Model for

Nuclear Educational Organizations

12

IAEA KM Self-Assessment Model

Model for KM Assessing Research and

Development Organizations

Categories of IAEA KM SA Model for R&D

14

1. KM Policies and Strategies

1. Written policies for implementing KM strategy

2. KM policy integrated into management system

3. Written policy for IP

4. Written policy for knowledge and information security

5. Best practice adoption/international standards

6. Communication strategy

7. Identification of KM responsibilities

8. Managers are personally involved in the KM program

9. Processes in place to capture design rationale

10.Organization’s strategic focus supports a continuous

learning environment

15

Example of Assessment Questions

(for Policy/Strategy)

1 Does the organisation have a written policy

for implementing its KM strategy?

2 Is this KM policy integrated into the

management system?

3 Do you have an Intellectual Property (IP)

policy?

The IAEA self assessment model is available as an

interactive Excel Spreadsheet with graphical output

IAEA NKM Self-Assessment Tool

for R&D Organizations

The IAEA self assessment model is available as an

interactive MS Excel Spreadsheet with graphical

output

•NKM.Assessment.R&D.rev1.xlsx

•NKM.Assessment.R&D.Empty.xls

•NKM.Assessment.R&D.Empty.xlsx

Assessment with the IAEA Interactive Tool

18

No. Key words Description of Criteria

Exists in my Organization

Sco

rin

g Important to my Organization

Sco

rin

g

Comments

0 1 2 3 4 0 1 2 3 4

1 KM Policy

Does the organisation have a written policy for implementing its KM strategy?

6 1 0,1 1 2 4 3,4

2 Integration of KM policy

Is a KM policy integrated into the management system? 5 2 0,3 1 1 4 3,5

3 IP Policy Do you have an Intellectual Property (IP) policy? 2 1 2 2 1,9 2 5 3,7

4 Security of knowledge & information

Does the organisation have a written security policy for knowledge and information?

1 2 4 3,1 5 2 5 2,2

5 Security standards

If so, is this based on industry best practices or national or international standards?

1 1 2 2 2,7 2 4 3,7 1 missing answer

6 Communication of KM Policy

Is the KM policy communicated to all staff in the organisation? 5 1 0,2 1 2 3 3,3 1 missing answer

7 Responsbilities for KM strategy

Are those responsible for managing the formulation and implementation of the organization's KM strategy clearly identified?

4 3 0,9 2 3 2 3,0

8

External Technical Service

Does the organisation have policies/processes in place to ensure that adequate responsibility for KP is taken when supplying or relying on external technical services/

1 1 2 2 1 2,1 2 3 2 3,0

9 Continuous learning

Does the organisation’s strategic focus support continuous learning to improve individual and organisational performance?

3 3 1 1,7 3 4 3,6

10 Design rationale

Does the organisation have processes in place to capture R&D decisions and design rationale?

1 1 5 2,6 3 4 3,6

11 Safety Culture / KM alignment

Is the organisation’s KM policy aligned with continued emphasis on a strong safety culture?

4 1 1 0,5 1 3 2 3,2 1 missing answer

Average 1,5 3,3

Visualization of Assessment Results

19

2. HR Planning and HR Processes

1. Workforce planning – a comprehensive workforce

planning methodology

2. Succession planning

3. Risk assessment for critical knowledge loss

4. Exit interviews

5. Talent programme for leadership/technical talent

6. Competence assessment of technicians

7. Competence assessment of scientists

20

2. HR Planning and HR Processes

21

3. Competence Development

1. Performance appraisals

2. Knowledge sharing at conferences, internal

seminars, publications

3. Metrics for above

4. Formal training for nuclear facility operators

5. Refresher training

6. Formal human performance programme

7. Coaching & mentoring approach

22

3. Competence Development

23

4. Documentation Processes

1. KM methods incorporated into procedures

2. Learning from experience

3. Use of self assessments

4. Use of external benchmarking for good practice

5. Feedback from R&D experience

6. Work team composition considerations

7. Publication of annual scientific report

8. Documentation of all work activities

9. Prompt update of information to represent technical and

organisational change

10. Updated configuration information for nuclear irradiation facilities

24

4. Documentation Processes

25

5. Technical (IT) Solutions

1. Alignment of IT & KM strategies

2. Integrated approach to information management

3. Utilisation of:

a. Scientific library

b. Scientific journal

c. Citation index database

d. Nuclear event database

e. Research reactor event database

4. Use of training programs for simulators, CBT, multimedia simulations etc. to

capture transfer knowledge

5. It support tool use, e.g.

a. Knowledgebase

b. Simulation tools

c. Knowledge search engines

d. Expert yellow pages

e. Expert systems

f. Wikis/blogs

26

5. Technical (IT) Solutions

27

6. Approaches to Capture/Use Tacit

Knowledge

1. Taxonomy development

2. Process for critical knowledge ID

3. Processes for knowledge elicitation/harvesting, eg.

a. Interviews

b. Video capture

c. OJT dialogue

d. Mentoring/coaching

e. Communities of Practice (CoPs)

f. Explicit capture (narrative documentation)

g. Card sorting

h. Concept mapping

i. Process mapping

j. Story telling

k. Others

4. Knowledge retention to facilitate search/retrieval

5. Processes for utilization of captured knowledge

28

6. Approaches to Capture/Use Tacit

Knowledge

29

7. KM Culture/Workforce Culture

Supporting KM

1. Culture to promote transfer of knowledge

2. No blame environment – reporting

incidents/events and sharing from lessons

learned

3. Rewarding of knowledge sharing

4. Leadership/commitment

5. Encouragement of trust, ethics, cooperation,

collaboration amongst teams

30

7. KM Culture/Workforce Culture

31

8. External Collaboration

1. Regular collaboration with higher educational

institutes

2. Does this include:

a. Teaching by research staff (at educational institutes)

b. Teaching by educational staff (at the R&D organisation)

c. Participation in joint research projects

d. Participation in CoPs

e. Participation in joint seminars

3. Regular collaboration with other R&D institutions

4. Regular collaboration with foreign institutions

32

8. External Collaboration

33

Summary

1. POLICY, STRATEGY, VISION AND MISSION

35

1. Organisation Policy vs. national policy

2. Importance of nuclear education

3. Programme level

4. Strategies

5. Industrial collaboration

6. International dimensions

7. Student selection criteria

8. Attracting the highest quality students

9. Alumni communication

10. Administrative responsibilities allocation

11. Communication policy

12. KM policy

Have been developed to help organizations to:

• Understand existing KM strengths &

development areas in the organisation

• Help prioritize areas for action

• Support the implementation of an IAEA

KM expert mission

• It has been successfully applied at several nuclear

organizations around the world

• IAEA supporting documentation and tools are

available to assist organizations

36

IAEA KM Self Assessment Tools