60
IAEA International Atomic Energy Agency 3 rd Meeting of the EU IRRS Coordination Group and IAEA EC-IAEA Agreement ENER/11/NUCL/SI2.588650 Status of the IAEA Activity 18 September 2012

3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

  • Upload
    others

  • View
    4

  • Download
    0

Embed Size (px)

Citation preview

Page 1: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEAInternational Atomic Energy Agency

3rd Meeting of the EU IRRS Coordination Group and IAEA

EC-IAEA Agreement ENER/11/NUCL/SI2.588650

Status of the IAEA Activity

18 September 2012

Page 2: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Outline

• Status of the Agreement

• 10 year IRRS Program

• Analysis of the Results of the Past IRRS Missions

• Criteria of Effectiveness and Efficiency of IRRS Missions

• Post-Mission Evaluation

• Series of Targeted Consultancies

• Status of the IRRS Guidelines

• Publication of IRRS information9/18/20123nd Meeting of the EU IRRS CG and IAEA 2

Page 3: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

STATUS OF THE AGREEMENT

9/18/20123nd Meeting of the EU IRRS CG and IAEA 3

Page 4: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Contracting

• 3-years Project, 10 year plans, original Agreement for one year (April 2011-2012)

• Extension to two years (April 2011-2013)

• Longer term contracting would be more useful for both parties

9/18/20123nd Meeting of the EU IRRS CG and IAEA 4

Page 5: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Progress Reports

• Every six months• Due next October• Reflection/discussion

might be beneficial

9/18/20123nd Meeting of the EU IRRS CG and IAEA 5

Page 6: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

10 YEAR IRRS PROGRAM

9/18/20123nd Meeting of the EU IRRS CG and IAEA 6

Page 7: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

IRRS missions to EU

• ENSREG – IAEA MoU• DDG letter to the MSs• Not all MSs answered• Data from ENSREG WG1 • Uncertainties and contradictions• Expert Pool and National Coordinators• Recruitment for the recent mission

accordingly

9/18/20123nd Meeting of the EU IRRS CG and IAEA 7

Page 8: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

IRRS missions to EU (cont.)

9/18/20123nd Meeting of the EU IRRS CG and IAEA 8

Country Pre-period 1st m.

Pending follow-up

First mission

Follow-up mission

Comment

Op

erat

ing

NP

Ps

Belgium 2013, Q4 2015

Bulgaria 2013 2016, Q1

Czech Republic 2013 2016 ENSREG: fu-2015

Finland 2012 - 2015

France 2006 2014 2016

Germany 2008 ? ? ENSREG: 2021

Hungary 2015 2017

Netherlands 2014 ? No official letter, ENSREG: fu-2017

Romania 2011 2014/2015 2019 2022 New letter overwrote ENSREG

Slovak Republic 2012* - 2014

Slovenia 2011 - 2013/2014

Spain 2008 - - No first mission in the period (!!!)

Sweden 2012 - 2014-2016 ENSREG:fu-2014

United Kingdom 2009 2013 2019 2022

Oth

er in

stal

lati

on

s

Austria 2016* ? Or later, ENSREG: 2017-18, fu-2020

Denmark Last third Last third No date given , ENSREG: 2019-21*

Estonia 2015 2017

Greece 2012* ? ? Research reactor not included

Italy 2015 2017/2018 ENSREG: 2013-14, fu-2016 (!!!)

Latvia ? ? ENSREG: 2016*, fu-2018

Lithuania 2016 2018

Poland 2013* ? No follow-up indicated, ENSREG; fu-2015

Portugal ? ?

No

Inst

. Cyprus ? ? ENSREG: 2016*, fu-2019

Ireland 2015 2018

Luxembourg ? ? ENSREG: 2017-18*, fu-2020

Malta ? ?

? No official answer to IAEA

* Reduced scope mission

Page 9: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Expert Pool

• Experts nominated from: • Nuclear countries: B, BG, CZ, D, E, H, RO, S,

SF, SK, SLO, UK• Countries with installation: A, DK, GR, LAT, LIT• Other: CYP, EIR, LUX

• No expert from France and Netherlands!• CVs from: D, H, E, RO, S, SLO• More CVs would be needed

9/18/20123nd Meeting of the EU IRRS CG and IAEA 9

Page 10: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Expert Pool (cont.)

9/18/20123nd Meeting of the EU IRRS CG and IAEA 10

Page 11: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Expert Pool (cont.)

9/18/20123nd Meeting of the EU IRRS CG and IAEA 11

Page 12: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

National Coordinators

9/18/20123nd Meeting of the EU IRRS CG and IAEA 12

EU Contact Points

Country Name e-mail

Belgium Thierry Maldague [email protected]

Bulgaria Alexander Rogatchev [email protected]

Czech Republic Petr Krs [email protected]

Finland Hannu Koponen [email protected]

France Isabelle Forest [email protected]

Germany Kai Weidenbrück [email protected]

Hungary Zoltanne Bodis [email protected]

Netherlands Aad Sedee [email protected]

Romania Camelia Liutiev [email protected]

Slovak Republic Karol Janko [email protected]

Slovenia Laura Kristančič Desman [email protected]

Spain Ivan Recarte [email protected]

Sweden Ingemar Lund [email protected]

United Kingdom Peter Addison [email protected]

Austria Helmut Fischer [email protected]

Denmark Kaare Ulbak [email protected]

Estonia Ilmar Puskar [email protected]

Greece Ms. V. Kamenopoulou [email protected]

Italy

Latvia Andris Abramenkovs [email protected]

Lithuania Sigitas Šlepavičius [email protected]

Poland Magdalena Szymko [email protected]

Portugal

Cyprus Panicos Demetriades [email protected]

Ireland Tom Ryan [email protected]

Luxembourg Patrick Majerus [email protected]

Malta Paul Brejza [email protected]

?

?

Page 13: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

ANALYSIS OF THE PAST MISSIONS

9/18/20123nd Meeting of the EU IRRS CG and IAEA 13

Page 14: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA 9/18/20123nd Meeting of the EU IRRS CG and IAEA 14

Basis of the Analysis – 2006 -2011

EU missions

United KingdomFranceSpainGermanyRumaniaSloveniaSwitzerland*UK follow-upFrance follow-upSpain follow-upGermany follow-up* I know, it is not EU, yet almost

Non-EU missions

JapanMexicoUkraineCanadaRussiaChinaUSAKoreaUkraine follow-upCanada follow-up

Page 15: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA 9/18/20123nd Meeting of the EU IRRS CG and IAEA 15

Mission Site Overview

Page 16: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Primary data collected from the missions

9/18/20123nd Meeting of the EU IRRS CG and IAEA 16

Page 17: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Observations

• Recommendation : non-compliance with IAEA Safety Standards

• Suggestion : a way of further improvement• Good Practice : unique feature worth of

recommending to others

• Note: R+S → Findings

9/18/20123nd Meeting of the EU IRRS CG and IAEA 17

Page 18: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

4.50

24 32 25 18 2 31 27 29 4 10 20 22 33 15 23 7 26 36 1 16 8 19 9 21 3 11 17 34 35 5 12 13 30 6 14 28

refe

renc

e/m

issi

on

Requirement number

Average number of references from recommendations and suggestions to GSR Part 1 Requirements (in decreasing order)

Eu missions all missions

Analysis of References

9/18/20123nd Meeting of the EU IRRS CG and IAEA 18

Conclusion: GSR Part1 may need revision

0.00

0.20

0.40

0.60

0.80

1.00

1.20

24 32 25 18 2 31 27 29 4 10 20 22 33 15 23 7 26 36 1 16 8 19 9 21 3 11 17 34 35 5 12 13 30 6 14 28

Cum

ulat

ive

rate

Requirement number

Cumulative reference rate of recommendations and suggestions

from largest from smallest

• 9 Requirements (25%) obtain almost 60% of the references

• 15 Requirements (~ 40%) have 80%

• The 12 (33%) least referenced Requirements have ~ 5%

0.00

0.50

1.00

1.50

2.00

2.50

3.00

3.50

4.00

4.50

24 32 25 18 2 31 27 29 4 10 20 22 33 15 23 7 26 36 1 16 8 19 9 21 3 11 17 34 35 5 12 13 30 6 14 28

refe

renc

e/m

issi

on

Requirement number

Average number of references from recommendations and suggestions to GSR Part 1 Requirements (in decreasing order)

Eu missions all missions

Page 19: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Statistics of Observations

9/18/20123nd Meeting of the EU IRRS CG and IAEA 19

Follow-ups

0

20

40

60

80

100

120

140

Nu

mb

er o

f o

bse

rva

tio

ns

Mission date

Correlation of observations

All observations R+S GP

Conclusions:• In most missions the total no.

of findings (R+S+GP) is within the range of 40-60

• The no. of R+S’s and GP’s are negatively correlated

Page 20: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Statistics of Observations (cont.)

• Conclusion: The Modules related to the core regulatory activiti es (authorization, review and assessment, inspection) i nclude the highest number of observations. Module II and VIII are cons iderably less important, the distribution of the observations in t he other Modules is quite even →→→→ Reshaping of the Module structure might be consider ed

9/18/20123nd Meeting of the EU IRRS CG and IAEA 20

Observations EU non-EU Follow-up Summed

Recommendations 124 178 25 327

Suggestions 184 203 36 423

Good Practices 102 110 29 341

Summed 410 491 90 991

0

0.2

0.4

0.6

0.8

1

I II III IV V VI VII VIII IX X XI

rati

o

Module

GP/(R+S) for first missions

Page 21: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Comparison of EU and non -EU missions

Conclusion: There is no essential difference between the EU and non-EU missions

9/18/20123nd Meeting of the EU IRRS CG and IAEA 21

0.0

10.0

20.0

30.0

40.0

50.0

60.0

to GSRPart1

to other No.ofR+S

nu

mb

er o

f re

fere

nce

s/m

issi

on

Average number of references and findings

EU missions

nonEU missions

0

10

20

30

40

50

60

Minimum Average Maximumn

um

ber

of f

ind

ings

/mis

sio

n

Ranges of observations in EU missions

Suggestions

Recommendations

Good practices

0

10

20

30

40

50

60

70

Minimum Average Maximum

nu

mb

er o

f fin

din

gs/m

issi

on

Ranges of observations in all missions

Suggestions

Recommendations

Good practices

0

1

2

3

4

5

6

7

8

9

10

I II III IV V VI VII VIII IX X XI

ob

serv

atio

ns/

mis

sio

n

Module number

Average number of observations in EU missions

Recommendations Suggestions Good practices

0

1

2

3

4

5

6

7

8

9

10

I II III IV V VI VII VIII IX X XI

ob

serv

atio

ns/

mis

sio

n

Module number

Average number of observations in non-EU missions

Recommendations Suggestions Good practices

Page 22: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Analysis of Observations

• Observations are sorted into Subject Groups in each Module

9/18/20123nd Meeting of the EU IRRS CG and IAEA 22

IRRS Modules

Mod S.G. Subject

1 a Co-operation/interaction among organizations, bodies

b National policies, strategies

c Providing resources to the RB

d Providing/using legal framework for regulatory activities

e Transparency, public involvement

f Prime responsibility for safety

g Building competence in nuclear safety

h Waste Management

x Other

y TO OTHER MODULES

2 a OE exchange with international community

b Relationship with international organizations

x Other

y TO OTHER MODULES

3 a Staffing of the RB

b Competence of the RB

c Resources of the RB (obtaining, using, extending)

d Organization of the RB

e Developing documents for regulatory activities and cooperation

f External involvement in the regulatory processes

g Training of the RB

h Decision making process, contents of decisions

x Other

y TO OTHER MODULES

4 a Developing an (integrated) MS, general

b Details of the MS, developing MS manual

c MS review and audits

d Safety culture

e Knowledge management and IT tools

f Managing organizational changes

x Other

y TO OTHER MODULES

Page 23: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Analysis of Observations (cont.)

Conclusion: Co-operation and resources are major issues in many countries, legal framework is pronounced in some no n-EU countries

9/18/20123nd Meeting of the EU IRRS CG and IAEA 23

Subject groups in Module I. EU n-EU Total

a Co-operation/interaction among organizations, bodies 9 11 20

b National policies, strategies 7 4 11

c Providing resources to the RB 5 9 14

d Providing or using legal framework for regulatory activities 6 23 29

e Transparency, public involvement 3 3 6

f Prime responsibility for safety 1 3 4

g Building competence in nuclear safety 0 1 1

h Waste Management 0 7 7

x Other 0 2 2

y To be moved to another Module 5 0 5

Σ Sum of Recommendations and Suggestions in the Module 31 63 94

0

2

4

6

8

10

a b c d e f g h x y a b x y a b c d e f g h x y a b c d e f x y a b c d e f g h i x y a b c d e f g h i j k x y a b c d e f g h i j x y a b c d e f x y a b c d e f g x y a b c d e f g x

Findings/Subject Groups in EU missions

Recommendations Suggestions

Mod.III Mod.IV Mod.V Mod.VIMod.I Mod.VII Mod.VIII Mod.IX Mod.XII

Page 24: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Analysis of Observations (cont.)

9/18/20123nd Meeting of the EU IRRS CG and IAEA 24

Subject groups in Module VII. EU n-EU Total

a Developing the inspection program/system 10 18 28

b Use of previous results 2 2 4

c Procedures and guidance 11 11 22

d Follow-up of inspections (monitor, evaluate, share) 3 6 9

e Preparation of inspection reports 3 1 4

f Site inspectors 0 3 3

g Inspector team composition 1 2 3

h Graded approach 1 3 4

i Medical Practice 8 0 8

j Waste Management 0 2 2

x Other 1 0 1

y To be moved to another Module 4 10 14

Σ Sum of Recommendations and Suggestions in the Module 40 47 87

Conclusions:• Development of inspection program and preparation o f the respective

procedures and guides represent the highest challen ge in Module VII.• The basis and techniques of the review of Module VI I might need

further development in order to include actual insp ection techniques and results into the scope of the review.

Page 25: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Coverage and Positioning

Conclusion: Almost 8% of the findings appear in a Module not fully relevant to the nature of the finding. Guidance to the reviewers should be given in order to they contribute to the appropriate Module.

9/18/20123nd Meeting of the EU IRRS CG and IAEA 25

Mod.No.

I 2 95 0.02

III 4 91 0.04

IV 6 70 0.09

V 6 83 0.07

VI 4 85 0.05

VII 1 85 0.01

VIII 1 21 0.05

IX 2 98 0.02

X 4 54 0.07

Av 3.3 79 0.04

Ratio of ungrouped findings to the total numbers Un-

gr.

To-

tal

Ra-

tio

0.00

0.01

0.02

0.03

0.04

0.05

0.06

0.07

0.08

0.09

I III IV V VI VII VIII IX X

Conclusion: The Subject Groups introduced in this report seem to adequately cover the large majority of the IRRS findings

0

5

10

15

20

25

30

I III IV V VI VII VIII IX

Nu

mb

er

of

fin

din

gs

Module

Misplaced findingsfrom other Modules to other Modules

Page 26: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Comparison with Previous Results

• ENSREG WG1 analysis of missions in 1998-2008• Forming common sets of the ENSREG and IAEA groupings

Conclusion: Results of analysis of earlier IRRT and IRRS mission s by ENSREG – although was performed with less resolution than the present one – are in a very good agreement with the results of t he present analysis

9/18/20123nd Meeting of the EU IRRS CG and IAEA 26

ID Common name IAEA ENSREG

No. % No. %

1. RB Background 76 13.9 54 12.2

2. Cooperation 33 6.0 20 4.5

3. Time constraint 5 0.9 4 0.9

4. Management System 48 8.8 46 10.4

5. Review and Assessment 23 4.2 23 5.2

6. Inspection and Enforcement 106 19.4 95 21.4

7. Other RB documents 29 5.3 16 3.6

8. Regulations and guides 48 8.8 58 13.1

9. Staffing 44 8.1 20 4.5

10. Resources 9 1.6 15 3.4

11. Competence 42 7.7 9 2.0

12. External support 24 4.4 18 4.1

13. Emergency preparedness 51 9.3 46 10.4

14. Operational Experience Feedback 6 1.1 11 2.5

15. Periodical Safety Review 2 0.4 8 1.8

Page 27: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Report

9/18/20123nd Meeting of the EU IRRS CG and IAEA 27

Page 28: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Analysis of Good Practices

• On-going• The hosts are asked to group the GPs:

1. You have applied as lessons learned from previous IRRS missions

2. You intend to apply as lessons learned from previous IRRS missions

3. You have applied independently of the results from previous IRRS missions

4. Not applicable for some reason

• Shall reveal the spread and the novelty value of the GPs

• Your country is kindly requested to contribute

9/18/20123nd Meeting of the EU IRRS CG and IAEA 28

Page 29: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

EFFECTIVENESS AND EFFICIENCY OF IRRS MISSIONS

9/18/20123nd Meeting of the EU IRRS CG and IAEA 29

Page 30: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Performance Indicators

1. Size of the IRRS team 2. Length of the mission report 3. Time available for the review of

the Advance Reference Material (ARM)

4. Number of advance written comments from the reviewers

5. Feedback from the team members on the quality of the ARM

6. IRRS experience of the team members

7. Feedback from the host country representatives

8. Feedback from the team members on the mission

9. Coverage of the pre-mission Action Plan of the host country

10. Number of issues found beyond those in the Action Plan

11. Balance of findings12. Conciseness of the mission

report 13. Completion time of the mission

report 14. Number of issues remained

open in the follow-up mission

9/18/20123nd Meeting of the EU IRRS CG and IAEA 30

Page 31: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Values and Ranges

• Performance indicators may fall into the ranges:• Optimum• Acceptable• Needing attention

• The indicators are numerical• Relative distance from optimum:• Overall effectiveness is the average distance of PI’s:

• Optimum if ∆∆∆∆ = 0• Effective if 0 < ∆∆∆∆ ≤ 0.1• Acceptable if 0.1 < ∆∆∆∆ ≤ 0.2• To analyse if 0.2 < ∆∆∆∆

9/18/20123nd Meeting of the EU IRRS CG and IAEA 31

δδδδ = (x1-x)/x 1 Optimum range

x x1 x2

Actual value

Optimum range δδδδ = (x-x 2)/x2

x1 x2 xActual value

Page 32: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Examples of Performance Indicators

9/18/20123nd Meeting of the EU IRRS CG and IAEA 32

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

0.80

0.90

1.00

E-fu D-fu AUS-fu CA-fu ROM KOR SLO CH UAE S

rati

o o

f m

em

be

rs w

ith

exp

eri

en

ce

missions

Team Experience

0

5

10

15

20

25

30

0.00 5.00 10.00 15.00 20.00

Nu

mb

er

of

team

me

mb

ers

Size of first mission

Team size vs. missions size

Team size Linear (Team size)

0.00

0.50

1.00

1.50

2.00

2.50

RUS US KOR SLO CH UAE S

Missions

Action Plan Coverage

β1 - findings in AP β2 - findings beyond AP

0.00

0.10

0.20

0.30

0.40

0.50

0.60

0.70

F-fu UK-fu UA-fu E-fu D-fu CAN-fu AUS-fu

Ratio of open issues in follow-ups

Recommendations Suggestions All

Page 33: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

An interesting PI – Balance of findings

ρ = √[( NR* NG)/ NAv(R*G)]

9/18/20123nd Meeting of the EU IRRS CG and IAEA 33

0.00

0.50

1.00

1.50

2.00

2.50

Tendency of findings (R vs. GP)

Recommendations Good Practices Balance

0.00

0.20

0.40

0.60

0.80

1.00

1.20

1.40

1.60

Balance of findings (R vs. GP)

Page 34: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Mission Effectiveness and Efficiencies

Conclusion: It is rather reassuring that although there are per formance indicators that need attention in all missions, the overall performance of the missions in the great majority of the cases fal ls into the effective range

9/18/20123nd Meeting of the EU IRRS CG and IAEA 34

Indicators KOR D-fu SLO AUS-fu CH CAN-fu UAE S

C1 – Team Size 0.03 0 0.04 0.05 0 0.04 0.01 0

C2 – Report Length 0.11 0.15 0 0.13 0 0 0.24 0

C3 – ARM Review Time 0.13 0 0.16 0.13 0.18 0.30 0 0

C4 – Advance Comments - - - - 0.08 - 0 0

C6 – Team Experience 0.20 0 0.25 0.09 0.30 0.09 0.08 0.30

C7 – Host Feedback - - - - 0 - - 0.04

C8 – Team Feedback - - - - 0 - - 0

C9 – Action Plan Coverage 0.30 - 0 - 0 - 0 0.30

C10 – Beyond AP Coverage 0.02 - 0 - 0 - 0 0

C11 – Balance of Findings 0 - 0.16 - 0 - 0.07 0.16

C12 – Mission Report Contents 0 - 0.18 - 0.11 - 0.09 0.12

C13 – Report Completion Time 0 0.10 0.30 0 - 0 - -

C14 – Open Issues - 0.17 - 0 - 0 - -

Average Measure of Deviation (∆) 0.08 0.07 0.12 0.07 0.07 0.07 0.06 0.08

Page 35: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Report

9/18/20123nd Meeting of the EU IRRS CG and IAEA 35

Page 36: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

POST-MISSION EVALUATION

9/18/20123nd Meeting of the EU IRRS CG and IAEA 36

Page 37: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Prompt Evaluation Report Contents

• Basic Mission Data• Feedback from the Team members on the ARM

• Ratings (1 – 5) on three questions (Eff. Criteria No.5)• Characteristic comments• General conclusions

• Feedback from the Team Members on the effectiveness of the missions• Ratings (1 – 5) on five questions (Eff. Criteria No.7)• Characteristic comments• General conclusions

9/18/20123nd Meeting of the EU IRRS CG and IAEA 37

Page 38: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Prompt Evaluation Report Contents (cont.)

• Feedback from the Host on the mission• Ratings (1 – 5) on seven questions (Eff. Criteria No.6)• Characteristic comments• General conclusions

• Overall evaluation of the effectiveness and efficiency of the mission• Numerical values of the effectiveness and efficiency

Performance Indicators• Discussion and conclusions

9/18/20123nd Meeting of the EU IRRS CG and IAEA 38

Page 39: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Evaluation Data

9/18/20123nd Meeting of the EU IRRS CG and IAEA 39

Page 40: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Reports

9/18/20123nd Meeting of the EU IRRS CG and IAEA 40

Page 41: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

TARGETED CONSULTANCIES FOR ENHANCING EU MISSION EFFICIENCY

9/18/20123nd Meeting of the EU IRRS CG and IAEA 41

Page 42: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Objectives

• Reviewing the orientations given by the EC and assessing their implications on the current IRRS programme

• Providing guidance to the host Country and to the IRRS team members for preparation to and conduct of the missions

• Setting guidance for the review process during the missions in order to ensure consistency in the depth and intensity of the review of various areas

• Providing guidance to the Member States for preparation of the advance reference material prior to the missions

The results are expected to be generally applicable, not only to EU missions

9/18/20123nd Meeting of the EU IRRS CG and IAEA 42

Page 43: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Terms of Reference

9/18/20123nd Meeting of the EU IRRS CG and IAEA 43

Page 44: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Topics

1. General issues in conducting a mission

2. Review of the legal, governmental and regulatory framework

3. Review of the management system

4. Review of regulatory activities related to NPPs (Mod. 5,7,8)

5. Review of regulatory activities related to NPPs (Mod. 6,11)

6. Review of regulatory activities related to facilities and activities other than NPP

7. Review of regulatory activities related to emergency preparedness and response, and to thematic areas in radiation safety

8. Elaboration of an EU specific IRRS module

9. Format and template of an IRRS report

10. Member State activities for preparations to host, conduct and follow-up an IRRS mission

11. Application of Good Practices

9/18/20123nd Meeting of the EU IRRS CG and IAEA 44

Page 45: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Schedule and Participants

9/18/20123nd Meeting of the EU IRRS CG and IAEA 45

Consultancy data summary as of 08.08.2012

No Title pers days modules Date Room p1 p2 p3 p4 p5

1 General issues in conducting a mission 4 4 28.02 - 02.03 M0E70 Len Creswell Victor McCree Andrej Stritar Georg Schwarz

2 Review of the legal, governmental and regulatory framework 4 4 I, II, III 19 - 22.03 M0E61 Colin Patchett Karol Janko Erik Jende Shahid Mallick

3 Review of the Management System 3 3 IV 10 - 12.04 M0E70 Erik Jende Marta Ziakova Tero Varjoranta Cantemir Ciurea-Ercau

4 Review of the reg. activities related to NPP's, Part I 5 4 V, VII, VIII, IX 23-26.04 B0513 Francois Rinfret Laurent Kueny Thomas Wildermann Petteri Tiippana

5 Review of the reg. activities related to NPP's, Part II 4 4 VI, XI (R&A) 02-04.05 B0513 Jozef Misak Heikki Reponen Robby Gray Petr Krs

6 R. of the reg. act. related to facilities and activities other than NPP 5 4 xcutting, XI (trans) 18-21.06 G0E85 Peter Lietava Luc Baekelandt Jean-Paul Samain Frank Nitsche (Luis Jova Sed)

7 R. of reg. act. Related to EPR and to thematic areas in rad. safety 6 4 X, XI (rad.) 11-14.06 G0E85 Igor Grlicarev Karol Janko Pascal Guillaud Debbie Gilley Pascal Deboodt

8 Elaboration of an EU specific IRRS module 3 3 - -

9 Format and template of an IRRS report 5 4 24-27.09 M0E70 Erik Jende Jozef Misak Andrej Stritar Peter Lietava

10 MS preparations to host, conduct and follow-up on IRRS mission 5 4 05-08.11 B0513 Steve Evans Andreas Schefer Gustaf Lövenhielm Igor Grlicarev Jan Husatcek

11 Application of Good Practices 3 3

Page 46: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Consultancy Reports so far

9/18/20123nd Meeting of the EU IRRS CG and IAEA 46

Page 47: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Collected Recommendations

9/18/20123nd Meeting of the EU IRRS CG and IAEA 47

Page 48: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Standard Mission Schedule

9/18/20123nd Meeting of the EU IRRS CG and IAEA 48

Time SAT SUN MON TUE WED THU FRI SAT SUN

9:00-10:00

Arr

iva

l o

f T

ea

m M

em

be

rs

Team building

meeting:

• 5 minutes/TM

self-intro

• Refresher

training

Entrance

Meeting

Inte

rvie

ws

Vis

its

Inte

rvie

ws

Vis

its

Inte

rvie

ws

Vis

its/

EP

R e

xerc

.

DT

C w

rite

s

intr

od

uct

ory

pa

rts

TM write Report

TL and DTL review

introductory part

• Discussing and

improving Draft

Report

• Cross-Reading

• TL, DTL, TC and

DTC read

everything

Free

day

, So

cial

To

ur

Re

ad

ing

, C

ross

-re

ad

ing

of

the

Re

po

rt

10:00-11:00

11:00-12:00 Draft text to TL

12:00-13:00

Lunch Lunch with

Host

Standing lunch Standing

lunch Standing lunch Standing lunch Standing lunch

13:00-14:00

Inte

rvie

ws

Vis

its In

terv

iew

s

Vis

its

Inte

rvie

ws

Vis

its/

EP

R E

xerc

ise

DT

C w

rite

s in

tro

du

cto

ry p

art

s Policy Discussions

Finalisation of the

Draft Report

14:00-15:00 Initial Team

Meeting:

• IRRS process

• Main

objectives

• Report writing

• Schedule

• First

observations

• In-Group

discussions

Inte

rvie

ws 15:00-16:00

Se

cre

tari

at

ed

its

the

re

po

rt

Pre

limin

ary

Dra

ft R

epo

rt

Re

ady

Cro

ss-r

ea

din

g b

y T

M

16:00-17:00

Written preliminary

findings delivered

17:00-18:00 Daily Team

Meeting

Daily Team

Meeting

Daily Team

Meeting:

Discussion of

findings

Daily Team

Meeting

Daily Team

Meeting

18:00-20:00 Informal

dinner Team Dinner Dinner Dinner Dinner Dinner Dinner Dinner

20:00-24:00 Writing of

the report

Writing of the

report

Secretariat

edits Report

TM write

Report

Writing of the

report TM Read Draft

Secretariat edits the

report

MON TUE WED THU FRI

9:00-10:00

Individual discussions

of Rs, Ss and GPs with

counterparts

Cross-Reading

TL, DTL, TC and DTC read

everything

Finalisation

Common read through

and finalisation by the

Team Discussion with Host

Submission of the Final Draft 9:00-10:00

10:00-12:00

Exit Meeting

Press Conference

10:00-12:00 Submission of the Draft

to the Host

12:00-13:00 Standing lunch Standing lunch Lunch Standing Lunch Lunch 12:00-13:00

13:00-15:00 Policy Discussions

Discussion of the

report by the

team

TC

, D

TC

pre

pa

re E

xecu

tiv

e

Su

mm

ary

an

d e

xit

pre

sen

tati

on

Ho

st r

ea

ds

Dra

ft

TL

fin

ali

ses

Exe

cuti

ve

Su

mm

ary

an

d e

xit

pre

sen

tati

on

TC

Dra

fts

the

Pre

ss

Re

lea

se

Written comments by the Host

Team meeting for

finalisation of the Report

Departure Home

13:00-15:00

15:00-17:00

Individual discussions

of Rs, Ss and GPs with

counterparts

15:00-17:00

17:00-18:00 Daily Team Meeting Discussion of Executive

Summary

Briefing of the DDG

Finalisation of the press

release

17:00-18:00

18:00-20:00 Dinner Dinner Dinner

Farewell Dinner

18:00-20:00

20:00-21:00 Secretariat includes

changes Secretariat finalises text Free

20:00-21:00

21:00-24:00 Free 21:00-24:00

Page 49: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Standard Team Assignments

9/18/20123nd Meeting of the EU IRRS CG and IAEA 49

Team activitiesa) Smallh) Medium Large Follow-upg)

Team Lead (TL, DTL, TC, DTC)b)

3 3 3 3

Group A

Governmental R&F (mod 1)

Global nuclear safety regime (mod 2)

Interface with security (mod 12)

3c)

2c) 3

2c) Group B

Responsibilities of the regulatory body (mod 3)

Management system (mod 4)

Development of regulations and guides (mod 9)f)

3 3

Group C

Authorization (mod 5)

Review and assessment (module 6) 2

2 2

2 Group D

Inspection (mod 7)

Enforcement (mod 8)

2 2

Group E

Emergency preparedness (mod 10)

2

2 2

3

Group F

Other optional thematic areas (mod 11)

- control of medical exposures

- control of chronic exposures (radon, NORM and past

practices) and remediation

1 1

Facilities/Activitiesd)

Nuclear power plants

Radiation sources applications

Research reactors

Fuel cycle facilities

Waste management facilities

Decommissioning

Transport

- 2 5

Fukushimae)

Temporary, should be included in standard modules - 1 1 -

Administration 1 1 1 1

Total 11 19 23 11

a) Numbers of experts include IAEA staff, b) DTC is assigned to a Group, c) DTL supports Group Ad) For small nuclear programs the Facilities and Activities are to be reviewed by Groups C – F. Experts allocated to Facilities/Activities in medium and large missions may need to work together with the experts in Group F. For large programs the number of reviewers may be less than 5 according to the needs of the mission.e) The Fukushima module should be reviewed also for small programs and in follow-up missions even if there is no dedicated reviewer to thatf) Groups C through E review the respective contents of the regulations and guides (provided it is in the scope of the mission) and report to Group Bg) Numbers of experts of follow-up missions are relevant for large nuclear countries and should be adjusted for small non-nuclear and medium size nuclear countries according to the actual needs.h) Definitions:Small : No NPPs, few Facilities/Activities Medium : Less than 5 NPP units (in construction, operating, to decommission), few Facilities/ActivitiesLarge : 5 or more NPP units, and/or many Facilities/Activities

Page 50: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

STATUS OF IRRS GUIDELINES

9/18/20123nd Meeting of the EU IRRS CG and IAEA 50

Page 51: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Current Guidelines Version

• Released in 2010, last revised in March 2011

9/18/20123nd Meeting of the EU IRRS CG and IAEA 51

Page 52: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Recently Revised Version

• To be published soon

9/18/20123nd Meeting of the EU IRRS CG and IAEA 52

Page 53: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Recently Revised Version

9/18/20123nd Meeting of the EU IRRS CG and IAEA 53

Page 54: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

New Version to be Elaborated

• Based on the results of the Targeted Consultancies

• With emphasis on practical guidance

• To elaborate in 2013

9/18/20123nd Meeting of the EU IRRS CG and IAEA 54

Page 55: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

PUBLICATION OF IRRSINFORMATION

9/18/20123nd Meeting of the EU IRRS CG and IAEA 55

Page 56: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Shared Area for Consultancies

9/18/20123nd Meeting of the EU IRRS CG and IAEA 56

Page 57: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

Shared Area for this Meeting

9/18/20123nd Meeting of the EU IRRS CG and IAEA 57

http://gnssn.iaea.org/NSNI/Shared%20Documents/Forms/AllItems.aspx?RootFolder=%2FNSNI%2FShared%20Documents%2FOPEN%20Shared%20Files%2FENSREG%20IRRS%20CG%20%2D%20IAEA%20Meeting%2C%2018%2E09%2E2012&InitialTabId=Ribbon%2EDocument&VisibilityContext=WSSTabPersistence

Page 58: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

IRRS Homepage

• Under development• To access from RegNet ReSCoN• Three levels:

• Open Access Public Area (anonymous users), • IRRS Stakeholders Restricted Area (registered users), • IAEA Restricted Area (IAEA registered users);

9/18/20123nd Meeting of the EU IRRS CG and IAEA 58

Page 59: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA

IRRS Homepage (cont.)

9/18/20123nd Meeting of the EU IRRS CG and IAEA 59

Page 60: 3 Meeting of the EU IRRS Coordination Group and … Documents/OPEN Shared...to GSR Part 1 Requirements (in decreasing order) Eu missions all missions Analysis of References 3nd Meeting

IAEA 9/18/20123nd Meeting of the EU IRRS CG and IAEA 60

THANK YOU FOR YOUR ATTENTION