Joint external evaluation · The JEE tool consists of 19 technical areas. The JEE tool assesses country capacity under the International Health Regulations (2005) to prevent, detect

Dr Nirmal Kandel, MBBS, MA (Anthropology), MPH, EMBA

Team Lead – JEE Thailand

26 – 30 June, 2017

Bangkok, Thailand

Joint external evaluation

Joint External Evaluation2

2

IHR monitoring and evaluation framework (IHR – MEF)

IHR Review

Committee makes

recommendations

IHR

(2005)

IHR

Revie

w

Com

mitte

e

2005 2014 2015 2016

The first JEE

mission is

conducted

JEE Tool is

developed

Combining the

GHSA Action

packages and the

IHR Capacities

WHA

58

The IHR (2005)

is adopted by

the 58th World

Health

Assembly

(WHA)

WHA61.2 is

adopted. WHO

develops a

framework for

annual reporting

to the WHA

2008

IHR M&E

Framework


IHR monitoring and evaluation framework (IHR – MEF)

Country

plannin

g

IHR

MEF

Annual Reporting

After Action Review

Exercises

Joint External Evaluation

• Transparency

• Mutual accountability

• Trust building

• Appreciation of

public health benefits

• Dialogue

• Sustainability


Process improvement approach

IHR/preparedness

for health security

Using IHR

Monitoring and

Evaluation

Framework

Use of information to

develop action plan

and costing

Support to

- Priority capacities

- Priority countries

Health systems

National review

cycle and

budget planning


The JEE tool: overview

In February 2016, the WHO developed the joint external evaluation (JEE) tool.

The JEE tool consists of 19 technical areas.

The JEE tool assesses country capacity under the International Health

Regulations (2005) to prevent, detect and rapidly respond to public health

threats whether occurring naturally or due to deliberate or accidental events.

The JEE tool can be used for internal self-evaluation or external evaluation.

Since February 2016, all external evaluations are being done using the JEE tool.


JEE tool: core elements

The JEE tool is a data gathering instrument designed to evaluate

IHR capacities for health security across all relevant sectors at the

national level. The 19 technical areas of the tool are arranged

according to the following core elements:

• Preventing and reducing the likelihood of outbreaks and

other public health hazards and events defined by the IHR

(2005) is essential.

• Detecting threats early to save lives.

• Rapid and effective response requires multisectoral, national

and international coordination and communication.


JEE tool: outcomes

This tool specifically helps to:

• determine the baseline capacity, including gaps and needs;

• inform the development of implementations plans;

• measure progress on work implemented across the IHR core

capacities; and

• highlight gaps and needs for current and prospective donors and

partners, as well as to inform country level planning and priority

setting.


JEE process: a different kind of evaluation

1. Voluntary external evaluation – openness and transparency

2. Peer-to-peer review is a fully collaborative process, with joint development of scores

and priority actions; it is not an audit or an inspection

3. Multisectoral includes agriculture, wildlife, security, and others, both within the host

country and on the external team

4. Field visits support and inform technical area discussions

5. Integrates and supports findings from other assessments

6. Focus is on the development of priority actions

7. Final report presented to host country within two weeks of completion of the mission

8. Broad donor and international support is on a common platform


JEE process final report

1. Focus on “end user” needs, i.e. establishing baseline and next steps to

strengthen capacity in each technical area. These include:

• Scores

• Strengths

• Areas which need strengthening

• Top three (maximum five) priority actions for each technical area.

2. The final report is typically provided to the host country for review within two

weeks of completion of the mission.

3. Evaluation results are openly available and posted online.


Experiences from JEE mission

Member States/countries, international organizations, and donors/partners have

considered the external evaluation process a success (for example, Pakistan at the

WHA 2016 encouraged all Member States to conduct the JEE mission, based on their

experience).

The evaluation process has also been a learning experience for those who have

participated in the JEE missions.

Forty-seven countries have already completed external JEEs as of now.

It is standard JEE practice to have all evaluation reports publicly available on the WHO

website as of now 26 reports are already online and remaining are in process


COMPLETED - 47

IN PIPELINE - 27

Afghanistan, Albania, Armenia, Bahrain, Bangladesh, Belgium, Belize, Benin, Cote d'Ivoire,

Cambodia, Ghana, Guinea, Eritrea, Ethiopia, Finland, Jordan, Kenya, Kuwait, Kyrgyzstan, Lao

People's Democratic Republic, Latvia, Lebanon, Liberia, Maldives, Mauritania, Mongolia

Morocco, Mozambique, Myanmar, Namibia, Nigeria, Oman, Pakistan, Qatar, Saudi Arabia,

Senegal, Sierra Leone, Slovenia, Somalia, Sri Lanka, Sudan, Tunisia, Turkmenistan, United

Republic of Tanzania and Zanzibar , United Arab Emirates, United States of America, Viet Nam

Australia, Bhutan, Cameroon, Canada, Chad, Comoros, Djibouti, Indonesia, Iraq, Japan,,

Lesotho, Libya, Madagascar, Malaysia, Mali, New Zealand,, Federated States of Micronesia ,

Republic of Korea, Singapore, South Africa, Switzerland, Liechtenstein, Thailand, The Gambia,

Togo, Uganda, Zambia

JEE Missions(June 2017)


Examples of impact of external assessment

“The National Center .. AMR reference laboratory

has since 2014 been certified by the international

CEASAR program AMR External Quality

Assessment program”

“Passive monitoring in animals is in place for over

80 notifiable diseases and in humans for 52

diseases (including zoonotic diseases)”

“Further enhancement of co-operation between the

health and veterinary services could be pursued

through formalized procedures and designated

responsibilities to support the sustainability, even if

good informal exchange of information exists”

“This is the first time we are meeting together and

we realized the concept of working together for the

people of Balochistan and we commit to support and

work together with provincial health office”

”The country formed a permanent cross-cutting

ministerial council to put policies, plans, and

processes in place to comply with the International

Health Regulations”

” The vaccination coverage for the first dose of the

MMR vaccine in the country for children aged 2

years is above 92%.”


The role of evaluations

Country: Partner Interaction


Tools, Guides and Templates (Supporting Materials)

Joint External Evaluation Implementation Guide

Joint External Evaluation Tool and Process Overview

Joint External Evaluation Reporting Template

JEE Roster Database

Self-Evaluation Toolkit

Standard Operating Procedures for JEE Roster of Experts

Online Team Orientation Course

Team Lead Training Course

Standard JEE opening presentation, technical areas presentation and country health system overview templates

Performance Evaluation of JEE and Checklists.

Accessible On: http://www.who.int/ihr/procedures/implementation/en/

http://www.who.int/ihr/procedures/implementation/en/

THANK YOU

Documents

Joint external evaluation · The JEE tool consists of 19 technical areas. The JEE tool assesses country capacity under the International Health Regulations (2005) to prevent, detect