View
9
Download
0
Category
Preview:
Citation preview
Dr Nirmal Kandel, MBBS, MA (Anthropology), MPH, EMBA
Team Lead – JEE Thailand
26 – 30 June, 2017
Bangkok, Thailand
Joint external evaluation
Joint External Evaluation2
2
IHR monitoring and evaluation framework (IHR – MEF)
IHR Review
Committee makes
recommendations
IHR
(2005)
IHR
Revie
w
Com
mitte
e
2005 2014 2015 2016
The first JEE
mission is
conducted
JEE Tool is
developed
Combining the
GHSA Action
packages and the
IHR Capacities
WHA
58
The IHR (2005)
is adopted by
the 58th World
Health
Assembly
(WHA)
WHA61.2 is
adopted. WHO
develops a
framework for
annual reporting
to the WHA
2008
IHR M&E
Framework
Joint External Evaluation3
IHR monitoring and evaluation framework (IHR – MEF)
Country
plannin
g
IHR
MEF
Annual Reporting
After Action Review
Exercises
Joint External Evaluation
• Transparency
• Mutual accountability
• Trust building
• Appreciation of
public health benefits
• Dialogue
• Sustainability
Joint External Evaluation4
Process improvement approach
IHR/preparedness
for health security
Using IHR
Monitoring and
Evaluation
Framework
Use of information to
develop action plan
and costing
Support to
- Priority capacities
- Priority countries
Health systems
National review
cycle and
budget planning
Joint External Evaluation5
The JEE tool: overview
In February 2016, the WHO developed the joint external evaluation (JEE) tool.
The JEE tool consists of 19 technical areas.
The JEE tool assesses country capacity under the International Health
Regulations (2005) to prevent, detect and rapidly respond to public health
threats whether occurring naturally or due to deliberate or accidental events.
The JEE tool can be used for internal self-evaluation or external evaluation.
Since February 2016, all external evaluations are being done using the JEE tool.
Joint External Evaluation6
JEE tool: core elements
The JEE tool is a data gathering instrument designed to evaluate
IHR capacities for health security across all relevant sectors at the
national level. The 19 technical areas of the tool are arranged
according to the following core elements:
• Preventing and reducing the likelihood of outbreaks and
other public health hazards and events defined by the IHR
(2005) is essential.
• Detecting threats early to save lives.
• Rapid and effective response requires multisectoral, national
and international coordination and communication.
Joint External Evaluation7
JEE tool: outcomes
This tool specifically helps to:
• determine the baseline capacity, including gaps and needs;
• inform the development of implementations plans;
• measure progress on work implemented across the IHR core
capacities; and
• highlight gaps and needs for current and prospective donors and
partners, as well as to inform country level planning and priority
setting.
Joint External Evaluation8
JEE process: a different kind of evaluation
1. Voluntary external evaluation – openness and transparency
2. Peer-to-peer review is a fully collaborative process, with joint development of scores
and priority actions; it is not an audit or an inspection
3. Multisectoral includes agriculture, wildlife, security, and others, both within the host
country and on the external team
4. Field visits support and inform technical area discussions
5. Integrates and supports findings from other assessments
6. Focus is on the development of priority actions
7. Final report presented to host country within two weeks of completion of the mission
8. Broad donor and international support is on a common platform
Joint External Evaluation9
JEE process final report
1. Focus on “end user” needs, i.e. establishing baseline and next steps to
strengthen capacity in each technical area. These include:
• Scores
• Strengths
• Areas which need strengthening
• Top three (maximum five) priority actions for each technical area.
2. The final report is typically provided to the host country for review within two
weeks of completion of the mission.
3. Evaluation results are openly available and posted online.
Joint External Evaluation10
Experiences from JEE mission
Member States/countries, international organizations, and donors/partners have
considered the external evaluation process a success (for example, Pakistan at the
WHA 2016 encouraged all Member States to conduct the JEE mission, based on their
experience).
The evaluation process has also been a learning experience for those who have
participated in the JEE missions.
Forty-seven countries have already completed external JEEs as of now.
It is standard JEE practice to have all evaluation reports publicly available on the WHO
website as of now 26 reports are already online and remaining are in process
Joint External Evaluation11
COMPLETED - 47
IN PIPELINE - 27
Afghanistan, Albania, Armenia, Bahrain, Bangladesh, Belgium, Belize, Benin, Cote d'Ivoire,
Cambodia, Ghana, Guinea, Eritrea, Ethiopia, Finland, Jordan, Kenya, Kuwait, Kyrgyzstan, Lao
People's Democratic Republic, Latvia, Lebanon, Liberia, Maldives, Mauritania, Mongolia
Morocco, Mozambique, Myanmar, Namibia, Nigeria, Oman, Pakistan, Qatar, Saudi Arabia,
Senegal, Sierra Leone, Slovenia, Somalia, Sri Lanka, Sudan, Tunisia, Turkmenistan, United
Republic of Tanzania and Zanzibar , United Arab Emirates, United States of America, Viet Nam
Australia, Bhutan, Cameroon, Canada, Chad, Comoros, Djibouti, Indonesia, Iraq, Japan,,
Lesotho, Libya, Madagascar, Malaysia, Mali, New Zealand,, Federated States of Micronesia ,
Republic of Korea, Singapore, South Africa, Switzerland, Liechtenstein, Thailand, The Gambia,
Togo, Uganda, Zambia
JEE Missions(June 2017)
Joint External Evaluation12
Examples of impact of external assessment
“The National Center .. AMR reference laboratory
has since 2014 been certified by the international
CEASAR program AMR External Quality
Assessment program”
“Passive monitoring in animals is in place for over
80 notifiable diseases and in humans for 52
diseases (including zoonotic diseases)”
“Further enhancement of co-operation between the
health and veterinary services could be pursued
through formalized procedures and designated
responsibilities to support the sustainability, even if
good informal exchange of information exists”
“This is the first time we are meeting together and
we realized the concept of working together for the
people of Balochistan and we commit to support and
work together with provincial health office”
”The country formed a permanent cross-cutting
ministerial council to put policies, plans, and
processes in place to comply with the International
Health Regulations”
” The vaccination coverage for the first dose of the
MMR vaccine in the country for children aged 2
years is above 92%.”
Joint External Evaluation13
The role of evaluations
Country: Partner Interaction
Joint External Evaluation14
Tools, Guides and Templates (Supporting Materials)
Joint External Evaluation Implementation Guide
Joint External Evaluation Tool and Process Overview
Joint External Evaluation Reporting Template
JEE Roster Database
Self-Evaluation Toolkit
Standard Operating Procedures for JEE Roster of Experts
Online Team Orientation Course
Team Lead Training Course
Standard JEE opening presentation, technical areas presentation and country health system overview templates
Performance Evaluation of JEE and Checklists.
Accessible On: http://www.who.int/ihr/procedures/implementation/en/
THANK YOU
Recommended