M&E Basics

Miguel Aragon Lopez, MD, MPH.UNAIDS M&E Senior Adviser

12th May 2009

Why Standardized M&E Terminology?

UNCT 26th February 2009

A common understanding of M&E terminology is critical for:

–maintaining clear communication

–taking a common approach

M&E Definitions: Why Standardized M&E Terminology?

UNCT 26th February 2009

• Monitoring—routine tracking and reporting of priority information about a plan / program / project, its inputs and intended outputs, outcomes and impacts

• Measurement of progress toward achieving program/project objectives; most often involves counting what we are doing.

M&E Definitions: Why Standardized M&E Terminology?

Evaluation—the rigorous, scientifically-based collection of information about plan / program / intervention activities, characteristics, and outcomes that determine the merit or worth of the program/intervention

ProgramImprovement

ProgramImprovement

Reporting/Accountability

Reporting/Accountability

Data Sharing with PartnersData Sharing with Partners

The Purpose of M&E

M&E Definitions: Results – RBM approach

UNDAF and agency programmes in terms of a hierarchy of SMART results which has five levels:

–MDG related national priority/ goal (equated with impact)–UNDAF outcome, know in Moz also as pillars –Outcome of one or more agencies working together–Output usually of one agency, but possibly of more than one working together–Activity Result

SMART Results

Specific: Results must use change language – they must describe a specific future condition

Measurable: Results, whether quantitative or qualitative, must have measurable indicators, making it possible to assess whether they were achieved or not

Achievable: Results must be within the capacity of the UNCT and partners to achieve

Relevant: Results must make a contribution to selected priorities of the national development framework

Timebound: Results are never open-ended - there is an expected date of accomplishment

M&E Definitions: Results – RBM approach

The chain of results: causal sequence for an intervention to achieve desired objective

UNCT 26th February 2009

. Management

. Training

. Counseling

. Logisticmanagement. Operation research. BCC. Conference. Facilitation. etc.

. Services - Access - Quality. Awareness. Knowledge. Attitude. Capacities. Competency. Opinion. Aspiration. Motivation

. Behaviors

. Practices

. Decision

. Utilizationof services

Quality of lifeConditions:. Human. Economic. Civic. EnvironmentMDGs:. Poverty. Morbidity. Mortality. HIV prevalence. Education. Employment. Gender equality

INPUTS ACTIVITIES OUTPUTS OUTCOMES IMPACT

.Infrastructure

. Human

. Finance

. Equipment

. Technology

. Policy

. Time

. Volunteers

. Partners

Measure process Measure impact

Planning Implementation Outcomes

-Formative Evaluation(Planning and Assessment)

-Input/Output Monitoring-Process Evaluation

-Outcome Monitoring-Outcome Evaluation-Impact Monitoring-Impact Evaluation

What & how well we are doing?

Baselines, targets and performance

Current level of

achievement

Commitment

Performance

Baseline Target Achievement

WFP Emergency Operation M&E Framework

Program-based Data Population-based Survey

X kg maize,X kg oilX Kg other

Input (Resources)

Distribution ofFamily ration toWomen

Activities ( Interventions,

Services)

# of familyration recipients disaggregatedby gender

Output Targeted

women receivingfull family ration

% of target houseHold with adequateFood supply

OutcomesIncreased

household foodsupply

Average # ofMeals per day by genderand age

Impact Increased

consumptionespecially W,

Ch & V Ind.

Measure process Measure impact

RESULTS

HIV/AIDS M&E Framework

Program-based Data Population-based Biological, Behavioral &

Social Data

StaffFundsMaterialsFacilitiesSupplies

Input (Resources)

TrainingsServicesEducationTreatmentsInterventions

Activities ( Interventions,

Services)

# Staff Trained# Condoms Provided# Clients Served# Tests Conducted

Output (Immediate

Effects)

Situation AnalysisResponse AnalysisStakeholder NeedsResource AnalysisCollaboration plans

Program Development

Data

Assessment & Planning

Provider BehaviorRisk BehaviorService Use Clinical OutcomesQuality of Life

Outcomes(Intermediate

Effects)

Social Norms HIV prevalenceSTI IncidenceAIDS MorbidityAIDS MortalityEconomic Impact

Impact (Long-term

Effects)

Measure process Measure impact

M&E Definitions: Indicators

An Indicator is….a variable

that measures one aspect of a program/project and useful to

measure changes

Indicators are measures used to monitor progress made towards the achievement of intended RESULTS, considering

as the output, outcome or impact of a development intervention.

M&E Definitions: SMART Indicators

Specific: indicators need to measure what they claim to measure

Measurable: can be quantified and measured by some scale

Achievable: can data on the indicator actually be colleted?

Relevant: does it provide information that is relevant to the programme decision makers?

Time-bound: when is change expected?

Strategic Planning for M&E: Setting Realistic Expectations

Most Some Few*All

Input/ Output Monitoring

Input/ Output Monitoring

Process EvaluationProcess

EvaluationOutcome

Monitoring / Evaluation

Outcome Monitoring / Evaluation

Levels of Monitoring & Evaluation EffortLevels of Monitoring & Evaluation Effort

Number of

Projects

Number of

Projects

15

Impact Monitoring / Evaluation

Impact Monitoring / Evaluation

Key messages:

1. The main purpose of M&E is programme/project improvement.

2. M&E is not only about INDICATORS.

3. M&E is an essential management tool and it is present along programme/project implementation.

4. M&E starts with the planning process.

THANK YOU