CO-CREATINGERASMUS+ AND THE EUROPEAN SOLIDARITY CORPS

MEASURING PROGRESS, DEFINING SUCCESS

DG Education, Youth, Sport and Culture

European Commission

Anjelina BengyuzovaRoxane Crestian

AGENDA

• Welcome

• Erasmus performance framework

• Looking forward to the next programme

• Group discussion

• Wrap-up

OBJECTIVES OF THE SESSION

Provide information

Get feedback

Build a community of practice

ERASMUS INDICATORS

• Legal basis (primary legislation: regulation)

• Monitoring and evaluation framework (secondary legislation: delegated act)

• Expert group (27 MSs)

ERASMUS INDICATORS – LEGAL BASIS

Legal basis indicators = key indicators

Two main areas to be monitored:

Participants from diverse backgrounds in learning mobilitiy activities Organisations and institutions with a reinforced European and

international dimension

Disaggregation by domains (E&T, youth, sport), Key Action, country,

gender, sector, where relevant

ERASMUS INDICATORS: MONITORING AND EVALUATION FRAMEWORKThe framework will cover details such as:

• specific objectives, fields and KAs each indicator addresses

• definitions of the indicators

• unit of measurement (number of, etc…)

• disaggregation per country

• baseline and target for the indicator

• availability

• frequency of reporting

• data source

• frequency of measurement

• data quality rating

MAIN PRINCIPLES UNDERPINNING THE PREPARATION OF THE LEGAL BASIS AND MONITORING AND EVALUATION FRAMEWORK INDICATORS

Policy relevance

Continuity

Proportionality

PROJECT MANAGEMENT CYCLE

How do my activities contribute to the programme priorities? General Objectives, Specific Objectives, Programme objectives, etc. Provides feedback for informed decision-making

What should my activities achieve in the set timeframe? Indicators, milestones and targets for each priority Regular assessment of milestones

Do my activities progress as foreseen? Regular monitoring and measurement of progress made Reporting on achievements

PLANNING

FEEDBACK

SETTING UP A PERFORMANCE FRAMEWORK

LEADING QUESTIONS

Are my indicators representative of my objectives?

Are they useful to me? To my stakeholders?

How often do I monitor them?

What would I like to change?

.

SMART OBJECTIVES

• Specific objectives specify the situation that needs to be changed and (if relevant) the target group concerned are precise enough to assess if and how well it has been achieved are not too broad, not too vague and not too high-level

• Measureable in an impartial and verifiable way

• Attainable : The objective is challenging enough, but not overly ambitious realistic given the available time, money and staffing discussed and agreed and has received management/political backing

• Relevant to the needs of society/stakeholders, and to the wider political context

• Time-bound: indicates the time by when it must be achieved

• Relevant : Does it measure the right thing? For specific or general objectives, does it really measure result or impact, instead of output? Is it closely linked to the objctive?

• Accepted : Have the definition, target and milestones been discussed and agreed among staff? Are they included in politically endorsed documents?

• Credible : Does it provide credible results? How frequently is data available? Are annual data series available? Is the trend visible?

• Easy : Is it easy to monitor? What is the cost of monitoring? Gathering data should not be too costly nor require disproportionate efforts. Is it easy to understand for non-experts? Is the definition clear and short? Is it free from acronyms or jargon?

• Robust : Can it lead non-insiders to wrong conclusions? Can it generate perverse effects, be easily manipulated?

RACER INDICATORS

ResultsInitial or intermediate effects

ImpactsGlobal or long-term effects

Specific objectives

General objectives

OutputsWhat we deliver

InputsResources

Incr

easi

ng in

flue

nce

ofex

tern

al p

laye

rs a

nd f

acto

rs

ActionsWhat we do

IndicatorBaselineTarget

IndicatorBaselineTarget

IndicatorBaselineTarget

IndicatorBaselineTarget

EC PROGRAMME PERFORMANCE FRAMEWORK

https://eu2019.fi/en/priorities/climate-leadership/emissions-reduction-targets

Join a group Chose a spokeperson of the groupDiscuss within your group Capture your ideas and share them

30 minutes

Playback to the room

DISCUSSION

1. How do you measure progress today? Input? Output? Result? Impact?

2. How do you balance meeting reporting needs and reducing administrative

burden?

3. How do you report this information and use it for decision making?

4. How do you capture the right data at the right moment?

QUESTIONS

Thank you!

1. How do you measure progress today? Input? Output? Result? Impact?

2. How do you balance meeting reporting needs and reducing administrative burden?

BRAINSTORMING

3. How do you report this information and use it for decision making?

4. How do you capture the right data at the right moment?

BRAINSTORMING

BEST PRACTICE EXEMPLE – NL IMPACT TOOL

More information and material available on theNL Erasmus+ Impact tool –Mobility webpage

BEST PRACTICE EXEMPLE – UK IMPACT+ TOOL

Contact:Madeleine ROSE UK National Agency Deputy Director

More information and materialavailable on theUK Erasmus+ Impact and evaluationwebpage

DG EDUCATION, YOUTH, SPORT AND CULTUREEUROPEAN COMMISSION

Anjelina BENGYUZOVA

Programme Manager Erasmus+

Anjelina.BENGYUZOVA@ec.europa.eu

Roxane CRESTIANStrategic Planning and Performance OfficerRoxane.CRESTIAN@ec.europa.eu