12
MASS Project Evaluation Annie Paton [email protected]

MASS Project Evaluation Annie Paton [email protected]

Embed Size (px)

Citation preview

Page 1: MASS Project Evaluation Annie Paton anne@indigops.com

MASS Project Evaluation

Annie Paton

[email protected]

Page 2: MASS Project Evaluation Annie Paton anne@indigops.com

Agenda Indigo Background Overall Evaluation Format Internal Evaluation Topics Evaluation Focus & Objectives Baseline & Monitoring Information

Page 3: MASS Project Evaluation Annie Paton anne@indigops.com

Indigo Background MASS application development & evaluation Local authorities, colleges, charities European Funding

ESF, ERDF, Interreg, LLP High success rate Project Management, Monitoring & Evaluation

Other Services Varied experience Evaluation

£16.5 million projects ESF, ERDF, LLP, Lottery & government funding Transnational (A1 for Jobs, Leonardo) Target group (ESF – LTP – Disengaged school children)

Page 4: MASS Project Evaluation Annie Paton anne@indigops.com

Format Interim Report

August 2010 Report on progress Adhering to timescales & milestones Any barriers to success

Final Report September 2011 Draw conclusions on design, implementation &

success Inform stakeholders of results & impact Stimulate support for mainstreaming Identify further innovation

Page 5: MASS Project Evaluation Annie Paton anne@indigops.com

Internal/Self Evaluation Simona (RO) Self evaluation feeds into external Communication

Effectiveness, frequency, methods, barriers Twice, middle & end (online survey)/ observation

Partnership Meetings Effectiveness, structure, content, cultural aspects Learn & adapt Short post meeting questionnaire

Team working Involvement, motivation & commitment Partner level

Page 6: MASS Project Evaluation Annie Paton anne@indigops.com

Topics

Leonardo Other topics

Innovation * Validity * Dissemination * Valorisation * Transnationality Partnership

Design & Methodology

Project Management & Delivery

Feasibility of Products

Progress

Page 7: MASS Project Evaluation Annie Paton anne@indigops.com

Focus Project Aim 1 – To enable professionals in

Greece, Sweden, Netherlands & Romania to understand the need/value of adapting VET systems in a shift towards learning outcomes....

Project Aim 3 – Ensuring the professionals have the competencies to deliver VET to disaffected groups which is meaningful and conducive to learning and employment outcomes....

Dissemination & Valorisation of results

Page 8: MASS Project Evaluation Annie Paton anne@indigops.com

Project Aim 1 Evaluation Objectives

How feasible is use of EQF to map soft skills at partner level?

Is the value of soft skills within VET in partner countries relevant and recognised?

How effective are the materials and tools for assessment within classroom context?

- Methodologies- Benchmarking (desk research/ consultation)- Partner questionnaire (PM level & tutor level)- Analysis of progress of relevant work

packages/documentation review

Page 9: MASS Project Evaluation Annie Paton anne@indigops.com

Project Aim 3 Evaluation Objectives

What is the impact of the methodologies used in the piloting on disaffected learners?

How do the outcomes for the group compare with that of the outcomes in the past?

Do learners find the tools easy to use? Do the materials meet the requirements of

trainers/tutors? Is there evidence to support employment

outcomes for the group?

Page 10: MASS Project Evaluation Annie Paton anne@indigops.com

Project Aim 3 Evaluation Methodologies

Consultation with piloters (twice, mid point & end) Consultation with tutors (twice, mid point & end) Analysis of outcomes for piloters Comparative analysis with past outcomes Limited budget, best way for each partner,

questionnaire or telephone interviews.

Page 11: MASS Project Evaluation Annie Paton anne@indigops.com

Baseline Information & Monitoring Understand current situation Current learning & employment outcomes for

learners Control group for comparison How do you monitor learners? How do you monitor tutors & teachers? Use of English

Page 12: MASS Project Evaluation Annie Paton anne@indigops.com

Next Steps.... Formalise the framework – Annie Produce a time plan - Annie Send baseline survey - Annie Keep in touch......All