Upload
others
View
3
Download
0
Embed Size (px)
Citation preview
Impact Assessment
Summary Findings Presentation
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
2
Session Objective
To Present Summary Findings of the Impact Assessment conductedon CATHSSETA Funded and Non-
funded Learning Interventions for the period 2011/2012 to
2015/2016
3
Introduction
4
Section 4Section 5
Section 2Section 6
Section 7
Section 3
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
5
Agenda
6
Section 2
Results Chain as the Impact
Assessment Framework
7
Objective 1: To Provide, Through Funded Learnerships/Internships, Relevant Matriculants and Graduates with Appropriate Exposure to the Workplace to Improve Their Career Prospects
Learnerships Internships
Results Chain as the Impact
Assessment Framework
8
Objective 1: To Provide, Through Funded Learnerships/Internships, Relevant Matriculants and Graduates with Appropriate Exposure to the Workplace to Improve Their Career Prospects
Learnerships Internships
Results Chain as the Impact
Assessment Framework
9
Objective 2: To Contribute, Through Funded Learnerships, To Improved Employer Circumstances to Ensure Ongoing Employer Involvement in These Programmes
Learnerships Internships
Results Chain as the Impact
Assessment Framework
10
Objective 2: To Contribute, Through Funded Learnerships, To Improved Employer Circumstances to Ensure Ongoing Employer Involvement in These Programmes
Learnerships Internships
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
11
Agenda
12
Section 3
Input data that informed
Assessment Findings
Planned
Consultations
Actual Consultations
Stakeholders
Consulted
Percentage
Completed
Focu
s
Gro
up
s Learners and Interns 100 29 29%
Employers 50 42 84%
Surv
eys
Online300
315131%
Telephonic 78
Interviews 30 34 113%
Total 480 498 104%
Data Collection
13
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
14
Agenda
15
Section 4
Assessment Findings: Impact of
Learning Programmes
16
47%
59%
76%
59%
50%
75%
61%
73%
78%
65%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Learners/Interns Employed inAppropriate Occupations
Increased Earning Capacity ofLearners/Interns
Improved Career Advancementfor Learners/Interns
Improved Qualifications forLearners/Interns
Sustained, PermanentEmployment
Interns Learners
Learner and Intern Specific Impacts
Assessment Findings: Impact of
Learning Programmes
17
Learners/Interns Employed per Sector
73%
64%
100%
83%81%
72%
67%
38%
75% 76%
100%
79%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Conservation Arts, Culture andHeritage
Gaming and Lotteries Hospitality Sport, Recreationand Fitness
Travel
Interns Learners
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
18
Agenda
19
Section 5
Rating Scale
80%-100% Exemplary
66%-79% Met
34%-65% Partially Met
0%-33% Not Met
Summary Findings:Rating Scale
20
Activity Output Outcome Impact
To provide, through funded Learnerships, relevant
Matriculants with appropriate exposure to the workplace to
improve their career prospects
Provide Learners with work experience
(Employers)
Provide Learners with training (Employers)
Provide Learners with mentoring
(Employers)
Provide Learner certification (CATHSSETA)
Collaborate with training provider on
Learnership (Employer)
Learners with work experience
Trained Learners
Mentored Learners
Increased collaboration
between employers and training
providers
Learners With Job Ready Skills and
Competence
Greater integration between training
providers and employers
Learners (particularly those with
demographics in line with Transformative targets) employed in
appropriate occupations
Increased earning capacity of Learners
Improved career advancement for
Learners
Improved qualifications for
Learners
Sustained, permanent
employment
Objective 1
Summary Findings - Learnerships
21
Summary Findings - Internships
Activity Output Outcome Impact
Provide Interns with work experience
(Employers)
Provide Interns with training (Employers)
Provide Interns with mentoring
(Employers)
Provide Interns with career guidance
(employers)
Interns with work experience
Trained Interns
Mentored Interns
Career guidance
Interns With Job Ready Skills and
Competence
Interns (particularly those with
demographics in line with Transformative targets) employed in
appropriate occupations
Increased earning capacity of Interns
Improved career advancement for
Interns
Improved qualifications for
Interns
Sustained, permanent
employment
To provide, through funded Internships, relevant
graduates with appropriate exposure to the workplace
to improve their career prospects
Objective 1
22
Summary Findings - Learnerships
To contribute, through funded Learnerships, to improved employer circumstances to ensure ongoing Employer
involvement in these programmes
Recruit and place Learners (Employers)
Provide Employers with support during
Learnership (CATHSSETA)
Provide Employer with tax incentives,
funding etc. to encourage them to
take on Learners (CATHSSETA)
Increased Employer capacity
Increased Employer capability
Financial benefits accruing to the
Employer (e.g. tax breaks, grants, Youth
Wage Subsidy, B-BBEE Status)
Increased Employer business growth
Increased Employer revenues
Reduced Employer costs
Overall cost of learning intervention
to the company
Increased Employer take on of Learners
Employers assume ownership of the
Learnership programme
Decreased incidence of Scarce Skills
Improvement in Critical Skills
Greater Employer willingness to take on Learners in the future
Invite Employers to apply (CATHSSETA)
Pay grants (CATHSSETA)
Activity Output Outcome ImpactObjective 2
23
Summary Findings - Internships
Recruit and placement Interns
(Employers)
Provide Employers with support during
Internship (CATHSETA)
Provide Employer with tax incentives,
funding etc. to encourage them to
take on Interns (CATHSSETA)
Increased Employer capacity
Increased Employer capability
Financial benefits accruing to the
Employer (e.g. tax breaks, grants, Youth
Wage Subsidy, B-BBEE Status)
Increased Employer business growth
Increased Employer revenues
Reduced Employer costs
Overall cost of learning intervention
to the company
Increased Employer take on of Interns
Employers assume ownership of the
Internship programme
Decreased incidence of Scarce Skills
Improvement in Critical Skills
Greater Employer willingness to take on Interns in the future
Invite Employers to apply (CATHSSETA)
Pay grants (CATHSSETA)
To contribute, throughfunded Internships, to improved employer
circumstances to ensure ongoing Employer
involvement in these programmes
Activity Output Outcome ImpactObjective 2
24
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
25
Agenda
26
Section 6
Assessment Findings: Delivery against
Targets
27
Transformation
Imperative
Target Description CATHSSETA’s
Targets
Actual Met
1 Age Youth – under 35 years’
old
60% 82%
2 Disability All forms of disability 1% 0,7%
3 Gender Female 65% 67%
4 Race Black 85% 94%
5 Geography Rural and informal
settlements
45% 35%
Transformation Imperatives – Learnerships
Special Note: With regard to the assessed delivery against the target for Disability, the Actual figure as reflected above was determined by an analysis of QMR data, which was deemed by CATHSSETA to be under-reporting this figure. Colloquially, CATHSSETA believe they have met the target.
Assessment Findings: Delivery against
Targets
28
Transformation Imperatives – Internships
Transformation
Imperative
Target Description CATHSSETA’s
Targets
Actual Met
1 Age Youth – under 35 years’
old
60% 96%
2 Disability All forms of disability 1% 0,7%
3 Gender Female 65% 56%
4 Race Black 85% 90%
5 Geography Rural and informal
settlements
45% 54%
Special Note: With regard to the assessed delivery against the target for Disability, the Actual figure as reflected above was determined by an analysis of QMR data, which was deemed by CATHSSETA to be under-reporting this figure. Colloquially, CATHSSETA believe they have met the target.
Agenda
1
2
3
4
6
Session Objective and Introduction
Results Chain as the Impact Assessment Framework
Input data that informed Assessment Findings
Assessment Findings: Impact of Learning Programmes
Assessment Findings: Delivery against Targets
5 mins
5 mins
5 mins
5 mins
5 mins
5Assessment Findings: Underlying Impact drivers
measured against the Results Chain10 mins
7 Lessons Learnt 10 mins
29
Agenda
30
Section 7
Lessons Learnt
Process Structures
31
Lessons Learnt
CATHSSETA
Internal Processes1 Key Finding
CATHSSETA processes are viewed as inefficient (as reported by Employers and
Learners)
Insufficient time allowed for Employers to apply and recruit for learning programmes
Learners are receiving their certificates very late or are receiving them with incorrect details
32
Lessons Learnt
CATHSSETA should explore the following: Increasing staffing to address resourcing constraints that may be negatively
impacting support provided to Employers Advance planning of learning programme funding windows to enable
earlier notice to Employers and better alignment with industry timelines Better management of the certification process/ expectations
33
CATHSSETA
Internal Processes1 Suggested Resolution
Lessons Learnt
Employers
Internal Processes2 Key Finding
The quality and extent of mentoring provided by Employers does not fully
meet Learner/ Intern needs
34
Suggested Resolution
CATHSSETA to investigate training to be provided to mentors, based on
Employers specification of needs.
Lessons LearntCATHSSETA
Internal Processes
Employers
Internal Processes
3
Key Finding
CATHSSETA engagement with Employers reported as inadequate
Employer have reported that low levels of engagement with CATHSSETA limit the efficacy of the relationship, and the degree of beneficial support from CATHSSETA
Employers have requested guidelines for the running of learning programmes
Stipends are deemed inadequate to meet Learner/Intern needs, resulting in Learner/Intern hardship or cost overruns for Employers
Employers have raised concerns regarding the lack of support received from CATHSSETA
Employers have requested additional funding for mentorship Employers have raised concerns that CATHSSETA is not present during the
induction of their Learnership/Internship programmes35
Lessons Learnt
CATHSSETA
Internal Processes
Employers
Internal Processes
3
Suggested Resolution
CATHSSETA to consider the following:
Increased engagement with Employers to better manage the relationship,
and to proactively address Employers needs
Proactively managing Employer and Intern/ Learner expectations around
stipends, by communicating stipend focus and structural limitations
Provision of Guidelines for Employers for conducting learning programmes
Improved CATHSSETA presence at Learner/Intern induction programmes
36
Lessons LearntCATHSSETA
Internal Processes
Interns/Learners
4
Key Finding
CATHSSETA engagement with Learners/Interns reported as inadequate
• Learners have raised concerns about the level of contact they have with CATHSSETA and the extent of support provided
37
Suggested Resolution
CATHSSETA should explore the following: • A higher level of engagement with Learners/ Interns, e.g. during induction,
monitoring, and graduation
Lessons LearntEmployers
Internal Processes
Training Providers
5
Key Finding
Communication and support between Employers of Learners and Training
Providers requires improvement.
• Employers are unaware of which training providers are available and which ones are recommended by CATHSSETA
• Employers have raised concerns that training providers do not always provide effective training and that material is sometimes outdated
38
Suggested Resolution
CATHSSETA to consider the following:
• Increasing Employer awareness of training providers
• Providing Employers with increased avenues for reporting issues with training providers and training material, should this be required.
Assessment Findings: Impact of
Learning Programmes
39
47%
59%
76%
59%
50%
75%
61%
73%
78%
65%
0%
10%
20%
30%
40%
50%
60%
70%
80%
90%
100%
Learners/Interns Employed inAppropriate Occupations
Increased Earning Capacity ofLearners/Interns
Improved Career Advancementfor Learners/Interns
Improved Qualifications forLearners/Interns
Sustained, PermanentEmployment
Interns Learners
Learner and Intern Specific Impacts
Activity Output Outcome Impact
To provide, through funded Learnerships, relevant
Matriculants with appropriate exposure to the workplace to
improve their career prospects
Provide Learners with work experience
(Employers)
Provide Learners with training (Employers)
Provide Learners with mentoring
(Employers)
Provide Learner certification (CATHSSETA)
Collaborate with training provider on
Learnership (Employer)
Learners with work experience
Trained Learners
Mentored Learners
Increased collaboration
between employers and training
providers
Learners With Job Ready Skills and
Competence
Greater integration between training
providers and employers
Learners (particularly those with
demographics in line with Transformative targets) employed in
appropriate occupations
Increased earning capacity of Learners
Improved career advancement for
Learners
Improved qualifications for
Learners
Sustained, permanent
employment
Objective 1
Summary Findings - Learnerships
40
Session Close
1
2
3
4
5
6
Thank You
41