View
95
Download
2
Category
Preview:
Citation preview
TB-ELI Outcome Evaluation
Framework & Toolkit
d
September 1st 2016
Agenda
• Introduce impact measurement – moving from traditional output
measurement to outcome measurement
• Collective impact model – TB-ELI’s 8 shared outcomes and how each
project can contribute to those outcomes.
• Social outcomes measurement toolkit – brief intro of the prototype
including screenshots
How Do We Measure Impact?
TB ELI Projects
Activity
+ve
Social
Impacts
Desired
Outcome
Traditionally, many social projects measured Outputs only Outputs only Outputs only Outputs only but OutcomesOutcomesOutcomesOutcomes can also be measured
Project Activity
• Training
Course for
Care Givers
Outputs
• Number of
Training
Courses Run
• Number of
trainees
• Feedback
Scores on
Trainers
Outcomes
• Improvement
in emotional
wellbeing of
caregiver
• Care giver
feeling
confident in
their ability to
care
8 TB-ELI Shared Outcomes for Projects
1. Persons with disabilities experience increased psychological and emotional well-being.
2. Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows.
3. Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation.
4. Persons with disabilities have more opportunities to participate in social, family, economic and community life.
5. Caregivers experience increased psychological and emotional well-being.
6. Caregivers feel confident of their ability to provide competent care and support to persons with disabilities.
7. Caregivers have greater access to support services, network and structure that sustain caregiving.
8. Caregivers have more opportunities to participate in social, family, economic and community life.
Example OutcomeOutcomeOutcomeOutcome Indicators
Stated Shared Outcome Example Outcome Indicator
Persons with disabilities experience increased psychological and emotional well-being.
Improved psychological and emotional state in person with disability
Decreased use of psychological and emotional support by person with disability
Persons with disabilities improve in their life skills (i.e. independent living skills, functional skills etc.) as much as their potential allows.
Increased length of time spent living independently experienced by person with disability
Increased length of free time experienced by caregiver
Decreased use of support by person with disability
Increased length of time spent on a specified "independent living" activity by person with disability
Persons with disabilities (or their proxies) are able to make informed decisions and planning via better support and access to information, programme and product navigation.
Increased take up of care or support services by person with disability
Increased satisfaction with care or support provision by person with disability
Decreased complaints associated with inappropriate care or support from person with disability
Increased knowledge of available care and support for person with disability
Decreased returns or cancellations of inappropriate care or support services by person with disability
Persons with disabilities have more opportunities to participate in social, family, economic and community life.
Increased length of time engaged in social, family, economic and community life activities by person with disability
Increased length of time spent working by person with disability
Decreased length of time spent alone by person with disability
Example OutcomeOutcomeOutcomeOutcome Indicators
Stated Shared Outcome Outcome Indicator
Caregivers experience increased psychological and emotional well-being.
Improved psychological and emotional state in caregiver
Decreased use of psychological and emotional support by caregiver
Caregivers feel confident of their ability to provide competent care and support to persons with disabilities.
Increased knowledge of available care and support for person with disability
Increased take up of appropriate care or support services for person with disability
Decreased take up of inappropriate care or support services for person with disability
Decreased use of selection support services by caregiver
Caregivers have greater access to support services, network and structure that sustain caregiving.
Increased take up of appropriate care or support services for person with disability
Increased knowledge of available care and support for person with disability
Caregivers have more opportunities to participate in social, family, economic and community life.
Increased length of time engaged in social, family, economic and community life activities by caregiver
Increased length of time spent working by caregiver
Decreased length of time spent caring by person by caregiver
Social Outcomes Measurement – Simple 4 Step
Process Stage 1:
PreparationFunding Awarded
Project Team Completes the
“Preparation Survey”*
“Preparation Survey” submitted to SG Enable for review
and approval
“Preparation Survey” defines the
indicators to be tracked for the specific project
Stage 2:
Before
Project Team executes
“Before Survey”
Stage 3:
During
Project Team completes the
‘Progress Survey”
“Progress Survey” tracks Activity
Indicators defined by the Project Team in
the “Preparation Survey”
Stage 4: After
Project Team completes the “After
Survey” at the “Impact Horizon”
Project Team produces “Impact
Case Studies”
Project Team reports performance
in terms of: Outcome Indicators, Activity Indicators,
and Case Study
Additionality determined using the baseline established
using the “Before Survey”
Supporting Toolkit & Capability Development
Supporting Tool Kit & Capability Development
Supporting Toolkit & Capability Development
Toolkit auto-generates a dashboard
of indicators that a project can use
to measure social outcomes
Supporting Toolkit & Capability Development
Toolkit will also assist the project in
selecting the most appropriate source of
data to track and measure the indicator. It
will also allow project to track data in the
tool
Toolkit Training Course
• Successful Grant recipients will
also attend training sessions at
NUS
• In addition, ad-hoc support will
be made available throughout
• All training sessions are practical,
hands on and focus on using the toolkit and helping each project
Recommended