Demonstrating the Outcomes

What Does it Take to Make a Difference?

Joint PDI / STRADA MASTERCLASS

Purpose of Today Purpose of Today

“PDI has made a significant contribution to the voluntary sector’s response tothe needs of children and young people in the context of family andcommunity, from the specific areas of drug and alcohol misuse. It is clearfrom the data surveyed that a much more holistic, strengths basedperspective has been taken by the projects, than just what drugs and alcoholdo to young people and families. In some respects this perspective has beenahead of its time.

The measurement of outcomes has been to some extent pioneered by thePDI approach. PDI understands that what we measure should not be limitedto that which we can measure. PDI is assisting in the development of how weshow to both voluntary and statutory funders that the reporting of the ‘soft’outcomes, the ‘distance travelled’ for many families and young peopleaffected by drug and alcohol misuse depends upon more complexinterpretation than quantitative data can provide.”

Continuation Study of Practice Issues Evidenced in Projects Funded through PDI; STRADA (June 2010)

PDI JourneyPDI Journey

Achieving an Outcome Achieving an Outcome Focus on helping projects understand what realistic

outcomes they can support and how this can help contribute to the longer journey

Offer ongoing guidance, support and training to help think through how outcomes and evaluation significantly impacts on delivery and planning

Understanding the importance of the soft measures, how they contribute to the ‘hard outcomes’

The Outcomes The Outcomes

Improved health and well-being

Increased confidence and self-esteem

Increased coping skills

Improved parenting capacity

Increased safety of children

Improved educational/employment attainment

Reduced or abstained substance use

The Indicators The Indicators

Increased attendance at school

Improved family relationships

Parents setting routines and boundaries

Parents ensuring children access dental/health appointments

Parents understanding the impact of their substance use

Children have improved behaviour

Children are more able to make friends

Families are accessing community activities

Families have improved involvement with statutory services

Parents are accessing employment training opportunities

Increased identification of children at an earlier stage

Young people are involved in less risky behaviours

Progressing ChangeProgressing Change

RELATIONSHIPRELATIONSHIPS S THROUGHOUTTHROUGHOUT

Knowing this worksKnowing this works

Knowing this worksKnowing this works Relationship is key, using the workers

experience and skills – observation.

Strengths based approaches isn’t just for assessment, an effective tool to be used to measure change.

It isn’t a form filling exercise – outcomes are about seeing the difference.

self-evaluation can work as long as it is robust and genuine understanding of how it helps.

Seeing the resultsSeeing the resultsReported Core PDI Outcomes (33 projects – Apr 2012)

Seeing the resultsSeeing the resultsReported Indicators of Self-esteem and confidence (33 projects – Apr 2012)

Seeing the resultsSeeing the results PDI OUTCOME LOGIC MODEL – FUNDING TO PROJECTS

PDI Core Outcomes

Indicators of Change (Project outcomes)

Indicators of Change (first steps)

Core Types of PDI Funded Approaches

Family/Parenting Capacity work

Intensive Support for young people

Children, young people and parents are re-engaged or regularly attending nursery, school, or employment volunteering opportunities

Increase in the safety of children

Increase in attainments in education, employment

Improved parenting skills

Reduction or abstinence in drugs and alcohol

High Level PDI Outcomes

Improved aspirations and opportunities for children and young people Improved confidence,

self-esteem and resilience

We have improved the life chances for children, young people and families at risk

Increase in the health and well-being for children and young people

National Outcomes

Our young people are successful learners, confident individuals, effective contributors and responsible citizens

Our children have the best start in life and are ready to succeed

We live longer and healthier lives

Children and young people have increased awareness of the risks associated with substance issues

Assumptions: This is not an extensive list of project outcomes, but encompasses the key components of reporting outcomes by projects The national outcomes are contributing factors to the Scottish Government’s strategic objectives, Healthier, Smarter, Safer and Stronger This logic model focuses on the primary outcomes relating to PDI work (see Weaver’s Triangle in Evaluation Framework and Work Plan)

Parents and young people have improved their engagement with statutory services

Parents and young people have an increased understanding of the impact of their substance use

Parents are now ensuring children attend and access health and education appointments Children, young people and parents have identified and accessed positive alternative activities

Children, young people and parents are identifying specific goals that will support their progress

Children are either/on or off the register, supervision or statutory measure

Parents have developed structured routines and boundaries Parents and young people have made positive changes to their substance use Parents, children and young people are engaging well with other services (including diversionary activities) Parents, Children and young people have improved coping skills

So what next?So what next?

We don’t know it all!! We don’t know it all!!

We need to improve our support and learning to:

Improving awareness of IT skills and database systems

Continual PDI self-development

Better ways of effectively and supportively involving children in evaluation

Become over complacent in a world of outcomes

Additional Information Additional Information Lloyds TSB Foundation for Scotland:

www.ltsbfoundationforscotland.org.uk

Evaluation Support Scotland: www.evaluationsupportscotland.org.uk

Partners in Evaluation: www.pievaluation.co.uk

Outcome Star: http://outcomesstar.org.uk/