Kentucky Youth Development Coordinating Council Retreat June 12, 2008 Why We Need Success Measures The Big Picture Approach Karen Finn, Senior Fellow [email protected]

Kentucky Youth Development Coordinating Council Retreat June 12, 2008

Why We Need Success MeasuresThe Big Picture Approach

Karen Finn, Senior [email protected] Forum for Youth Investment

© The Forum for Youth Investment 2008

The American DREAM

All youth can be ready.

Every family and community can be supportive.

Each leader can make a difference.


Too Few Youth are Ready.Only 4 in 10 are doing well.

Too Few Families and Communities are Supportive.Fewer than 2 in 5 youth have the supports that they need.

Too Few are Trying to Make a Difference.

The American REALITY


The American DILEMMA

THE GAP BETWEENVISION AND REALITY HAS TO BE CLOSED

At a time when“Failure is NOT an Option”

(The Hope Foundation)

and “Trying Hard is NOT Good Enough”

(Mark Friedman)


• Fragmentation

• Complacency

• Low Expectations of Youth, Communities and Leaders

The American DILEMMA


SOURCE:Margaret Dunkle

Business as Usual… See a Problem, Convene a Task Force, Create a Program…

Has Created a Tangle of Inefficiencies

Children’s Services in Los Angeles County


Core Supports &

Opportunities

Delinquency

& Violence Pregnancy

& HIV/AIDSD

ropo

uts

&

Illite

racy

Unemplo

ymen

t

Substance Abuse,

Suicide, Depression

Even the smallest communities

have too many initiatives

Civic Engagement

Educational Attainment

Physical Health

Vocational Readiness & Success

Social & Emotional Health


The Ready by 21 Challenge:

Changing the Odds for Youth by Changing the Way We Do Business

Change the oddsfor youth

Change the waywe do business

Change the landscapeof communities


Identifying Shared Outcomes and Indicators





Changing the Way We Do Business

Think Differently

so that together we can

Act Differently



Think Differently


Act Differently

BIG PICTURE APPROACH



SET BIGGER GOALSBE BETTER PARTNERSUSE BOLDER STRATEGIES

Think Differently


Act Differently

BIG PICTURE APPROACH

WANTED: Young People Who are Ready

Changing the Odds for Youth . . .


Are they Ready?





43% are doing well in two lifeareas and okay in one

• Productivity: Attend college, work steadily

• Health: Good health, positive health habits, healthy relationships

• Connectedness: Volunteer, politically active, active in religious institutions, active in community

Too Few Young People are Ready

Doing Well43%

Doing Poorly22%

In the Middle35%

22% are doing poorly in two lifeareas and not well in any

• Productivity: High school diploma or less, are unemployed, on welfare

• Health: Poor health, bad health habits, unsupportive relationships

• Connectedness: Commit illegal activity once a month

Researchers Gambone, Connell & Klem (2002) estimate that only 4 in 10 are doing well in their early 20s.


We Know What it Takes to Support Development

• The National Research Council reports that teens need:• Physical and Psychological Safety• Appropriate Structure• Supportive Relationships• Opportunities to Belong• Positive Social Norms• Support for Efficacy and Mattering• Opportunities for Skill-Building• Integration of Family, School and Community efforts


Do these Supports Really Make a Difference? Even in Adolescence?

0

5

10

15

20

25

30

35

40

45

50

Youth with SupportiveRelationships

Youth with UnsupportiveRelationships

Ready by End of 12th Grade Not Ready

ABSOLUTELY

SOURCE: Finding Out What Matters for Youth: Testing Key Links in a Community Action Framework for Youth Development

Gambone and colleagues show that youth with supportive relationships as they enter high school are 5 times more likely to leave high school “ready” than those with weak relationships…


… and those seniors who were “ready” at the end of high school were more than 4 times as likely to be doing well as young adults.

Do these Supports Make a Difference in Adulthood?

0

10

20

30

40

50

60

70

80

Ready by 21 Not Ready by 21

Good Young Adult Outcomes

Poor Young Adult OutcomesSOURCE: Finding Out What Matters for Youth: Testing Key Links in a Community Action Framework for Youth Development

NEEDED: Coordinated & High Quality Supports

. . . by Changing the Landscape of Family and Community Supports


Are They Getting the Supports They Need?





One third of 6-17 year olds lack the supports they need

50%37%

13%

6 – 11 Years Old

45%30%

25%

12 – 17 Years Old

• According to the America’s Promise Alliance National Promises Survey, only 31% of 6-17 year olds have at least 4 of the 5 promises. 21% have 1 or none.

• And the likelihood of having sufficient supports decreases by age:• 37% of 6-11 year olds have at least 4 promises; 13% have 1 or none.• Only 30% of 12-17 year olds have at least 4; 25 % have 1 or none.


Civic Social Emotional Physical Vocational Cognitive

Ages

Times of Day

OutcomeAreas

???

Reach Counts

Morning . . . Night

21

.

.

.

0 School AfterSchool

At its best, school only fills a portion of developmental space


Who is Responsible for the Rest?

• Families• Peer Groups• Schools and Training Organizations• Higher Education• Youth-Serving Organizations• CBOs (Non-Profit Service Providers and Associations)• Businesses (Jobs, Internships and Apprenticeships)• Faith-Based Organizations• Libraries, Parks, and Recreation Departments• Community-Based Health and Social Service Agencies

?


Improving Program Availability isn’t Enough

• There is basic agreement that young people who participate fully in school and programs and their communities have better outcomes than those who do not.

• Consequently there is increased interest in getting inside the black box -- mapping the program landscape what is available to whom, when, where, why, how, and how much it costs.

Youth outcomes

Youth Participation


We Advocate for a “Big Picture Approach”

• Take Aim• Take Stock• Target Action• Track Progress

The Forum couples field knowledge with conceptual, practical and “power” tools to help state and local leaders quickly organize available information

(about youth outcomes, community supports and current initiatives and resources) to support data-driven “big picture” planning and accountability.

Taking Aim

Outcomes and Indicators

DEFINITIONSRESULT or OUTCOME:

INDICATOR

PERFORMANCE MEASURE

Children born healthy, Children succeeding in school, Safe communities, Clean Environment, Prosperous Economy

Rate of low-birthweight babies, Rate of high school graduation, crime rate, air quality index, unemployment rate

1. How much did we do? 2. How well did we do it?

3. Is anyone better off?

A condition of well-being for children, adults, families or communities.

A measure which helps quantify the achievement of a result.

A measure of how well a program, agency or service systemis working. Three types:

= Customer Outcome


Kentucky’s Outcomes

• Youth Make Healthy Choices• Youth are Life Long Learners• Youth Participate in Community Decision

Making• Youth Develop Social and Emotional

Competencies• Youth have Knowledge and Skills to be

Productive in the 21st Century

The Kentucky Youth Development Coordinating Council - OUTCOMES

• Youth Make Healthy Choices:

Young people make healthy choices regarding their mental and physical health including: nutrition, physical activity, substance use and abuse, sexual activity, coping skills, stress reduction and emotional well-being.


• Youth are Life Long Learners

Young people are successful in school and develop the skills they need throughout their life to be employable and support themselves and their family.


• Youth participate in Community Decision Making:

Young people have meaningful roles in their schools, communities and the organizations that serve them through opportunities for decision making, leadership and service.


• Youth Develop Social and Emotional Competencies :

Young people develop the skills they need for healthy relationships and they experience healthy relationships in their lives.


• Youth Have Knowledge and skills to be productive in the 21st Century :

Young people have the skills necessary to be self sufficient and successful in our global economy.

Pre-K0–5

School-Age6–10

Middle School11–14

High School15–18

Young Adults19–21+

Ready for College

Are life long learners

Ready for Work

Have knowledge

and skills for 21st Cent.

Ready for Life

Make healthy choices

Develop social and emotional

competencies

Participate in community

decision making


Selecting Indicators

• Balanced set of indicators:• Across outcome areas• Across ages• Across populations • Across a range of goals and approaches

• That have strong:• Communication Power• Proxy Power• Data Power


Take Aim on the Big PictureHow are Young People Doing?

Pre-K0–5

School-Age6–10

Middle School11–14

High School15–18

Young Adults19–21+

Ready for College

LEARNING

Ready for Work

WORKING

Ready for Life

THRIVING

CONNECTING

LEADING

High school failure doesn’t occur in a vacuum… and high school

completion doesn’t ensure adult success.


The Matter of Baselines

Baselines have two parts: history and forecast

H

M

L

History Forecast

Turning the CurvePoint to Point

OK?


Maryland Ready by 21 Action Agenda



Indicators: Desired Results:

Ready for college

Ready for work

Ready for Life

Action Areas:



Indicators: • Educational

attainment• Employment

• Health Care

Coverage• HIV/AIDS

rate • Deaths by

Injury rate• Arrests

Desired Results:

Ready for college

Ready for work

Ready for Life

Action Areas:




attainment• Employment • Health Care

Coverage• HIV/AIDS rate • Deaths by


Desired Results:

Ready for college

Ready for work

Ready for Life

Action Areas:

Competent, Caring Adults

Accessible, Affordable Housing

Access to Health Care

Pathways to Education and Employment

Equal Treatment Under the Law







Desired Results:

Ready for college

Ready for work

Ready for Life

Action Areas:












Desired Results:

Ready for college

Ready for work

Ready for Life

Action Areas:







Maryland Ready By 21TM Action Agenda

• What results do you want for youth?• What indicators do you have access to?• What contributing factors (the story behind) are impacting these

indicators?• How do these cluster? Developed action areas• What are a balanced, integrated set of strategies and action steps

in each area? Who is doing what??• What are the “Moving Trains” and “Standing Bodies” that can be

linked to?• Constantly cross checking these pieces against the big picture

results and analyzing them against what we know is needed to make change

Ready for College, Work

& LifeAs measured by indicators e.g., educational attainment,

employment, health care coverage, HIV/AIDS rate…

Program/System Level PerformancePARTICIPATION

How much do we do?

QUALITYHow well do we do it?

PROGRAM OUTCOMESIs anyone better off?

Frequency, duration,

intensity of participation

Point of Service Quality

Improved skills, knowledge &

behaviors

Maryland’s Ready by 21 Action AgendaDESIRED OUTCOMES

Competent, Caring AdultsAccessible, Affordable HousingAccess to Health CarePathways to Education and EmploymentEqual Treatment Under the Law

ACTION AREASPOPULATION

LEVEL GOALS

How is our community doing? How are our young people doing?


Percentage of the Five America’s Promises that Kentucky Program Outcomes Address

21%

25%

16%

26%

12%

Caring Adults

Safe Places

Healthy Start

Marketable Skills

Opportunities to Serve


Number of the Five Promises that Each Kentucky Program Pursues

48

30

83

12

1 promise 2 promises 3 promises 4 promises 5 promises


Point of Service Quality and the YPQA

PlanMake choices

Reflect

Partner with adults

Lead and mentorBe in small groups

Experience belonging

Engagement

Reframing conflictEncouragementSkill building

Active engagementSession flow

Welcoming atmosphere

Supportive Environment

Interaction

Safe Environment Healthy food and drinks

Program space and furniture Emergency proceduresPsychological and emotional safety

Physically safe environment

Take Stock of Public and Private Community SupportsUsing a Common Set of Performance Measures

Setting A Setting B Setting C Setting D Setting E

Safe Places

Caring Adults

Opportunities to Help Others

Effective Education

Healthy Start

Taking Action


Big Picture Goals

Messages●FrameworksData●Metrics

A Blueprint for Action


Big Picture Goals


Big Tent Partners

Stakeholders & Structures taking

shared responsibility



Big Picture Goals


Big Tent Partners



Changed Odds for

Children & Youth



Improve/Coordinate Systems, Services & ProgramsBig Picture

GoalsMessages●Frameworks

Data●Metrics

Big Impact Strategies

Big Tent Partners



Changed Odds for

Children & Youth



Changed Odds for

Children & Youth

Improve/Coordinate Systems, Services & Programs

Align Policies

& Resources

Big Picture Goals



Big Tent Partners





Changed Odds for

Children & Youth


Align Policies

& Resources

Increase

Demand

Big Picture Goals



Big Tent Partners





Changed Odds for

Children & Youth


Align Policies

& Resources

Engage Youth & Families

Increase

Demand

Big Picture Goals



Big Tent Partners





Big Picture Coordinating

Bodies

Changed Odds for

Children & Youth


Align Policies

& Resources

Engage Youth & Families

Increase

Demand

Big Picture Goals



Big Tent Partners





Kentucky’s Blueprint for Action

Tracking Progress


from 4 in 10doing well

to 7 in 10 doing well

Providing These Supports CAN Change the Odds

Gambone/Connell’s research suggests that if all young people got the supports they needed in early adolescence, the picture could change…


Tracking Progress on Indicators

Percent of Children in Maryland Entering Kindergarten Fully Ready

0102030405060708090

100

01/02 02/03 03/04 04/05 05/06 06/07Year

Pe

rce

nt

49%49%49%49%

67%67%67%67%


8th graders who scored at or above proficient reading level

0

10

20

30

40

50

60

70

80

90

100

1998 2002 2003 2005 2007


Youth aged 18-24 not attending school not working, no degree beyond HS

0

5

10

15

20

25

2002 2003 2004 2005 2006


HS Grads age 25-29 who have completed a bachelor’s degree or higher

0

5

10

15

20

25

30

2002 2003 2004 2005 2006


We Advocate for a “Big Picture Approach”

• Take Aim• Take Stock• Target Action• Track Progress

The Forum couples field knowledge with conceptual, practical and “power” tools to help state and local leaders quickly organize available information

(about youth outcomes, community supports and current initiatives and resources) to support data-driven “big picture” planning and accountability.

ConnectingThrivingLeadingWorkingLearning

As measured by indicators e.g., Teen birth rate

(common resources: Kids Count; Search internal assets)

Program/System Level PerformancePARTICIPATIONHow much do we

do?

QUALITYHow well do we do

it?

PROGRAM OUTCOMES

Is anyone better off?Point of Service Quality

Improved skills, knowledge &

behaviorsAs measured by indicators e.g., %

with improved decision-making skills

Frequency, duration,

intensity of participation

CHILD & YOUTH FAMILY & COMMUNITYOUTCOMES or RESULTS

Caring AdultsSafe PlacesEffective Ed

Healthy StartsOpportunities to

Contribute

As measured by indicators e.g., % with caring adult

(common resources: Search external assets)

SUPPORTS or INPUTSPOPULATION

LEVEL

GOALS

e.g. e.g.

How is our community doing? How are our young people doing?

The Forum for Youth Investment www.forumfyi.org

Documents

Kentucky Youth Development Coordinating Council Retreat June 12, 2008 Why We Need Success Measures The Big Picture Approach Karen Finn, Senior Fellow [email protected]