DSHS | Research and Data Analysis Division | CONTACT 360.902.0890 [email protected] 1 MAY 2014 Social Services and Education: Measuring Outcomes

DSHS | Research and Data Analysis Division | CONTACT 360.902.0890 • [email protected] 1MAY 2014

Social Services and Education: Measuring Outcomes for Vulnerable Populations

ERDC Conference 2014

May 21, 2014

Barbara Lucenko, PhDAlice Huber, PhD

Washington State Department of Social and Health Services Research and Data Analysis Division

Funded by the U.S. Department of Education, American Recovery and Reinvestment Act of 2009


Research and Data Analysis Division (RDA)

Research and Data Analysis (RDA) maximizes use of …• Unique data infrastructure• Measurement, reporting and analytical abilities• Multidisciplinary research teams

Integrated Client Database, allows us to summarize… • Services• Costs• Risk Factors

Summarized for…• Individuals• Families• Services• State, counties, school districts, service areas• Programs and new projects


RDA Integrated Client Database

Internal

Arrests Charges

Convictions

Incarcerations

Community Supervision

Dental ServicesMedical Eligibility Medicaid, State OnlyHospital Inpatient/ OutpatientManaged Care Physician ServicesPrescription Drugs

Hours

Wages

Housing AssistanceEmergency ShelterTransitional HousingHomeless Prevention and Rapid Re-housing Permanent Supportive Housing

Public HousingHousing Choice VouchersMulti-Family Project-Based Vouchers

External

Administrative Office

of the Courts

Employment Security

DepartmentDepartment

of CorrectionsWashington State Patrol

Department of Commerce

Health Care Authority

Housing and Urban

Development Public Housing

Authority

WASHINGTON STATEDepartment of Social and Health Services

Integrated Client Database

Nursing Facilities

In-home Services

Community Residential

Functional Assessments

Case Management

Community Residential Services

Personal Care Support

Residential Habilitation Centers and Nursing Facilities

Medical and Psychological Services

Training, Education, Supplies

Case Management

Vocational Assessments Job Skills

Child Protective Services

Child Welfare Services

Adoption

Adoption Support

Child Care

Out of Home Placement

Voluntary Services

Family Reconciliation Services

Institutions

Dispositional Alternative

Community Placement

Parole

Food Stamps

TANF and State Family Assistance

General Assistance

Child Support Services

Working Connections Child Care

DSHS Juvenile

Rehabilitation

DSHS Economic Services

DSHS Aging and Long-

Term Support

DSHS Developmental

Disabilities

DSHS Vocational

Rehabilitation

DSHS Children’s Services

Child Study Treatment Center

Children’s Long-term Inpatient Program

Community Inpatient Evaluation/ Treatment

Community Services

State Hospitals State Institutions

Assessments

Detoxification

Opiate Substitution Treatment

Outpatient Treatment

Residential Treatment

DSHS Behavioral Health and Service

IntegrationMental Health and Substance Abuse Services

Births

Deaths

Department of Health


Research and Data Analysis Division (RDA)

Program Evaluation Projects• Quasi-experimental approach• Risk factors and service histories are key • Making meaningful comparisons with administrative data

Performance Measurement• Outcomes for specific populations• Program implementation• Systems monitoring

Outcomes of Interest• Treatment success• Employment• Criminal Justice Involvement• Medical costs and cost offsets


Washington State P20 Education Data Warehouse

Workforce Training and Education Coordinating Board

Career Schools, Non-credit Workforce Programs

Superintendent of Public Instruction

P-12 Students, Courses, Graduation, Teachers

Department of Early Learning

ECEAP, Child Care, Providers

Community and Technical Colleges

Students, Courses, Degrees, Majors

Washington Student Achievement Council

Financial Aid

P-20W Information for Parents, Teachers Administrators, Planners, Policy-makers, Researchers

Routine Reports, Research Briefs, Ad hoc Analyses, Research Datasets

4-year Colleges and Universities

Students, Courses, Degrees, Majors

Employment Security

Industry, Hours, Earnings

Washington State Department of Corrections

Inmate Education

Department of Labor and Industries

State Apprenticeships

&EDUCATION RESEARCH

DATA CENTER


Education and Social Services Research Project

Grant funded project (2009 ARRA SLDS Grant)

• Collaboration with OFM Education Research and Data Center (ERDC)

• Project conducted by DSHS, Research and Data Analysis, ends June 2014

Combining education and social services data• Integrated education and DSHS data• Longitudinal data to follow the educational achievement of DSHS youth• Education measures for DSHS youth from ERDC P-20 database include K-12, higher

education and workforce outcomes

Tracking education progress and outcomes for DSHS youth• High school graduation• Academic achievement (test scores, GPA)

• Unexcused absences• Higher education enrollment and attainment


Education and Social Services Research ProjectAdministrative• Data sharing agreements between ERDC and DSHS• DSHS participates in P-20 data governance discussions• Communication with ERDC • Review of products by data partners (OSPI, SBCTC, DEL, etc)

Logistics• An education entity (ERDC) performs link • Direct identifiers removed• ERDC maintains ID crosswalk • ERDC provides education data• DSHS maintains data set containing education and social services

information


ERDC “P-20” DataAvailable from 2003-2004 school year forward• K-12 data, AY 2004/05 through AY 2012/13• Community College (SBCTC), AY 2003/04 through AY 2011/12• Higher Education (PCHEES), AY 2000/01 through AY 2011/12

Continued updates going forward

2010-2011 school year

Selection Criteria• Source: DSHS Integrated Client Database

• DSHS services: All clients who received any DSHS service in State Fiscal Years 2000-2012

• Age: Birth through 35 years-old on January 1 of the SFY in which they first received DSHS services, OR any age if they received an ESA service during SFY2000 through 2012

DSHS Service Recipients (SFY 2000-2012)

DSHS Service Cohort and Education Data

2003-2004 2004-2005 2005-2006 2006-2007 2007-2008 2008-2009 2009-2010 2010-2011 2011-2012 2012-2013

DSHS Client DataCurrently available from State Fiscal Years 2000 through 2012

SCHOOL YEAR


Examples of Projects Completed to Date


High School Outcomes for DSHS-Served Youth

On-time and extended (late) graduation for students who received at least one month of DSHS services while in the 9th grade

9th Graders during Academic Year 2005-2006

ALL DSHS

Medical Assistance Only

Child Support Enforcement Only

Basic Food

Temporary Assistance for Needy Families

Developmental Disability Admin

Children's Administration

Behavioral Health - Mental Health

Behavioral Health - Chemical Dependency

Juvenile Rehabilitation

0% 90%

48%

63%

65%

41%

31%

20%

27%

23%

11%

9%

7%

7%

5%

8%

7%

30%

8%

8%

5%

5%

55%

70%

70%

49%

38%

50%

35%

31%

16%

14%

On-time graduation

Late

Service categories represent at least one month of service type during 9th grade year


Behavioral Health Needs and School Success

On-time and extended (late) graduation for students who received at least one month of DSHS services while in the 9th grade

9th Graders during Academic Year 2005-2006

0%

56%

36%

19%

12%

7%

10%

6%

5%

Yes. Graduated

Yes. Graduated

Yes. Graduated

Yes.

No Known Behavioral Health Need

Mental Health Only

Substance Abuse Only

Both Mental Health and Substance Abuse

LateOn time

LateOn time

LateOn time

LateOn time

63%

46%

25%

17%

Graduated from high school?

Behavioral health categories are mutually exclusive and represent services, medications, or diagnoses related to mental health and/or substance abuse or substance-related arrests


Percent by academic standard

100%

80%

60%

40%

20%

0%

2006 2007 2008 2009 2010 2011

10th grade youth are successful in school


Percent of youth

80%

60%

40%

20%

0%2009 2010 2011 2012 2013 2014

Youth complete high school


Children Served by DSHS and Enrolled in Special Education

DSHS serves almost half of K-12 students statewide, and two-thirds of K-12 special education students

ALL K-12 Students, StatewideTOTAL = 1,027,724

K-12 Students Served by DSHS

46%TOTAL = 473,710

K-12 STUDENTS IN SPECIAL ED

12% of all studentsTOTAL = 123,744

17% of the DSHS K-12 caseload is enrolled in Special Education

n = 78,286

8% of K-12 students NOT served by DSHS are enrolled in Special Education

n = 45,458

As of December 1, 2006


What is Next?Sustaining the Infrastructure• Continue to staff and update• Expand data sharing agreements• Continue to work with ERDC• Secure resources beyond June 2014

Projects on the Horizon

To be completed in this State Fiscal Year…• School mobility • Transitions to employment for youth with developmental disabilities

And Beyond…• Performance measures (mandated in legislation)• Opportunity Youth (Bill and Melinda Gates Foundation)• Youth at Risk of Homelessness (Administration for Children and Families)• Adverse Childhood Experiences and educational outcomes (DSHS Division

of Behavioral Health and Recovery)


Education outcomes for students served by DSHS, 2012-2013 www.dshs.wa.gov/rda/

Postsecondary Enrollment Patterns Among Recent Graduates who Received Social and Health Services During High SchoolAUGUST 2013 Coker, Felver, He, Liu, Lucenko, Mancuso

http://publications.rda.dshs.wa.gov/1488/

Behavioral Health Needs and School SuccessYouth with mental health and substance abuse problems are at risk for poor high school performanceJULY 2013 Kohlenberg, Lucenko, Mancuso, Coker, He, Liu, Felver


Educational Disabilities Among At-Risk StudentsThe overlap between social service use and special education

participation among school-aged childrenAPRIL 2013 Coker, Sharkova, Mancuso, Lucenko, Liu, He, Felver


High School Outcomes for DSHS-Served YouthGraduation and drop-out rates for students who were 9th

graders in 2005-2006NOVEMBER 2012 Coker, He, Lucenko, Mancuso, Mayfield, Liu, Felver


http://www.dshs.wa.gov/rda/






Questions?

PHOTO: Microsoft Clipart

Documents

DSHS | Research and Data Analysis Division | CONTACT 360.902.0890 [email protected] 1 MAY 2014 Social Services and Education: Measuring Outcomes