Cranbrook Horizons-Upward Bound

Dayna Asante-Appiah, MSW/M.Ed. student &Caytlynn Schotten, MSW student

College Readiness Outcome Report

November 30, 2016Do HUB students outperform their peers?

About the authors● Team Member 1: Caytlynn Schotten

○ Second year Master of Social Work student ■ IP/Children & Youth

○ Interested in working within K-12 school settings.○ Identified as White, female○ Is a current HUB donor and regular part-time employee

● Team Member 2: Dayna Asante-Appiah○ Second year dual degree master’s student studying Social Work and

Higher Education○ Interests include college access issues for low-income students

of color○ African-American, female

AcknowledgementThis evaluation was conducted in partnership with CKHUB to examine the college readiness outcomes between CKHUB participants and nonparticipants in the general DPSCD population. Specifically, looking at ACT/SAT standardized scores and postsecondary enrollment rates.

We would like to acknowledge and thank the executive director: Dr. Taylor, as well as the HUB Administrative team for their assistance and support of this project.

Executive summaryOverall, CKHUB participants have higher ACT/SAT scores and postsecondary enrollment rates when compared to the general student population of DPSCD. For the most recent graduating class (2016), CKHUB participants scored approximately 4 points more than peers. In the 2015 graduating class, CKHUB students enrolled in a postsecondary education at almost twice the rate.

A primary theme that emerged from this project is the need for a more thorough evaluation of the effectiveness of CKHUB, such as collecting and comparing student samples from both populations.

The overall mission of HUB“…To prepare students who have limited opportunities from the Detroit Metropolitan area to enter and succeed in postsecondary education. We academically support the efforts of the student's home school by providing services that assist students in pursuing and achieving their dreams and goals for their academic endeavors and beyond.” (Cranbrook HUB, n.d.).

Programming is organized by two sessions; Summer and Winter- during the academic year.

The Problem - There is a significant achievement gap of high school

graduation and college graduation for students of color coming from high poverty areas, are at academic-risk, and/or first-generation college students.

The Hypotheses- H1- “Participant students of Cranbrook HUB are more

likely to have higher ACT composite and subtest scores as compared to non-participant DPSCD students”

- H2- “Participant students of Cranbrook HUB are more likely to have a higher rate of post-secondary enrollment within six months of graduating as compared to non-participant DPSCD students”.

Evaluation Design- Quasi-experimental

- Middle rigor level- Two comparison groups, not randomized

- No specific sampling sizes or number of participants taken into consideration; used averages for 2011-2016 graduating years

Data collection- A review of CKHUB graduating participants for the years

2011-2016 provided an average of ACT scores and postsecondary enrollment information.

- ACT scores and post-secondary enrollment information from DPSCD High Schools for the 2011-2016 graduating years was gathered through the Michigan Department of Education database website; MIschooldata.org

H1: ACT ComparisonGraduating Year

DPSCD ACT average composite scores

HUB ACT average scores HUB Difference

2011 15.5 20.5 5

2012 15.5 20.5 5

2013 16.6 19.58 2.98

2014 16.4 22 5.6

2015 16.5 19.5 3

2016 16 19.7 3.7

Overall Average

16.1 20.3 4.2

H1: ACT Comparison

N=6

H1: ACT Comparison DATA ANALYSIS- CKHUB ACT scores are high every year compared to their

peers

- DPSCD test scores have remained steady, averaging a score of 16.1

- HUB average test scores of 20.3

- Utilized T-Test, independent

- P(value)= 0.0005

H1: ACT Comparison Findings- P(value) confirms gain is not by chance

- The intervention has a statistically significant impact

H2: PostSecondary Enrollment ComparisonGraduating Class HUB percentage

enrolled in postsecondary

DPS percentage enrolled in postsecondary

HUB Difference

2011 98% 51% 47%

2012 92% 53% 39%

2013 94% 58% 36%

2014 83% 57% 26%

2015 93% 45% 48%

Overall Average 92% 53% 39%

H2: PostSecondary Enrollment Comparison

H2: PostSecondary Enrollment Comparison Data Analysis- CKHUB student enrolled in at higher rate into

postsecondary education every year for the 5 years

- DPSCD average postsecondary enrollment rate of 53%

- HUB average postsecondary enrollment rate is 92%

- Utilized Chi Square

- P(value)= .942

H2: PostSecondary Enrollment Comparison Findings- The intervention is not statistically significant- A larger sample size is need to statistically confirm the

conclusion that HUB postsecondary enrollment is that due to chance.

Limitations- The limited time for this evaluation did not allow us to

pull individual data for HUB students due to the time constraints of the team members and HUB staff.

- The evaluators had limited access to data from the comparison group; DPSCD; specifically regarding direct student population information.

- A lack of a larger sample size

how to strengthen our findings- Findings could be strengthen by confirming findings with

examining the two hypotheses with a large sample of specific student information

- An experimental survey with a group of students over a longer period of time would yield stronger findings that could evaluate more specifically how HUB as an intervention works

- Comparing HUB participant and home school within DPSCD system sample of student GPAs

Lessons Learned- Patience when working with organization when an outsider

- Time Consuming!

- Importance of being realistic with evaluation expectations

Questions?

CitationsCranbrook Education Community. (2012). 2012 CKHUB Federal Upward-Bound Program Grant

Proposal [unpublished].

Cranbrook Horizons-Upward Bound. (n.d.) About Us. Retrieved from: http://schools.cranbrook.edu/Page/About-Us/Horizons-Upward-Bound/About-HUB

Detroit City School District. 2015-16 College Readiness Trend: Total Score-All Students. Retrieved from: MIschooldata.org

Detroit City School District. College Enrollment by High School Trend: 2014-15- College Type (All by Category)-within 6 Months-Gender-All Genders. Retrieved from: MIschooldata.org