Focus SchoolsFocus Schools

Presented by:Michigan Department of Education

Webinar Presentation by:Joann Neuroth, Office of Education Improvement and Innovation (OEII)Venessa Keesler, Bureau of Assessment and Accountability (BAA)

Overview of the Overview of the SessionSession

• What is a Focus School?

• How was our school identified as a Focus School? How can I review the data regarding this designation?

• What does this mean for our school?

• What supports will be provided to assist with this effort?

• What are the next steps?

What is a Focus What is a Focus School?School?

• Schools with the largest achievement gaps in scale score between the top 30% of students and bottom 30% of students within a school

• Focus schools may have high average performance overall, but have a significantly large gap, suggesting struggles addressing low achieving students

What is the purpose of What is the purpose of Focus School Focus School designation?designation?• Identifying Focus Schools is a critical

component to closing achievement gaps within schools and statewide

• Focus schools highlight where changes in teaching and learning practices need to be undertaken to respond to the learning needs of low-achieving students.

• These changes are difficult, and both accountability and support need to be differentiated.

How was our school How was our school identified as a Focus identified as a Focus School?School?

• Top-to-Bottom list includes a component that examines the gap in achievement scores between top 30% and bottom 30% of students within a school

• Gaps are standardized between all students using a common assessment within a school, and then averaged for the school

• Gaps are calculated for all subject areas and combined

How were Focus How were Focus schools identified schools identified (continued)?(continued)?

• Average gap is then standardized and ranked among all schools

• 10% with largest gaps are identified as Focus Schools

What data supports the What data supports the designation?designation?

Z-scores compare schools

Common concerns Common concerns about this metricabout this metric

Are Focus schools only high-achieving schools?

Are Focus schools only high socioeconomic status schools?

Is the bottom 30% subgroup in Focus schools actually high performing?

Are schools more likely to be Focus schools if they have [fill in the blank group] kids?Z-scores compare schools

Not just high Not just high achieving...achieving...

Not just high (or low) Not just high (or low) socioeconomic...socioeconomic...

02

04

06

08

01

00

Pe

rcen

t E

con

om

ically

Dis

ad

van

tage

d

0 20 40 60 80 100Overall Percentile Rank

Focus Schools Non-Focus Schools

Bottom 30% are not Bottom 30% are not high achieving ...high achieving ...

0.5

11

.5

-2 -1 0 1 -2 -1 0 1

Non-Focus Focus

Den

sity

Bottom 30% Reading E/MSGraphs by Focus

0.5

11

.5

0 1 2 3 0 1 2 3

Non-Focus Focus

Den

sity

Top 30% Subgroup Reading E/MSGraphs by FocusBottom 30% Top 30%

Across all subject areas and grade levels, the bottom 30% subgroup consistently had average achievement z-score below zero, and most of them are between -0.5 and -1.5. (This example: E/MS Reading)

Not dominated by any Not dominated by any one subgroup ...one subgroup ...

• Focus schools have higher concentrations of subgroups in bottom 30% than other schools

0.2

.4.6

.8

Non-Focus School Focus School

Economic Disadvantage Students with DisabilitiesLimited English Proficient WhiteBlack/African American Asian

Hispanic Multiracial

Graphs by focusv1

Pause to frame Pause to frame METRICS questionsMETRICS questions

• We invite you to e-mail questions to :

Mde-accountability@michigan.gov• We will answer as many as time permits

at the end of this webinar• We will post answers to all questions on

a “Focus FAQ” blog so that you can browse other districts’ answers as well

What does this mean What does this mean for our school(s)?for our school(s)?

• Target efforts toward supporting needs of lowest achievers in the school (likely through strengthening or recalibrating the multi-tiered system of support)

• Set-asides for district Title I funding• No SES required• Choice and Transportation still required• District Support for Focus schools required

• Schools cannot receive “green” status on School Report Card or AYP until gaps are minimized

Requirements and Requirements and Supports for Focus Supports for Focus SchoolsSchools

• Focus schools engage in professional dialogue with district administrators• Deep diagnostic data analysis• Differentiated district support for Focus

schools• Revised School and District Improvement

Plans

• Title I Statewide System of Support (SSoS)• District Toolkit• School-specific Data Wall• District Resource Survey• District Improvement Facilitators trained to

coach district administrators

Title I Funding for these Title I Funding for these SupportsSupports

• State-funded District Improvement Facilitator* and uniform “data wall”

• Set aside 10% of district Title I allocation:• Choice and Transportation (required)

plus• Enhanced multi-tiered system of support, or• Professional learning aligned with building data

• Set aside 10% of building Title I allocation:• Professional learning on multi-tiered system of support

or scaffolded instruction for lowest performers or essential elements for MI-ACCESS

• Weekly, daily teacher collaboration time• Surveys of enacted curriculum, or• Culture/climate interventions

*in Year 2 or after, DIF is funded through district set-aside

How does a school EXIT How does a school EXIT Focus School status?Focus School status?

• Focus schools are designated based on year-to-year status of achievement gap relative to other schools in the state

• Following the end of four years as a Focus school, a school must make AYP, including the safe harbor target for the bottom 30% subgroup

• Submit documentation to MDE regarding efforts taken to reduce gaps and sustain the reduction of gaps over time

Good Getting Great Good Getting Great (GGG) Schools(GGG) Schools

• GGG designates schools with “permanent” gaps that are being well-addressed

• GGG schools are designated upon submission of documentation from facilitated dialogue:• Overall achievement is 75% or above• Bottom 30% is making rapid progress toward Safe

Harbor status

• GGG schools are removed from Year 2 and 3 Focus lists, even though achievement gap merits inclusion

What are the next What are the next steps?steps?

• Develop a plan to address internal and community communications regarding the Focus school designation

• Ask clarification questions through the FAQ blog ... and browse others’ answers

• Ensure 10% district set-aside and 10% building set-aside in consolidated application

• Send Choice/Transportation letters to parents by August 21.

Next steps? Next steps? (continued)(continued)

• Discontinue agreements with SES providers

• Consider ways to check implementation of, and strengthen/retarget the school’s multi-tiered system of support.

• Identify the district administrator who will partner with the District Improvement Facilitator (DIF) to support the school.

• Meet the DIF in mid-September to plan how to engage in deep, data-rich dialogue with schools regarding achievement gaps.

Next steps? Next steps? (concluded)(concluded)

• Utilize the District Toolkit strategies to examine systemic considerations and possible remedies for student achievement gaps.

• Revise both school and district improvement plans to reflect new strategies.

• Conduct stakeholder meetings with populations represented in the bottom 30%

• Participate in the Superintendent’s “Dropout Challenge” with 10-15 students in bottom 30%

For More InformationFor More Information

• www.mi.gov/focusschools • Resources Include:

• Focus school lookup tool• FAQ for Focus Schools• “At-a-Glance” Overview • Business Rules for metric calculations• This Overview Powerpoint• Summary statistics

QuestionsQuestions

• Ask now by emailing Mde-accountability@michigan.gov

• Supports for Focus Schools: Fran Lake, Office of Educational Improvement and Innovation• lakef@michigan.gov, • 517-335-2957

• Accountability Designations: Bureau of Assessment and Accountability, Evaluation Research and Accountability Unit• Mde-accountability@michigan.gov, • 877-560-8378, option 6

OTHER COMMON CONCERNSOTHER COMMON CONCERNSAnalyses of the Focus Metric

Understanding the “Bottom Understanding the “Bottom 30%”30%”

The bottom 30% subgroup is comprised of the traditional ESEA subgroups.

All “traditional” subgroups are represented.

Most commonly occurring subgroups in the Bottom 30%:•students with disabilities•limited English proficient students•black/African American students•economically disadvantaged students

25

Bottom 30% has ESEA Bottom 30% has ESEA SubgroupsSubgroups

26

0.2

.4.6

Economically Disadvantaged Students with Disabilities

Limited English Proficient WhiteBlack Asian/Pacific IslanderHispanic Multiracial

Focus Schools OverallFocus Schools Overall• Focus schools have even higher

concentrations of the subgroups (mentioned previously) in their bottom 30% subgroup than non-Focus schools.

• This indicates that the Focus methodology is • still detecting differences in achievement in traditional

subgroups • identifying schools where there are not only

large achievement gaps in general, but where there are also large gaps between demographic subgroups

• identifies schools that otherwise may not be identified using traditional subgroup methodology

27

Non-Focus/Focus Schools by Non-Focus/Focus Schools by subgroupsubgroup

28

0.2

.4.6

.8

Non-Focus School Focus School

Economic Disadvantage Students with DisabilitiesLimited English Proficient WhiteBlack/African American Asian

Hispanic Multiracial

Graphs by focusv1

More about the bottom 30% More about the bottom 30% subgroupsubgroup

•Analyses conducted to determine if the bottom 30% subgroup consisted solely of any demographic subgroup

•To address the question:•Does the bottom 30% “solely” consist of any one subgroup?

29

Focus Schools: Not only ED Focus Schools: Not only ED StudentsStudents

01

23

0 .5 1 0 .5 1

Non-Focus School Focus School

Den

sity

Percent Economically Disadvantaged Students in the Bottom 30%Graphs by focusv1

30

Bottom 30% in Focus Bottom 30% in Focus Schools: More Black Schools: More Black Students than non-Focus Students than non-Focus schoolsschools

05

10

15

0 .5 1 0 .5 1

Non-Focus School Focus School

Den

sity

Percent Black Students in Bottom 30% SubgroupGraphs by focusv1

31

But: Focus Schools But: Focus Schools overall—black students overall—black students not overly representednot overly represented

05

10

15

20

0 .5 1 0 .5 1

Non-Focus School Focus School

Den

sity

Percent Black Students in School OverallGraphs by focusv1

32

SWD: Focus SchoolsSWD: Focus Schools0

.05

.1.1

5.2

.25

Non-Focus School Focus School

Avg % SWD in Top 30% Avg % SWD in Middle 40%

Avg % SWD in Bottom 30% Avg % SWD School

Graphs by focusv133

SWD: Priority SchoolsSWD: Priority Schools0

.05

.1.1

5.2

.25

Non-Priority School Priority School

Avg%SWD Top 30% Avg%SWDMiddle40%

Avg%SWDBottom30% Avg%SWDSchool

Graphs by priority

34

Focus Schools OverallFocus Schools Overall Focus schools have even higher

concentrations of the subgroups (mentioned previously) in their bottom 30% subgroup than non-Focus schools.

This indicates that the Focus methodology is •- still detecting differences in achievement in

traditional subgroups •- identifying schools where there are not only

large achievement gaps in general, but where there are also large gaps between demographic subgroups

•-identifies schools that otherwise may not be identified using traditional subgroup methodology

35

Non-Focus/Focus Schools by Non-Focus/Focus Schools by subgroupsubgroup

36

0.2

.4.6

.8

Non-Focus School Focus School

Economic Disadvantage Students with DisabilitiesLimited English Proficient WhiteBlack/African American Asian

Hispanic Multiracial

Graphs by focusv1

05

01

000

50

100

0 50 100 0 50 100

Urban Suburb

Town Rural

Focus School Non-Focus School

Pe

rcen

t ED

Stu

dent

s

School Percentile Rank

Graphs by locale4cat

37

05

01

00

0 50 100 0 50 100

Elementary/Middle School High School

Focus Non-Focus

Pe

rcen

t ED

Stu

dent

s

Overall Percentile Rank

Graphs by gradespan38

02

04

06

08

01

00P

erc

ent M

inor

ity S

tude

nts

in B

uild

ing

0 20 40 60 80 100Overall Percentile Rank

Focus Schools Non-Focus Schools

39

Bottom 30% High Bottom 30% High Performing?Performing?

• Is the bottom 30% subgroup in Focus schools actually high-performing?

• Is the bottom 30% subgroup in Focus schools higher than the top 30% subgroup in non-Focus schools?

• Is the top 30% subgroup in focus schools higher-performing than non-focus schools? 40

Answer: NoAnswer: No

•Across all subject areas and E/MS and high school, the bottom 30% subgroup consistently had average achievement z-score below zero, and most of them are between -0.5 and -1.5.

41

Example: E/MS ReadingExample: E/MS Reading

0.5

11

.5

-2 -1 0 1 -2 -1 0 1

Non-Focus Focus

Den

sity

Bottom 30% Reading E/MSGraphs by Focus

0.5

11

.5

0 1 2 3 0 1 2 3

Non-Focus Focus

Den

sity

Top 30% Subgroup Reading E/MSGraphs by FocusBottom 30% Top 30%

42

Are certain types of Are certain types of schools more likely to be schools more likely to be Focus schools?Focus schools?

• Have not detected any significant patterns yet

• Continuing to analyze the data• Because metric compares top 30

percent of kids to bottom 30 percent of kids in the school, it’s unlikely the gap is being driven exclusively by one group or type of kids.

Is there a relationship Is there a relationship between the economic between the economic disadvantage gap and the disadvantage gap and the achievement gap?achievement gap?

• Hypothesis: Schools with a range of student economic disadvantage are more likely to be Focus schools, because the higher income kids are all in the top 30% and the low income kids are all in the bottom 30%

• This would make the metric a proxy for socioeconomic gap, not achievement gap

How does the Focus How does the Focus metric differ from AYP metric differ from AYP subgroups?subgroups?

• Top-to-Bottom list includes the achievement gap between top 30% and bottom 30% of students within a school.

• Unlike subgroup designations, which are limited by size of groups and demographic status only, this approach targets ACHIEVEMENT gaps and THEN asks the demographic question.

• Methodology detects differences in achievement within subgroups; between subgroups; or with small populations.