Accountability data overview August 2014. Topics Changes to 2014 accountability reporting Overview of accountability measures Progress & Performance

Accountability data overviewAugust 2014

Topics

Changes to 2014 accountability reporting

Overview of accountability measures

Progress & Performance Index (PPI)

School percentiles

Accountability & assistance levels

Reports

Resources & tools

Massachusetts Department of Elementary and Secondary Education

2


3

Highlights of ESEA Flexibility in MA Goal: Reducing proficiency gaps by half by 2017 Accountability & assistance levels for schools &

districts (Levels 1-5) Progress & Performance Index (PPI) – a

performance measure that includes student growth, science, & other indicators

School percentiles – representing performance relative to other schools of the same school type

“High needs” subgroup data reported Low income students, students with disabilities,

current & former English language learners


4

Description 2012 & 2013 reporting 2014 reporting

Extra credit for reengaging dropouts

N/A High schools that reengaged 2 or more dropouts in the 2012-13 school year will earn 25 extra credit PPI points (all students & high needs groups only)

Weighting of growth and achievement in school percentiles

Achievement – 80%Growth – 20%

Non-high schools:Achievement – 75%Growth – 25%

High schools:Achievement – 50%Growth – 25%High school indicators – 25%

Methodology for identifying Commendation Schools

Better alignment between Commendation School criteria and that of federal Blue Ribbon Schools program.

Commendation Schools will be identified when official MCAS & accountability data are released in mid-September.



5

Description2012 & 2013 reporting 2014 reporting

Accountability reporting for PARCC PBA field test schools with some students exempt from MCAS testing

N = 89

N/A 2014 PPI and school percentiles calculated using highest value for all MCAS results or MCAS results excluding PBA field test grades.

2014 accountability & assistance level based on 2014 cumulative PPI and school percentile.

Accountability reporting for PARCC PBA field test schools with all students exempt from MCAS testing

N = 13

N/A No 2014 PPI or school percentile.

2013 accountability & assistance level held constant.



6

Description2012, 2013, & 2014 reporting 2015 reporting

Persistently low graduation rates

Any school with a graduation rate of less than 60% for four consecutive years is automatically placed in Level 3

Any school with a graduation rate of less than 67% for the most recent four-year graduation rate & 70% for each of the three prior five-year rates will be placed in Level 3.

Implementation in 2015, but schools will be notified in 2014 if they would have been impacted by this change in 2014.

Participation rates Schools testing less than 95% of students in any group on any of the required statewide assessments are automatically ineligible for Level 1, & schools testing less than 90% of students in any group on any test are automatically ineligible for Levels 1 and 2.

Current school participation consequences will also be applied at the district level.

Implementation in 2015, but districts will be notified in 2014 if they would have been impacted by this change in 2014.

Preview of changes to 2015 accountability reporting


7

Reducing proficiency gaps by half by 2016-17


8

Reducing proficiency gaps by half by 2016-17


9

The PPI is a measure of progress toward a group’s gap-narrowing goals Annual PPI shows progress over two years Cumulative PPI represents trend over time

Core indicators (up to 7) ELA, math, & science proficiency gap narrowing (CPI) ELA & math growth (SGP) Annual dropout rate Cohort graduation rate (4-and 5-year)

Extra credit Reducing percentage of students scoring Warning/Failing

&/or increasing percentage of students scoring Advanced (10 percent or more)

Reengaging dropouts (2 or more students)

What are some key PPI concepts?


10

Annual PPI = total points / # core indicatorsCumulative PPI = (2011*1 + 2012*2 + 2013*3 + 2014*4)

/ 10

Core indicators Up to 700 points awarded

1. ELA proficiency gap narrowing

0, 25, 50, 75, or 100

2. Math proficiency gap narrowing

0, 25, 50, 75, or 100

3. Science proficiency gap narrowing

0, 25, 50, 75, or 100

4. ELA growth 0, 25, 50, 75, or 100

5. Math growth 0, 25, 50, 75, or 100

6. Annual dropout rate 0, 25, 50, 75, or 100

7. Cohort graduation rate 0, 25, 50, 75, or 100

Extra credit indicators Up to 175 additional points awarded

ELA, math, science W/F reduction

25 + 25 + 25

ELA, math, science ADV increase

25 + 25 + 25

Dropout reengagement 25


11

The PPI and the school percentile PPI is a criterion-referenced measure of progress Percentiles are relative, & help the state &

districts focus supports on low-achieving students in low performing schools

Massachusetts uses school types (ES, ESMS, MS, MSHS/K-12, HS) to fairly compare the performance of schools serving the same or similar grades & distribute resources equitably

Every school’s percentile & PPI tells a different story Schools with lower percentiles but higher PPIs for all student

groups are showing improvement over time Schools with higher percentiles but lower PPIs are high

performing, but have more work to do to support student success

What are some key Level concepts?


12

Schools & districts are classified into a level based on a four-year trend The cumulative PPI for all students & high needs

students is used to classify schools into Levels 1 & 2 School percentiles (1-99) represent performance

relative to other schools of the school type, & are used to determine Level 3 schools (lowest-performing 20 percent per state law)

Districts are classified based on the level of lowest-performing school (exception for Board action)


13

How are schools classified?

Sample reports


15

Accountability reports

Layer 1: Accountability & assistance level Reason(s) for level designation School percentile (schools only) Determination of need for Special Education technical

assistance or intervention (districts and single-school districts only)

Cumulative Progress & Performance Index (PPI) for all student groups

Summary of school accountability information (districts only)

Layer 2 (group-specific): Annual & cumulative PPI figures Points awarded for each indicator Assessment participation data

Layer 3: Detailed data for each indicator for all student groups

Level 1 school (first layer of report)


16

Level 1 school (second layer of report)


17

Level 1 school (third layer of report)


18



19



20

Resources & tools

Resources and tools


22

http://www.doe.mass.edu/apa/accountability



23

Gap-halving calculators


24

PPI calculator


25

District analysis, review, & assistance tools

http://www.doe.mass.edu/apa/dart




26

District analysis, review, & assistance tools

http://profiles.doe.mass.edu/analysis/



Questions?


27

[email protected]


mailto:[email protected]




Documents

Accountability data overview August 2014. Topics Changes to 2014 accountability reporting Overview of accountability measures Progress & Performance