District 58 Winter Data Snapshot January 13, 2020 - original presentationRevised February 24, 2020(slides with green border)

Tonight’s Agenda

Snapshot of Winter 2020 Data

▸ MAP Reading and Math (December 2019 administration)▹ Winter Achievement Percentiles

▹ KPI On-Track▹ Winter 2019-Winter 2020 Growth

▹ New data point

How do we use MAP Data?

District, Building and Classroom level

▸ Achievement▹ Moment-in-time snapshot▹ Benchmark - review for tiers,

consider interventions▸ Growth

▹ Gains by grade level, class, school▹ Student Goal-Setting

Terms and Definitions

RIT ScoreWhen a student completes a MAP test, they receive a RIT score. This score represents a student’s achievement level at any given moment and helps measure their academic growth over time. The RIT scale is a stable scale, like feet and inches, that accurately measures student performance, regardless of age, grades, or grade level. Like marking height on a growth chart, and being able to see how a child is at various points in time, you can also see how much they have grown between tests.

Terms and Definitions

Mean RIT Percentile - the average percentile of the RIT scores for that group of students, based on student norms

Median RIT Percentile - the “middle” percentile of RIT scores for that group of students, based on student norms. Statistically half of our students fall at or above the median percentile while half fall at or below the median percentile.

Terms and Definitions

Achievement Percentile - A percentage based ranking of the achievement for the given term as compared to the school-level NWEA norms from the same grade and with the same weeks of instruction between testing.

This number is the percentile ranking of our school(s) against the other 68,000+ schools in the norming study. It is based upon the mean percentile and reflects overall school achievement.

Terms and Definitions

MAP Growth - typical score expected for matching peers within the NWEA norms study—those in the same grade who have the same RIT score in the first term, and the same Weeks of Instruction before testing. This is expressed individually or as a percentage of those meeting/exceeding the growth score.

Terms and Definitions

School Conditional Growth Index - ranks grade-level growth among growth observed across all matching schools within the NWEA norms study.

Winter MAP Benchmarking change effective 2018-19

Beginning in the 2018-19 school year, the Winter benchmark period was December, rather than January as in prior years.

Note that “Winter 2020” data from NWEA’s perspective reflects December 2019 assessment administration

Median Achievement Calculation Adjustment beginning Winter 2020

As a result of consulting with NWEA statisticians in October 2019, we have revised the procedure by which we calculate Student Median Performance Percentiles.

The overall difference in calculating methods shows minimal difference (and in some cases, no difference) but our current method is recommended as the most precise calculation.

NWEA Data Inaccuracies

January 3 - Dr. Eichmiller contacted NWEA regarding discrepancies

January 10 - NWEA assured us via phone that our data source was 100% accurate and our “source of truth”January 21 - Dr. Eichmiller again noted discrepancies and continued the dialogue with NWEA

January 28 - NWEA acknowledged that their data had contained inaccuracies on January 10th

January 31 - NWEA’s research team confirmed and further explained the data inaccuracies

What were the inaccuracies?

Student achievement data, and therefore actual growth attained has always been accurate.

Student growth projections from Winter 19 - Winter 20 were inaccurate.

▸ These were initially based upon 48 weeks between assessment administration rather than 52 weeks.

▸ The correction caused all growth projections to increase, which in turn decreased the number of students who met/exceeded their targets. (Student growth attainment remained constant, but the target moved.)

A Moment in Time -Winter 2020 District MAP Reading Data as presented January 13, 2020

A Moment in Time -Winter 2020 District MAP Reading Data as adjusted February 24, 2020

Historical Trends - District Reading MAP Achievement

Historical Trends - District Reading MAP Achievement

A Moment in Time -Winter 2020 District MAP Math Data as presented January 13, 2020

A Moment in Time -Winter 2020 District MAP Math Data as adjusted February 24, 2020

Historical Trends - District Math MAP Achievement

Historical Trends - District Math MAP Achievement

Key Performance Indicator Mid-Year Check-in - Reading

Key Performance Indicator Mid-Year Check-In - Math

Interpreting the data - growth and achievement side-by-side

Next Steps...

Building-level data meetings (early January)

▸ Tier I instructional focus▸ Individual student focus

Continued discussion on assessing and analyzing growth

▸ Winter-Winter▸ Spring-Spring▸ Winter-Spring

Key Performance Indicator breakdown by building for administrative & School Leadership Team review