2014 Assessment Update

Deb Lindsey, AdministratorState Assessment

Update Topics• Possible legislation on statewide assessment• Smarter Balanced Assessment Consortium

– Spring 2014 Field Test– Educator involvement– Technology readiness– Alignment study

• WAEA & School Performance Reports (SPRs)– Fall 2013 pilot– Changes to high school indicators

• PAWS updates– New cut scores– Post-test forensics

• Optional item bank for district use

Possible Legislation

• May delay implementation of new assessment system until 2015-16; require a task force to study options and recommend best fit for Wyoming – no bill

• Would reinforce data privacy – SF36• Would move WorkKeys to gr 12,

eliminate the former BoE, modifydistrict assessment systems, require4 years of math in high school, &create framework for educator eval –HB28

SBAC Activities-Field Test

• Field Test involves over 21,000 Wyoming students in grades 3-11

• Provides experience with processing more rigorous items, technology enabled items, and the online platform & navigation

• Provides experience in logistics• Tests the test and gets Wyoming

student performance in the field test data

3 4 5 6 7 8 9 10 110

500

1000

1500

2000

2500

3000

3500

TargetActual

Number of Students by Grade

SBAC Activities: Item Writing

• 46 Wyoming educators• 60 hours of training, including videos and 2

multi-day, in-person sessions• Deep immersion into test and item design,

Common Core State Standards, and item writing process

• 300 Wyoming-developed items will contribute to the field test pool

SBAC Activities: Digital Library

• 50 Wyoming Educators• 20 hours of training in formative assessment

and instructional practices• Additional commitment of approx 40 hours– Submission of 4 - 6 resources– Review/rate 12 resources against set criteria

• Online collection of professional learning and instructional resources, focused on classroom-based, formative assessment resources

SBAC Activities: Alignment

• Participate in an alignment study to investigate the content validity of the assessment– 12 Wyoming educators– 16 hours of training and review time– Review test items for alignment to • Common Core State Standards• SBAC Assessment Targets• SBAC Test Task Models

SBAC Activities: Tech Readiness

• SBAC Technology Readiness Tool (TRT) assesses district capacity in– Bandwidth– Number and types of devices

• TRT first deployed in late May, 2013; by Dec 10, 45 districts had completed the Tool

• Of the respondents, 89% (40) report that at least 80% of their students can be tested via the existing infrastructure – BUT 44% report that devices don’t meet “recommended” criteria

WAEA School Performance

• Pilot School Performance Reports (SPRs) were issued in the fall of 2013

• SPRs rate most schools in the state– Exceeding– Meeting– Partially Meeting– Not Meeting

• SPRs report several indicators– Achievement, growth, equity OR– Achievement, equity, readiness

• WDE has offered training on the SPRs as well as specific training on the growth indicator

SPRs – High School Indicators

• 2013 pilot used available data• 2014 indicators will change for high school only • Achievement indicator will use a standardized score,

rather than percent proficient• Achievement indicator will include English/writing

combined score• Equity indicator will report grade 11 standardized scores

of only those students with low PLAN scores in grade 10 (consolidated subgroup)

• Readiness indicator will include grade 9 credits attained as well as Hathaway eligibility

PAWS Changes

• PAWS blueprint necessitates new proficiency level descriptors, standard-setting and cut scores before 2014 results are released

CCSS

PAWS

2014

PAWS

CCSS

CCSS

PAWS

2013 2015

SAWS and ALT

• SAWS is an entirely new test and will require first-ever standard-setting

• The ALT at grades 9 and 10 is new in 2014 and will require first-ever standard-setting

• Test development routinely involves item and bias reviews of newly written items before field testing as well as data review of items that have been field tested

Participants

• WDE staff• State Board• Teacher panels• Educational Testing Service

research & content teams• Technical Advisory Committee (TAC)• Governor

Communication

• New performance standards WILL result in lower proficiency rates, since we will be reporting against the 2012 WY Content Standards in English Language Arts and Math

• WDE expectation is consistent with experiences of Kentucky, New York, and Wisconsin as they made the shift

• Begin messaging to your constituents that lower reported proficiency rates do NOT mean students know less; it’s that the bar will be higher

PAWS Post-Test Analyses

• Test security, including appropriate test preparation, administration, and storage, is key to test integrity

• WDE has an obligation to report valid test results to ensure we can make inferences about student and school performance

• Violations of test security make such inferences difficult• WDE and TAC completed first-ever analyses of PAWS data

– Statistically high erasure rates (4 SD above state mean)– Statistically high gains (4 SD above state mean)

• School/grade/subject combinations with irregularities in 2013 will be reported this week to Superintendents

Formative Item Bank Pilots

• WDE will issue RFI to obtain info from vendors• WDE will host a vendor fair on March 5 for

interested district staff• Interested districts will procure item banks

directly from vendors • WDE will reimburse their costs for the 2014-

15 school year

Contacts• Deb Lindsey, Division Administrator

– 777-8753• Steve Marsh, Assessment Supervisor

– 777-3498• Jessica Steinbrenner, Assessment Operations

and ACT Program Manager– 777-8568

• Tammy Schroeder, PAWS-SAWS Development Manager– 777-3618

• Pari Swanson, ALT Assessment Program Manager– 777-5696

• Bailey Anthony, Senior Office Support Specialist– 777-5296