Smarter Balanced Assessment Consortium

Update

Great Prairie AEA November 13, 2012

Students will strive to meet the target provided for them

Grade 4 ITBS Math 2001 – 2011

Grade 4 Reading 2001 - 2011

Iowa Students’ Performance on Different Measures

4th Reading

4th Math 8th Reading

8th Math 11/12th Reading

11/12th Math

0

10

20

30

40

50

60

70

80

90

100

82 8276 78 78 78

33

43

33 3439

25

Iowa Tests NAEP

% P

rofi

cie

nt

I O W A D E P A R T M E N T O F E D U C A T I O N

Iowa and Four other States - NAEP

1992 1996 2000 2003 2005 2007 2009 2011240

250

260

270

280

290

300

310

Iowa

Massachusetts

North Carolina

Louisiana

Texas

I O W A D E P A R T M E N T O F E D U C A T I O N

Turn to Your NeighborWhat does this data tell you?

Are We Measuring What We Think We Are Measuring?

• Proficiency in Iowa is set at 41%ile on Iowa Assessments.

• Iowa assesses only reading comprehension and math problem solving.

• The Iowa Assessment is not fully aligned to the grade level expectations of the Iowa Core.

• What worked with grade span standards does not work with grade level standards.

• All the top performing states have set their expectations of proficiency higher than Iowa.

We need to measure what we expect students to learn, if we want to be competitive

What we are currently doing isn’t working.

We need a vision of a Cohesive Summative Assessment System that supports instruction and student learning

To begin…Iowa is a member of 3 consortia:

1. Smarter Balanced Assessment Consortium – 25 states

2. Dynamic Learning Maps (DLM) – 12 states

3. English Language Proficiency Assessment 21 (ELPA21) – 12 states

Kindergarten Readiness Aligned to Iowa Early Learning Standards by

2013

ELA Assessment Aligned to Iowa Core by 2014-15

Mathematics Assessment Aligned to Iowa Core by

2014-15

Alternate Assessment Aligned to the Iowa Core

by 2014-15

English Language Proficiency Assessment

Aligned to New ELP Standards & the Iowa

Core by 2015-16

Science Assessment Aligned to New Iowa Core

Science Standards by 2015-16

Social Studies Assessment Aligned to New Iowa Core Social Studies Standards

by 2016-17

Goal: Fully Operational by

2016-17

Iowa Assessment

System

Think About…Smarter Balanced Assessment Consortium offers a more

comprehensive assessment system closely aligned to the CCSS.

A National Consortium of States

• 25 states representing over 19 million K-12 students

• 21 governing states

• 4 advisory states

• Washington state is fiscal agent; WestEd is Project Management Partner

Positioning Assessment as a Strategy for Improving Learning

Instruction(Powerful Pedagogy – including Formative Assessment Practices)

Assessment(O f Higher Order Thinking & Reasoning)

Learning(Defined by the

Standards)

Balanced Assessment System

Summative

InterimFormative

Balanced Assessment System

Selected Response

Performance Tasks

Constructed Response

Balanced Assessment System Built on Seven Key Principles

1. An integrated system2. Evidence-based approach3. Teacher involvement4. State-led with transparent governance5. Focus: improving teaching and learning6. Actionable information – multiple

measures7. Established professional standards

Work group engagement of 90 state-level staff:

Each work group: • Led by co-chairs from governing

states• 6 or more members from advisory

or governing states• 1 liaison from the Executive

Committee • 1 WestEd partner

Work group responsibilities:

• Define scope and time line for work in its area

• Develop a work plan and resource requirements

• Determine and monitor the allocated budget

• Oversee Consortium work in its area, including identification and direction of vendors

Accessibility and Accommodations 1

Formative Assessment Practices and Professional Learning

2

Item Development3

Performance Tasks4

Reporting 5

Technology Approach 6

Test Administration 7

Test Design 8

Transition to Common Core State Standards

9

Validation and Psychometrics10

Consortium Work Groups

ELA and MathHow will these new tests be different than what

we are currently using?

Grades 3-8 + High SchoolSummative & Interim

On-lineComputer Adapted + Performance Tasks

English Language Arts + Mathematics

Multiple Formats– Selected response– Short constructed

response– Extended response– Performance tasks

Multiple Types– Traditional – Technology enhanced

(e.g. drag and drop, building models, etc.)

– Performance task w/collaboration + independent

– Independent performance task

“Students can demonstrate progress toward college and career readiness in English Language arts and literacy.”

“Students can demonstrate college and career readiness in English language arts and literacy.”

“Students can read closely and analytically to comprehend a range of increasingly complex literary and informational texts.”

“Students can produce effective and well-grounded writing for a range of purposes and audiences.”

“Students can employ effective speaking and listening skills for a range of purposes and audiences.”

“Students can engage in research and inquiry to investigate topics, and to analyze, integrate, and present information.”

Overall Claim for Grades 3-8

Overall Claim for Grade 11

Claim #1 - Reading

Claim #2 - Writing

Claim #3 - Speaking and Listening

Claim #4 - Research/Inquiry

Claims for the ELA/Literacy Summative & Interim Assessments

“Students can demonstrate progress toward college and career readiness in mathematics.”

“Students can demonstrate college and career readiness in mathematics.”

“Students can explain and apply mathematical concepts and interpret and carry out mathematical procedures with precision and fluency.”

“Students can clearly and precisely construct viable arguments to support their own reasoning and to critique the reasoning of others.”

Overall Claim for Grades 3-8

Overall Claim for Grade 11

Claim #1 - Concepts & Procedures

Claim #2 - Problem Solving Modeling and Data Analysis

Reasoning

Claim #3 - Communicating

Claims for the Mathematics Summative & Interim Assessments

“Students can solve a range of complex well-posed problems in pure and applied mathematics, making productive use of knowledge and problem solving strategies.” “Students can analyze complex, real-world scenarios and can construct and use mathematical models to interpret and solve problems.”

Smarter Balanced Includes Formative Assessment to Support Instruction

Formative assessment is a process used by teachers and students as part of instruction. It provides feedback to adjust ongoing teaching and learning to improve students’ achievement of core content (Adapted from Council of Chief State School Officers, 2010).

FEEDBACK LOOP

Produced by AEA 267

Smarter Balanced Assessment Consortium’s Formative Digital Library

• The Digital Library is designed as an online, one-stop site with professional learning resources and collaboration opportunities for educators, parents, and students to learn more about balanced assessment systems, in particular formative assessment practices.

• Focus is to provide resources for educators, parents, and students that support student learning.

Formative Practices in the Digital Library – capacity building

• Formative tools that teachers can use throughout the year to better understand where students are in their learning of the Iowa Core and determine any misconceptions, allowing for quick adjustments to instruction as well as differentiated instruction.

Digital Library Resources

• Exemplar Instructional Modules w/FA • Inventory of Current Resources • Professional Learning on Assessment Literacy • Professional Learning on Smarter Balanced

Score Reports & Educator Resources • Professional Learning on the Digital Library

Resources • Educator-Submitted Supplemental Resources• Formative Assessment Training for State

Leadership Teams• Collaborative Professional Learning on

Formative Assessment• Glossary of terms

State Implementation TimelineDeveloped with Educators and Experts

2011-2012 School Year —

• Early 2012: Assessment claims for ELA/literacy and mathematics approved by Governing States

• April 2012: Item/task specifications and review guidelines published– http://www.smarterbalanced.org/itemspecs

• June 2012: Training modules available for item writers/reviewers– http://www.smarterbalanced.org/smarter-balanced-assessments/item-writing-and-re

view

• Summer 2012: Educators from Governing States began writing items and tasks; cognitive labs / small scale trials begin

State Implementation Timeline Developed with Educators and Experts

2012-2013 School Year —• September 2012: Sample items reviewed by Smarter Balanced staff and

advisors, Student Achievement Partners• Fall 2012: Achievement Level Descriptors development process begins• October 2012: Sample items and tasks available• Winter/Spring 2013 —Begin developing Digital Library & PD• February / March 2013: Pilot Test of first 10,000 items and performance

tasks• Spring 2013: Technology readiness tool available in BEDS2013-14 School Year• Fall 2013 — Achievement Level Descriptors development process begins• Summer 2013 — Assessment Literacy PD available and first set of

Exemplary Modules• Spring 2014 —Field testing of summative and interim assessments2014-15 School Year —Implementation of assessment system and final launch

of digital library

Formative Assessment Practices and Professional Learning – educator

involvementNational Advisory Panel (NAP)

•11-20 experts•Begins December 2012•Provides policies and criteria for resources

State Leadership Team (SLT)•5- 8 members•Recruiting begins November 2012•Provides training for State Network of Educators

State Network of Educators (SNE)•70 to 100 members•Representation from LEAs, AEAs, content leaders,

ELL, IHE•Begin recruiting in January 2013•Provides reviews,

Begins December 2012

National

Advisory Panel

•CONTRACTOR will begin recruiting December 18, 2012

•11 to 20 experts on formative assessment practices, adult on-line professional learning, and quality instruction incorporating universal design for a range of diverse learners

•develop and recommend policies to establish quality criteria to be applied to all resources recommended for the Digital Library

•The policies should include, but not be limited to the following contents:•Quality indicators of formative assessment

processes and tools•Quality indicators of professional learning•Quality indicators of effective instruction•Quality indicators of the effective use of evidence

Begins November 2012

State Leadership Team (SLT)

•State will begin recruiting November 2012 through December 18, 2012

•5 to 8 education professionals + State Lead•attend face-to-face or online meeting with

National Advisory Panel to provide feedback on proposed policies

•build the awareness and capacity of state-wide efforts to disseminate Smarter Balanced resources for educators through the Digital Library

•coordinate the process of selecting members for the State Network of Educators (SNE) in their states, and may serve as an SNE member

•attend regional meetings to learn to train members of the SNE to deliver training

•provides online training to SNE•provides leadership to the content-level and

grade-level groups represented in the SNE•developing plan to maintain and continuously

improve leadership, facilitation, and governance structures post-2014

State Network

of Educators

(SNE)

•CONTRACTOR will begin recruiting January 18, 2012•approximately 50 to 150 members per state and

2700+ across all states (approximately 77 - 90 members in Iowa)

•approximately $1500 stipend•all work completed by September 2014•participate in the review and feedback cycles for

development of the quality criteria policies, the Digital Library application, Smarter Balanced–developed resources, the inventory of currently available resources, and online training provided by the SLT

•identify and recommend additional resources for the Digital Library using their content and grade-level expertise.

•attend online trainings about the resources in the Digital library

•disseminate the training about resources in the Digital Library throughout existing state professional learning networks such as regional educational service centers or county offices, etc. (Area Education Agencies in Iowa and content leadership networks)Begins January 2013

Smarter BalancedSample Items and Performance Tasks

How will these new tests be different that what we currently are using?

Purpose of Sample Items and Performance Tasks

• Demonstrate rigor and complexity of ELA/literacy and mathematics questions

• Showcase variety of item types:• Selected response• Constructed response• Technology enhanced• Performance tasks

• Help teachers to begin planning for the shifts in instruction

Sample Items and Tasks http://www.smarterbalanced.org/sample-items-and-performance-tasks/

Think About….Will this assessment program meet the needs of our state?

What are we doing differently?

Exploring the Sample Items

Sample Items and Tasks http://www.smarterbalanced.org/sample-items-and-performance-tasks/

.

Scroll Down to….

Accessing the Sample Items and Tasks

The sample items and performance tasks are compatible with desktop and laptop computers with the following Internet browsers:

• Firefox 3.6 or newer

• Internet Explorer 8 or newer

• Chrome 18 or newer

• Safari 4.1 or newer 

In addition, Android and iPad tablets with 9.5 inch screens (10 inch class) or larger are supported with the following Internet browsers:

• Chrome 18 or newer (Android)

• Safari 4.1 or newer (iPad)

Explore sample items and performance tasks:• English language arts/literacy• Mathematics• Frequently asked questions (PDF)

Sample Items and Tasks Navigation

View mathematics or ELA/literacy items

Advance to next item, or go back to previous

Sample Items and Tasks Navigation

Content Claim

Grade band

Sample Items and Tasks Navigation

Filter by item type, themes

Item Metadata

About this item

Exploring the Sample Items

Selected response and technology enhanced items are machine scorable

Feedback and Support Starting Oct. 9

Online feedback and phone support available

Accessibility and Accommodations

• Sample items do not include accessibility and accommodations features

• Full range of accessibility tools and accommodations options under development guided by:– Magda Chia, Ph.D., Director of Support for Under-Represented

Students– Accessibility and Accommodations Work Group– Students with Disabilities Advisory Committee

• Chair: Martha Thurlow (NCEO)

– English Language Learners Advisory Committee– Accessibility & Accommodations Framework

• Learn more online:– http://www.smarterbalanced.org/parents-students/support-for-under-represented-stu

dents/

Let’s Explore….

Choose at least one ELA and one math item to preview.

• What supports will be needed for students to engage with the technology enhanced items?

• How can we best prepare students to be successful with writing tasks in ELA or the communication items in mathematics?

• How can we best prepare students to be successful with performance tasks?

• What other issues do we need to address?• What questions do you still have?

CCSSO Webinar for Teachers on November 9 from 1:00 to 2:00 PM (CST)

2012 National Teacher of the Year to Speak about What Teachers Can Learn from the New PARCC and Smarter Balanced Sample Assessment

Items

CCSSO will be hosting a webinar with 2012 National Teacher of the Year Rebecca Mieliwocki on the recently released Partnership for Readiness for College and Career (PARCC) and Smarter Balanced sample assessment items in English language arts.

The webinar will be held on Friday, November 9 from 2-3 p.m. ET #-( 1-2PM CST).

To register, please visit https://ccsso.webex.com/ccsso/onstage/g.php?t=a&d=719177081. An analogous webinar focused on mathematics will also occur at a later date.

 Scott Norton, Host

QuestionsContact: Colleen Anderson

Iowa Department of Educationcolleen.anderson@iowa.govTom DeeterIowa Department of Educationtom.deeter@iowa.gov

QuestionsContact: Colleen Anderson

Iowa Department of Educationcolleen.anderson@iowa.govTom DeeterIowa Department of Educationtom.deeter@iowa.gov

Grade 8 Mathematics 2001 - 2011

Grade 8 Reading 2001 - 2011

Grade 11 Math 2001 - 2011

Grade 11 Reading 2001 - 2011