34
OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Embed Size (px)

Citation preview

Page 1: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

OAT Toolkit for Social Studies

Using OAT Grade 8

Score Reports

Page 2: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

“To improve student achievement results, use data to focus on a few simple, specific goals.”

Mike Schmoker

Why analyze data?

Page 3: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Assessments: Classroom, School,

District, State

CompileData

Analysis,Interpretationand Dialogue

Determine Aligned

Resources

Curriculum Design and Planning for New Learning

and Re-Teaching

Standards

Standards

Standards

Classroom Implementation

Standards

Data Analysis Cycle

Sta

nd

ard

s

Stan

dard

s

Page 4: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Enhanced Class Score Report

Page one is a welcome page. One item to note on this page is the web address for Ohio’s Instructional Management System (IMS): http://ims.ode.state.oh.us/ode/ims/

On this site you can access released test items, model lessons, research on social studies education and other resources.

Page 5: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

See the bottom of page 1 for information on

the SUCCESS web site.

SUCCESS Web Site

Page 6: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Compare your class average with

district and state averages.

Ohio Achievement Test Results

Page 7: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Performance Levels

View the percentage of students who

achieved each performance level.

Page 8: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Standard Categories

Page 9: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Standard Categories

Page 10: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Standard Categories

Page 11: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Standard Categories

Page 12: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports
Page 13: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports
Page 14: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

• On which standards were your students most successful? Least successful?

• On which standards does your class exceed the district or state average? Are those items clustered around a specific skill or content?

• On which standards does your class fall below the district or state average? Are those items clustered around a specific skill or content?

Interpreting the Data

Page 15: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Consider the OAT data using three filters:

What does this mean for

• Curriculum?• Instruction?• Assessment?

Interpreting the Data

Page 16: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Page 17: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Page 18: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Page 19: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

A. It demonstrated a need for a process for accepting territories into the union.

B. Disputes between states could not be resolved without a national judiciary.

C. It showed that farmers needed the right to vote in national elections.

D. The lack of a national army showed the need for a stronger national government.

Question 22, Grade 8 OAT in Social Studies, 2007:

Interpreting the Data

22. In what way did Shays’ Rebellion of 1786 lead to the formation of the United States Constitution?

Page 20: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Item 22 Commentary (edited):

This multiple-choice question requires students to explain how Shays’ Rebellion helped lead to adoption of the United States Constitution. Option D is correct because Shays’ Rebellion exposed the need for a stronger national government. Under the Articles of Confederation the national government was very weak and the public began to question whether the government could handle the country’s problems without control over the economy or a national army. Shays’ Rebellion contributed to these concerns and citizens began to demand a change, leading to the 1787 Constitutional Convention.

Interpreting the Data

Page 21: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

• Which benchmark is being assessed?

• How does this item test understanding of the benchmark?

• What is the cognitive level of this item?

• What can we learn from student performance on this item?

Discussion Questions

Page 22: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

• How did your students fare with these items?

• Do they frequently write in the classroom?

• Are they expected to answer questions completely and to provide supporting details?

• Do they share examples of thorough responses?

Constructed response items include both short answer and extended response. Though few in number, they have a significant impact on the total score.

Constructed Response Items

Page 23: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Page 24: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

The British Parliament’s decision to tax the American colonists caused conflict between the colonies and Britain. Read the following quotations from a British newspaper and a Massachusetts colonist.

“The Colonies were acquired with no other view than to be a convenience to us, and therefore it can never be imagined that we are to consult their interest.”

—The London Chronicle, 1764

“If our trade be taxed, why not our lands, or produce ... in short, everything we possess? They tax us without having legal representation.”

—Samuel Adams, 1765

In your Answer Document, compare how these two authors differ in their opinions about taxing the colonies. (2 points)

Interpreting the Data

Question 21, Grade 8 OAT in Social Studies, 2007:

Page 25: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Scoring Guidelines for Item 21 (Short Answer):

Exemplar:

The London Chronicle writer believes that the colonies should serve British interests and that there is no need to consult the colonists before taxing them or passing laws that affect them. Samuel Adams disagrees. He believes that the British do not have the right to tax the colonists because the colonists are not represented in Parliament.

Other correct responses may include, but are not limited to:

The British believe that they have the right to tax the colonists. The colonists believe that they must have representation in the British government before taxes are levied upon them.

Interpreting the Data

Page 26: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Scoring Guidelines for Item 21 (Short Answer):

Score Point Description

2 points: The response explains that Adams (or the colonists) and The London Chronicle writer (or the British) disagree over whether American interests need to be represented before Britain can tax the colonies. The response may imply the difference by accurately summarizing both views.

1 point: The response explains the point of view of EITHER the British OR the colonists regarding taxation.

Interpreting the Data

Page 27: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

• Which benchmark is being assessed?

• How does this item test understanding of the benchmark?

• What is the cognitive level of this item?

• What can we learn from student performance on this item?

Discussion Questions

Page 28: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Page 29: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

40. One way United States citizens can participate in government is by voting.

The right to participate in government through voting originated in which ancient civilization?

A. Rome B. Egypt C. Greece

D. Babylon

Interpreting the Data

Question 40, Grade 8 OAT in Social Studies, 2007:

Page 30: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Interpreting the Data

Item 4 Commentary (edited):

This multiple-choice question requires students to show understanding of the historical origins of rights U.S. citizens have today by identifying which ancient civilization first developed a voting system. Option C, Greece, is correct because the ancient Greeks established the first known democracy, which allowed citizens to vote on all laws. Many governments today, including the United States, include the right to vote for all citizens, which can be traced to the ancient Greeks.

Page 31: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

• Which benchmark is being assessed?

• How does this item test understanding of the benchmark?

• What is the cognitive level of this item?

• What can we learn from student performance on this item?

Discussion Questions

Page 32: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

What would you suggest to the teacher of this class?

Review alignment of lesson plans and assessments with the knowledge and skills outlined in the standards.

Work with 6-8 teachers to plan together. Start by looking at how each grade contributes to understanding of the benchmarks. How can we make connections between grade levels?

Review classroom resources and materials and identify gaps. Talk to the Media Specialist about supplemental texts, Web resources, or audio/visual materials.

Review classroom assessments to ensure that they push students to explain their answers and make connections between ideas.

Next Steps

Page 33: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

“If we are not going to try to improve what we do, there is little sense in assessing it.”

William Glasser

Page 34: OAT Toolkit for Social Studies Using OAT Grade 8 Score Reports

Resources

Mertler, Craig A. Interpreting Standardized Test Scores, Strategies for Data-Driven Instructional Decision Making. Sage Publications, Inc. Thousand Oaks, 2007.

Interpreting the Data