Evaluating Instructional Materials Using Rubrics

Susan M. Kowalski, Brooke N. Bourdélat-Parks, and Pamela Van Scotter

11 March 2010 · NSTA · San Francisco, CA

www.bscs.org/sessions

BSCS Mission

The mission of BSCS is to transform science teaching and learning through research and development that strengthens learning environments and inspires a global community of scientifically literate citizens.

BSCS

•  Biological Sciences Curriculum Study •  Nonprofit organization 501(c)(3) •  Established in 1958 •  Work portfolio includes curriculum

development, professional development, educational research and evaluation projects.

•  Supported by public and private agencies

What brought you to this session?

Why did we develop rubrics?

•  Inquiry 8 project, funded by the Department of Education

•  Revisions after field tests •  Rigorous way to evaluate materials

Literacy Rubric

•  Have literacy strategies for each reading •  Want to make sure students:

– Have a high level of comprehension – Can pick out important information in readings

Sense-making Rubric

•  Strategies not necessarily associated with readings

•  Often about diagrams, data, graphs, or scientific communication

•  Helps students make sense of scientific concepts

Collaborative Learning Rubric

•  Research on collaborative learning – Empowers students – Takes the focus off teachers as the sole

authority •  See if particular aspects of collaborative

learning are present

Assessment

•  Opportunities for formative and summative assessment

•  Self, peer, and teacher assessment

5E Instructional Materials Rubric

•  Based on constructivist learning theory •  Certain aspects should be present in each

E

Results of External Evaluations

0% 10% 20% 30% 40% 50% 60% 70% 80% 90%

100%

% o

f Pos

sibl

e Po

ints

Key Feature

Unit Ratings by Feature

ES LS PS SS

Experience a Rubric

•  Choose the materials you want to evaluate •  Choose the rubric you want to use

– Begin with just 1 rubric – Only use the 5E rubric if you are familiar with

the instructional model and have materials written with the 5Es

•  Become familiar with the materials •  Complete the rubric

Need to Know

•  We have only provided student materials •  Skim whole chapter •  Base rubric work on:

– Assessment: Whole chapter/module – Collaborative: 1 instance of collaboration – Sense-making: 1 strategy – Literacy: Steps with 1 reading – 5E Materials: Whole chapter/module

Share Out

•  Describe some of the key questions on the rubric

•  Tell about your experience with the rubric •  Explain what you found about the

materials you were using

Question and Answer Time!

Do you have questions? Concerns?

Thank you for your attention!

To download this presentation, visit www.bscs.org/sessions

5415 Mark Dabling Blvd Colorado Springs, Colorado 80918

E: info@bscs.org W: www.bscs.org P: 719.531.5550