Oklahoma School Testing Program

Grades 3-8 and End-of-Instruction Assessments

OCCT, OMAAP, and Acuity Benchmark

Annual District Test Coordinator MeetingLocation:

OKC Sheraton Reed Center – May 28, 2014

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

2

Agenda

Welcome and Introduction

Session Goals

Program Administration

Online Assessment System

Wrap-up

Copy

right

© 2

014

CTB/

McG

raw

-H

ill L

LC.

3

Welcome

• Lisa Chandler • Assistant State Superintendent of Assessments

• Joyce DeFehr • Executive Director, State Testing

• Sonya Fitzgerald • Assistant Director of State Testing

• Craig Walker• Monitoring and Science Assessments Director

• Amy Nicar • ELA / History Assessment Specialist

Oklahoma State Department of Education

Copy

right

© 2

014

CTB/

McG

raw

-H

ill L

LC.

4

Welcome

• Katie Dunlap• Oklahoma State Solutions Manager

• Joe Turbett• Lead Architect, McGraw-Hill Education

• Brian Larkin • Technical Product Manager

• John Miller • Sr. Manager – Online Implementation Services

• David Needles • Sr. Program Manager - Acuity

• Tracy Keith • Sr. Program Manager – Oklahoma EOI

• Lindy Wienand • Sr. Program Manager – Oklahoma Grades 3-8

CTB/McGraw-Hill

Copy

right

© 2

014

CTB/

McG

raw

-H

ill L

LC.

5

Welcome

• Jake Goldsmith• Measured Progress Client Services Assistant Director

• Tinamarie Skillings• Measured Progress Lead Program Manager

• Monique Ring • Measured Progress Program Manager

• Sharman Lyons • Measured Progress Program Assistant

• Abbie Currier • eMetric Project Manager

Measured Progress & eMetric

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

6

Session Goals

Review Program

Administration Successes and

Challenges

Provide Forum for DTCs to

Express Testing

Successes and Failures

Collect Feedback to

Improve Delivery of

Future Testing Programs

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

7

CTB Program Administration

Improvements

Paper/pencil fulfillment & delivery Communication CTB Helpdesk Additional material orders Score reporting Online readiness

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

8

CTB Program Administration

Challenges

4/21 system interruption and testing suspension Faster communication Much fewer invalidations required No automatic invalidations

Material retrievals• 5/28 additional Grades 3-8 Two Week Reports• 5/30 EOI English II/III Two Week Reports

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

9

EOI Summer 2014 Administration

Place paper test material orders now – July 30th

Test Window Opens Test Window Closes Testing Hours

MondayJune 2, 2014

FridayAugust 1, 2014

Monday – Friday7:00 am – 7:00 pm

Central Time

Bulk Upload Opens Bulk Upload Closes Student Data AvailableTuesday

May 27, 2014Friday

May 30, 2014Monday

June 2, 2014Monday

June 9, 2014Friday

June 13, 2014Wednesday

June 18, 2014Monday

June 23, 2014Friday

June 27, 2014WednesdayJuly 2, 2014

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

10

Questions?

Oklahoma State Department of Education Acuity Benchmark Program

David Needles, Senior Program Manager - Acuity

May 2014

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

12

Purpose of Acuity Benchmark Program

Acuity Benchmark assessments are aligned to the College and Career Standards in Math and English/Language Arts, which are to be fully implemented and tested in 2014 – 2015.

- Grades 2 – 8 ELA and Math - End-of-Instruction Algebra I, Algebra II, Geometry, English II/III

The purpose of the Benchmark tests and use of the Acuity item bank is to help students transition to the new item types and rigor of the new standards and to help guide instruction.

- ELA and math benchmark tests include short, constructed response items.

- ELA also provides students practice with passage-based writing prompts.

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

13

Acuity Benchmark Benefits Acuity provided by the Oklahoma State Department of Education - Online or Offline Testing - Benchmark Assessments for Grades 2- 8 and EOI - Online Reports within 48 hours - Test Blueprints - Instructional Activities - Customized Test Feature (with Item Banks) - Performance Task Feature Professional Development - Regional Onsite Workshops - Online Digital Library (Acuity Community) - Live and Recorded WebEx - On–Demand videos - Reach Coaches - Acuity Demonstration Events - Vision 2020

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

14

2013-14 Acuity Benchmark Program Grade 2 Benchmark Assessments - 6 ELA diagnostic forms - 6 Math diagnostic forms - Instructional Activities - Additional Items for Customized Assessments - Open Test Windows

Professional Development Support - Regional Training in October and November - WebEx for Introduction to Acuity - Digital Library for “One Stop” Acuity Resources

Grades 3-8 and EOI Test Windows Expanded - 5 week window 2013 - 6 week window for 2014

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

15

2013-14 OK Acuity Benchmark Program

Assessment Type and SubjectFrequency of Test

WindowsPurpose Item Types

EOI Benchmark

Program

Algebra I, Algebra II, Geometry

2Help students transition to new item types, to the rigor of the new standards, and to help guide instruction.

Average of (35) Multiple-Choice and

(3) Open-Ended.

English II, English III

2

Grades 2* - 8 Benchmark

Program

Math 2Help students transition to new item types, to the rigor of the

new standards, and to help guide instruction.

Average of (20) Multiple-Choice

items and (2) Open-Ended. Writing

Prompts for Grades 3-8.Reading 2

*Grade 2 has open windows and 6 Diagnostic tests.

Benchmark Assessment Benchmark Grades 2013

Grade 2 Diagnostic Math and ELA NA 2 Open

Grade 3-8 Math and ELA 12 3-8

10/21 – 11/221/13-2/21

HS Algebra I & II, Geometry, English II & III 12

9-11 10/21 – 11/221/13-2/21

Note: EOI assessments can be used in lower grade levels.

2013-14 OK Acuity Benchmark Program

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

17

2013-14 Acuity Benchmark Program ActivityBENCHMARK 1-2

G3-8 and EOI SUMMARYTotals

Districts Participating In G3-8/EOI Acuity 236

Schools Participating In G3-8/EOI Acuity 519

Districts Testing Acuity 243

Number of Tests Assigned 397,656

Number of Tests Scored 270,695

Number of BM Writing Prompts 10,760

Custom Tests 42,172

Instructional Resources 13,774

Total Class Assessment Report Views 76,537

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

Acuity Benchmark Report Sample

18

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

19

Questions?

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

20

Break for Lunch

Afternoon session will start at 12:30pm

Copy

right

© 2

043

CTB/

McG

raw

-Hil

l LLC

.

21

CTB Online Assessment System

OAS Architecture Architecture set-up How OAS functions Solution

Test Delivery Client (TDC) User feedback

Test Administration System (TAS) User feedback

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

22

CTB Online Assessment System

Item Tryouts & Transitional Client Not Tested Codes & Other Demographics Student testing experience Other concerns

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

23

Questions?

Copy

right

© 2

014

CTB/

McG

raw

-Hil

l LLC

.

24

Thank you for your participation and feedback!