62
Overview to Performance Series: Understanding the Computer Adaptive Assessment Adapted from presentation by: Sallie Lawrence Senior Client Program Manager Copyright © 2017 Scantron Corporation. All rights reserved.

Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Overview to Performance Series: Understanding the Computer Adaptive

Assessment

Adapted from presentation by:

Sallie LawrenceSenior Client Program

Manager

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 2: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Alabama CPM Team2

Terrence Ingram

Education Specialist

Terry Grissom

Education Specialist

Combined 75 years in education – most of those years

serving students in Alabama

CPM team provides training and support to all districts in

Alabama.

Sallie Lawrence

Client Program Manager

Copyright © 2017 Scantron. All rights reserved.

Page 3: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Alabama AS/PS Project

Please visit our Dropbox for training materials,

recorded webinars, and other handouts and

guides that will support Achievement Series and

Performance Series

https://bit.ly/alsdedropbox

Copyright © 2017 Scantron Corporation. All rights reserved.

3

Page 4: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Your Staff ID is your Teacher Certification (TCH) Number (Ex: ABC-1234-5678.)• Type this is your browser: https://tcert.alsde.edu/

• Enter your last and first names, and click Search.

• Notice your TCH number on the right-hand side of the screen. Sometimes, there are multiple people with your name; if this is the case, evaluate the certification information associated with the name to be sure you area copying the correct TCH Number.

• Place this information the Helpful Information sheet provided to you today.

How to locate your Staff ID4

Page 5: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

5

Performance Series

What is Performance Series?

• Computer-adaptive test

• Test is built by Scantron

• Content-specific

• Online delivery only

• Restricted assessment

windows

Copyright © 2017 Scantron Corporation. All rights reserved.

• Test content is pre-determined

• Immediate Results

• Demonstrate Growth

• Compare Progress

• Identify Next Steps

Page 6: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Performance Series is a computer-adaptive, online assessment that

offers educators an efficient, standards-based method to diagnose

student needs, inform placement and instructional strategy

decisions, and predict performance on high-stakes tests.

Immediate results: Educators receive immediate access to test results, reports, and instructional resources to take action now - when the data is the most reliable

Demonstrate growth: Tests are administered at the beginning, middle, and end of every school year to accurately measure student growth and review program effectiveness.

Compare progress: Performance Series’ equal-interval measurement scale allows districts to track growth from year to year and make comparisons between students, regardless of grade level

Identify “Next Steps: Suggested Learning Objectives provide teachers, students, and parents with skills and concepts organized by ability level and linked to state or College & Career standards and instructional resources

Why Performance Series?

Copyright © 2017 Scantron Corporation. All rights reserved.

6

Page 7: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Suggested Learning Objectives

• Suggested Learning Objectives (SLOs) offer a

detailed list of skills based upon a student’s Scaled

Score.o Based on the student’s performance on the most recent subject-

based assessment.

o List of objectives the student has mostly likely attained

o List of objectives that could be considered instructional

next steps

• Use SLOs to—o Clarify where to begin instruction with a student

o Aid in the creation of long-term goals on an IEP/504

o Get student buy-in to the testing

o Guide conversations during parent-teacher conferences

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 8: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

8

0% 100%Proficiency

Boredom ZoneFrustration Zone

Grade-Level Expectation

Traditional Assessment

Goal of Adaptive Testing

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 9: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

The Adaptive Difference 9

Student begins

test slightly below

the 50th percentile

for grade level

Future test will

begin where last

test ended.

4th Grade Math Student – Fall – Scaled Score 2720

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 10: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Curriculum Alignment Guides

Alabama has a custom alignment:• Alabama Course of Study

• ACT College Readiness Standards

11

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 11: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Student

Testing

Experience

Copyright © 2017 Scantron. All rights reserved.

Page 12: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

14

To obtain your Site ID, contact District or School Location Controller

(LC), or your Scantron Education Specialist

Copyright © 2017 Scantron Corporation. All rights reserved.

Student Login

Page 13: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

15Copyright © 2017 Scantron Corporation. All rights reserved.

Student Login

Page 14: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

16Copyright © 2017 Scantron Corporation. All rights reserved.

Student Login

Page 15: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

The Student User Interface17

Page 16: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

K-2 Audio Check

Copyright © 2017 Scantron Corporation. All rights reserved.

18

Students Grades 5 & Below -- Audio Functionality Test

Page 17: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

K-2 Login Process - Video Tutorial

Copyright © 2017 Scantron Corporation. All rights reserved.

19

Page 18: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

20

Sample Question

*Students may use the

mouse to select an answer or

use the keyboard (A,B,C,D)

and press the enter key.

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 19: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

21

Sample Question

*Students may use the

mouse to select an answer or

use the keyboard (A,B,C,D)

and press the enter key.

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 20: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

22Copyright © 2017 Scantron Corporation. All rights reserved.

Sample Question – Audio Supported

Page 21: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

23

Completed Assessment Message

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 22: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Testing Irregularities

Copyright © 2017 Scantron Corporation. All rights reserved.

24

Students can spoil (delete) their tests by answering 3 out of 5

questions incorrectly in less than 15 seconds. They have to start from

the very beginning once the test has been spoiled.

Page 23: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

25

Resources for Test Administrators

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 24: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Performance Series

Student Profile Reports

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 25: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Performance Series Scores 27

1. Scaled Score (SS);

2. Standard Item Pool (SIP);

3. Unit Score Ranges (USR);

4. National Percentile Ranking (NPR)

5. Grade Level Equivalent (GLE)

6. Suggested Learning Objectives

(SLOs)Copyright © 2017 Scantron. All rights reserved.

Page 26: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• A linear transformation of the student ability estimate

• Range is from 1000 to 3700 except for Algebra and Geometry – the range is 5000 to 6000

Scaled Score (SS)28

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 27: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• The proportion of items that a student at a given ability level is expected to answer correctly if given all the items that are aligned to that student’s grade level and unit item pool

Standards Item Pool (SIP)29

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 28: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• An independent estimate of the range of ability (scale score) that is based on responses from each unit within a subject

• Consists of a unit Scaled Score (gray line) with the SEM on either end (green bars)

Unit Score Ranges (USR)30

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 29: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Lexile® MeasureThe Lexile scale is a developmental scale for reading ranging from

BR400L to above 1800L for advanced readers.

• The Lexile scale can be used

to measure a reader’s

ability level or a text’s difficulty level.

• Matching the reader and

text measures is the goal.

• If a reader has a Lexile measure of 600L, he or she will be able to

comprehend approximately 75% of a book with the same Lexile

measure (600L).

• The Lexile Measure can be used to find developmental and age-

appropriate books at the student’s reading level.

• The Lexile Measure (Research) is the measure to use when

tracking growth over time.

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 30: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• NPR compares students’ scaled scores to a normative sample

• Indicators that show where in a set of performance bands a student falls

National Percentile Ranking (NPR) and Performance Bands

32

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 31: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• The positioning of a student’s Scaled Score to reflect an estimated grade level based on national norm research

• Not available for K-1 or Algebra and Geometry

Grade Level Equivalent (GLE)33

Copyright © 2017 Scantron. All rights reserved.

Page 32: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Suggested Learning Objectives

• Suggested Learning Objectives (SLOs) offer a

detailed list of skills based upon a student’s Scaled

Score.o Based on the student’s performance on the most recent subject-

based assessment.

o List of objectives the student has mostly likely attained

o List of objectives that could be considered instructional

next steps

• Use SLOs to—o Clarify where to begin instruction with a student

o Aid in the creation of long-term goals on an IEP/504

o Get student buy-in to the testing

o Guide conversations during parent-teacher conferences

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 33: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Developing SLO Report35

Copyright © 2017 Scantron. All rights reserved.

Page 34: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Page 35: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Performance Series - Student Profiles

Page 36: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Performance Series - Student Profiles

Page 37: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Performance Series

Classroom Reports

Copyright © 2017 Scantron. All rights reserved.

Page 38: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Staff Login

www.performanceseries.com

Copyright © 2017 Scantron Corporation. All rights reserved.

40

Page 39: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

ReportsThe Reports button provides an overview of district and school

performance, supporting educators and administrators as they plan

instructional strategies.

• Disaggregate by• Students

• Classes

• Courses

• Staff

• Student groups

• Grade levels

• Locations

• Filter by• Sub-groups

• Special populations

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 40: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 41: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• Can be generated at the district, school, or teacher/class level

• Ability to immediately see average Scaled Score

• Can be used to determine how the district is performing

• Can be viewed by subject/grade level

Reports - Summary 43

Copyright © 2017 Scantron. All rights reserved.

Page 42: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Reports – Summary shown at Student level

Copyright © 2017 Scantron. All rights reserved.

Page 43: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 44: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• Available to Location Controllers, Administrators, and teachers

• Ability to view gains made in a specific reporting period

• Reports can be generated by District, School, Staff, Grade Level, Course, Class, and Student

• Helps to measure gains on a consistent scale to inform instruction and guiding progress

Reports - Gains46

Copyright © 2017 Scantron. All rights reserved.

Page 45: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

School Level View

Page 46: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Classroom Level View

Page 47: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 48: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• Available to Location Controllers, Administrators, and teachers

• Ability to view the normalized gains that were made in a specified testing period

• Student gains are measured against specified growth categories

• Measures gains on a consistent scale thereby informing instruction and guiding progress towards a normalized dataset

Reports – Gains Analysis50

Copyright © 2017 Scantron. All rights reserved.

Page 49: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Page 50: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 51: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• Compares student Scaled Scores to a normative sample for the specified subject

• Is grade dependent and represents the percentage of students that would score below the Scaled Score for the given student at the enrolled grade level

• Only available when testing is completed with the prescribed testing window

Reports - Percentile53

Copyright © 2017 Scantron. All rights reserved.

Page 52: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Good Tool for grouping

Page 53: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron Corporation. All rights reserved.

Page 54: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

• Shows the selected aggregate in the Performance Bands

• Does not guarantee the student will attain proficiency for the specific test

• Merely provide an easy way to evaluate the scores

Reports – Performance Bands56

Copyright © 2017 Scantron. All rights reserved.

Page 55: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Page 56: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Classroom

Reports

Copyright © 2017 Scantron. All rights reserved.

Page 57: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Performance Series- Classroom Reports

Copyright © 2017 Scantron Corporation. All rights reserved.

59

Page 58: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Page 59: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Class Standard Student Detail

Page 60: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Copyright © 2017 Scantron. All rights reserved.

Class Standard Student Detail

Page 61: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Alabama AS/PS Project

Please visit our Dropbox for training

materials, recorded webinars, and other

handouts and guides that will support

Achievement Series and Performance Series

http://bit.ly/alsdedropbox

Copyright © 2017 Scantron Corporation. All rights reserved.

63

Page 62: Overview to Performance Series: Understanding the Computer ......Performance Series is a computer-adaptive, online assessment that offers educators an efficient, standards-based method

Thank You!

Copyright © 2017 Scantron Corporation. All rights reserved.