Upload
others
View
1
Download
0
Embed Size (px)
Citation preview
Overview to Performance Series: Understanding the Computer Adaptive
Assessment
Adapted from presentation by:
Sallie LawrenceSenior Client Program
Manager
Copyright © 2017 Scantron Corporation. All rights reserved.
Alabama CPM Team2
Terrence Ingram
Education Specialist
Terry Grissom
Education Specialist
Combined 75 years in education – most of those years
serving students in Alabama
CPM team provides training and support to all districts in
Alabama.
Sallie Lawrence
Client Program Manager
Copyright © 2017 Scantron. All rights reserved.
Alabama AS/PS Project
Please visit our Dropbox for training materials,
recorded webinars, and other handouts and
guides that will support Achievement Series and
Performance Series
https://bit.ly/alsdedropbox
Copyright © 2017 Scantron Corporation. All rights reserved.
3
Your Staff ID is your Teacher Certification (TCH) Number (Ex: ABC-1234-5678.)• Type this is your browser: https://tcert.alsde.edu/
• Enter your last and first names, and click Search.
• Notice your TCH number on the right-hand side of the screen. Sometimes, there are multiple people with your name; if this is the case, evaluate the certification information associated with the name to be sure you area copying the correct TCH Number.
• Place this information the Helpful Information sheet provided to you today.
How to locate your Staff ID4
5
Performance Series
What is Performance Series?
• Computer-adaptive test
• Test is built by Scantron
• Content-specific
• Online delivery only
• Restricted assessment
windows
Copyright © 2017 Scantron Corporation. All rights reserved.
• Test content is pre-determined
• Immediate Results
• Demonstrate Growth
• Compare Progress
• Identify Next Steps
Performance Series is a computer-adaptive, online assessment that
offers educators an efficient, standards-based method to diagnose
student needs, inform placement and instructional strategy
decisions, and predict performance on high-stakes tests.
Immediate results: Educators receive immediate access to test results, reports, and instructional resources to take action now - when the data is the most reliable
Demonstrate growth: Tests are administered at the beginning, middle, and end of every school year to accurately measure student growth and review program effectiveness.
Compare progress: Performance Series’ equal-interval measurement scale allows districts to track growth from year to year and make comparisons between students, regardless of grade level
Identify “Next Steps: Suggested Learning Objectives provide teachers, students, and parents with skills and concepts organized by ability level and linked to state or College & Career standards and instructional resources
Why Performance Series?
Copyright © 2017 Scantron Corporation. All rights reserved.
6
Suggested Learning Objectives
• Suggested Learning Objectives (SLOs) offer a
detailed list of skills based upon a student’s Scaled
Score.o Based on the student’s performance on the most recent subject-
based assessment.
o List of objectives the student has mostly likely attained
o List of objectives that could be considered instructional
next steps
• Use SLOs to—o Clarify where to begin instruction with a student
o Aid in the creation of long-term goals on an IEP/504
o Get student buy-in to the testing
o Guide conversations during parent-teacher conferences
Copyright © 2017 Scantron Corporation. All rights reserved.
8
0% 100%Proficiency
Boredom ZoneFrustration Zone
Grade-Level Expectation
Traditional Assessment
Goal of Adaptive Testing
Copyright © 2017 Scantron Corporation. All rights reserved.
The Adaptive Difference 9
Student begins
test slightly below
the 50th percentile
for grade level
Future test will
begin where last
test ended.
4th Grade Math Student – Fall – Scaled Score 2720
Copyright © 2017 Scantron Corporation. All rights reserved.
Curriculum Alignment Guides
Alabama has a custom alignment:• Alabama Course of Study
• ACT College Readiness Standards
11
Copyright © 2017 Scantron Corporation. All rights reserved.
Student
Testing
Experience
Copyright © 2017 Scantron. All rights reserved.
14
To obtain your Site ID, contact District or School Location Controller
(LC), or your Scantron Education Specialist
Copyright © 2017 Scantron Corporation. All rights reserved.
Student Login
15Copyright © 2017 Scantron Corporation. All rights reserved.
Student Login
16Copyright © 2017 Scantron Corporation. All rights reserved.
Student Login
Copyright © 2017 Scantron Corporation. All rights reserved.
The Student User Interface17
K-2 Audio Check
Copyright © 2017 Scantron Corporation. All rights reserved.
18
Students Grades 5 & Below -- Audio Functionality Test
K-2 Login Process - Video Tutorial
Copyright © 2017 Scantron Corporation. All rights reserved.
19
20
Sample Question
*Students may use the
mouse to select an answer or
use the keyboard (A,B,C,D)
and press the enter key.
Copyright © 2017 Scantron Corporation. All rights reserved.
21
Sample Question
*Students may use the
mouse to select an answer or
use the keyboard (A,B,C,D)
and press the enter key.
Copyright © 2017 Scantron Corporation. All rights reserved.
22Copyright © 2017 Scantron Corporation. All rights reserved.
Sample Question – Audio Supported
23
Completed Assessment Message
Copyright © 2017 Scantron Corporation. All rights reserved.
Testing Irregularities
Copyright © 2017 Scantron Corporation. All rights reserved.
24
Students can spoil (delete) their tests by answering 3 out of 5
questions incorrectly in less than 15 seconds. They have to start from
the very beginning once the test has been spoiled.
25
Resources for Test Administrators
Copyright © 2017 Scantron Corporation. All rights reserved.
Performance Series
Student Profile Reports
Copyright © 2017 Scantron Corporation. All rights reserved.
Performance Series Scores 27
1. Scaled Score (SS);
2. Standard Item Pool (SIP);
3. Unit Score Ranges (USR);
4. National Percentile Ranking (NPR)
5. Grade Level Equivalent (GLE)
6. Suggested Learning Objectives
(SLOs)Copyright © 2017 Scantron. All rights reserved.
• A linear transformation of the student ability estimate
• Range is from 1000 to 3700 except for Algebra and Geometry – the range is 5000 to 6000
Scaled Score (SS)28
Copyright © 2017 Scantron Corporation. All rights reserved.
• The proportion of items that a student at a given ability level is expected to answer correctly if given all the items that are aligned to that student’s grade level and unit item pool
Standards Item Pool (SIP)29
Copyright © 2017 Scantron Corporation. All rights reserved.
• An independent estimate of the range of ability (scale score) that is based on responses from each unit within a subject
• Consists of a unit Scaled Score (gray line) with the SEM on either end (green bars)
Unit Score Ranges (USR)30
Copyright © 2017 Scantron Corporation. All rights reserved.
Lexile® MeasureThe Lexile scale is a developmental scale for reading ranging from
BR400L to above 1800L for advanced readers.
• The Lexile scale can be used
to measure a reader’s
ability level or a text’s difficulty level.
• Matching the reader and
text measures is the goal.
• If a reader has a Lexile measure of 600L, he or she will be able to
comprehend approximately 75% of a book with the same Lexile
measure (600L).
• The Lexile Measure can be used to find developmental and age-
appropriate books at the student’s reading level.
• The Lexile Measure (Research) is the measure to use when
tracking growth over time.
Copyright © 2017 Scantron Corporation. All rights reserved.
• NPR compares students’ scaled scores to a normative sample
• Indicators that show where in a set of performance bands a student falls
National Percentile Ranking (NPR) and Performance Bands
32
Copyright © 2017 Scantron Corporation. All rights reserved.
• The positioning of a student’s Scaled Score to reflect an estimated grade level based on national norm research
• Not available for K-1 or Algebra and Geometry
Grade Level Equivalent (GLE)33
Copyright © 2017 Scantron. All rights reserved.
Suggested Learning Objectives
• Suggested Learning Objectives (SLOs) offer a
detailed list of skills based upon a student’s Scaled
Score.o Based on the student’s performance on the most recent subject-
based assessment.
o List of objectives the student has mostly likely attained
o List of objectives that could be considered instructional
next steps
• Use SLOs to—o Clarify where to begin instruction with a student
o Aid in the creation of long-term goals on an IEP/504
o Get student buy-in to the testing
o Guide conversations during parent-teacher conferences
Copyright © 2017 Scantron Corporation. All rights reserved.
Developing SLO Report35
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron Corporation. All rights reserved.
Performance Series - Student Profiles
Copyright © 2017 Scantron Corporation. All rights reserved.
Performance Series - Student Profiles
Performance Series
Classroom Reports
Copyright © 2017 Scantron. All rights reserved.
Staff Login
www.performanceseries.com
Copyright © 2017 Scantron Corporation. All rights reserved.
40
ReportsThe Reports button provides an overview of district and school
performance, supporting educators and administrators as they plan
instructional strategies.
• Disaggregate by• Students
• Classes
• Courses
• Staff
• Student groups
• Grade levels
• Locations
• Filter by• Sub-groups
• Special populations
Copyright © 2017 Scantron Corporation. All rights reserved.
Copyright © 2017 Scantron Corporation. All rights reserved.
• Can be generated at the district, school, or teacher/class level
• Ability to immediately see average Scaled Score
• Can be used to determine how the district is performing
• Can be viewed by subject/grade level
Reports - Summary 43
Copyright © 2017 Scantron. All rights reserved.
Reports – Summary shown at Student level
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron Corporation. All rights reserved.
• Available to Location Controllers, Administrators, and teachers
• Ability to view gains made in a specific reporting period
• Reports can be generated by District, School, Staff, Grade Level, Course, Class, and Student
• Helps to measure gains on a consistent scale to inform instruction and guiding progress
Reports - Gains46
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
School Level View
Copyright © 2017 Scantron. All rights reserved.
Classroom Level View
Copyright © 2017 Scantron Corporation. All rights reserved.
• Available to Location Controllers, Administrators, and teachers
• Ability to view the normalized gains that were made in a specified testing period
• Student gains are measured against specified growth categories
• Measures gains on a consistent scale thereby informing instruction and guiding progress towards a normalized dataset
Reports – Gains Analysis50
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron Corporation. All rights reserved.
• Compares student Scaled Scores to a normative sample for the specified subject
• Is grade dependent and represents the percentage of students that would score below the Scaled Score for the given student at the enrolled grade level
• Only available when testing is completed with the prescribed testing window
Reports - Percentile53
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
Good Tool for grouping
Copyright © 2017 Scantron Corporation. All rights reserved.
• Shows the selected aggregate in the Performance Bands
• Does not guarantee the student will attain proficiency for the specific test
• Merely provide an easy way to evaluate the scores
Reports – Performance Bands56
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
Classroom
Reports
Copyright © 2017 Scantron. All rights reserved.
Performance Series- Classroom Reports
Copyright © 2017 Scantron Corporation. All rights reserved.
59
Copyright © 2017 Scantron. All rights reserved.
Copyright © 2017 Scantron. All rights reserved.
Class Standard Student Detail
Copyright © 2017 Scantron. All rights reserved.
Class Standard Student Detail
Alabama AS/PS Project
Please visit our Dropbox for training
materials, recorded webinars, and other
handouts and guides that will support
Achievement Series and Performance Series
http://bit.ly/alsdedropbox
Copyright © 2017 Scantron Corporation. All rights reserved.
63
Thank You!
Copyright © 2017 Scantron Corporation. All rights reserved.