Nebraska State Accountability Spring 2012

1

Nebraska State Accountability Spring 2012

Online Test Administration TrainingFebruary 28-29, 2012

2

Agenda

Introductions: Your NeSA Project Team Testing Window & Other Key Dates General Guidelines Paper/Pencil Testing Procedures Reporting

3

NeSA Project TeamPatricia Johnson, Program Director

John Born, Senior Project Manager

Stacey Reasoner

Computerized Assessments and Learning Project Manager

Rachel Lappe, Project Manager

Valerie Cook, Project Manager

4

Finding the Answers to Your Questions

DRC’s NeSA Customer Service

1(866)342-6280

[email protected]

8:00 a.m. – 5:00 p.m. CST

7:00 a.m. – 5:00 p.m. (March 19-May 11, 2012)

5

NeSA-Reading Program to Date Standalone Field Test in 2009. Operational testing of all students in grades 3-8

and 11 since 2010; Performance Level cut scores set.

Additional field testing embedded in operational tests.

6

NeSA-Mathematics Program to Date

Standalone Field Test in 2010. Operational testing of all students in grades 3-8

and 11 since 2011; Performance Level cut scores set.

Additional field testing embedded in operational tests.

7

NeSA-Science Program to Date

Standalone Field Test in 2011. 2012 marks the first year of operational testing

of all students in grades 5, 8, and 11. Additional field test items embedded in

operational tests. Performance Level cut scores to be set this

summer.

8

2012 NeSA Training

DRC’s eDIRECT & Enrollments System Training September 27-29, 2011 https://ne.drcedirect.com Recording available on NDE website

Technology Coordinator WebEx Training November 8-10, 2011 Recording available on NDE website

9

2012 NeSA Training (con’t)

Test Administrator WebEx Training Online – February 28-29, 2012 Paper/Pencil – February 28-29, 2012 Alternate Assessment – March 1, 2012

2012 NeSA Reporting WebEx Training August 7-9, 2012

10

Testing Window

March 26- May 4, 2012

The window is the same foronline and paper/pencil

administrations, including the NeSA-Alternate Assessments.

11

2012 NeSA Key Dates

Test Administration Training February 28-March 1

CAL Management Tools Available March 5

Paper/Pencil Test Materials Delivered to Districts March 5

Online Test Session Tickets Available March 5

Districts Train School Personnel and Distribute MaterialsOne Week Priorto Test Window

Testing Window March 26-May 4

Last Day for UPS to Pick Up Test Materials from Districts May 9

Please note

12

NeSA-Reading, Mathematics, and Science– two sessions each

Flexibility during the 6-week window Make-ups required Recommend scheduling early in the window Recommend avoiding Mondays and Fridays

Scheduling the Test

13

Online version of the NeSA-Mathematics and Science tests available in Spanish.

Braille and Large Print versions of the testbooklets available for NeSA-Reading, Mathematics, and Science.

Spanish translations of NeSA-Mathematics and Science paper/pencil test booklets available.

Spanish translation versions of the NeSA-Reading test materials available from NDE.

Accommodations

14

Accommodations for Students with IEP or 504 Plans and English Language Learners must be reported in Management Tools Student Editor for online testers.

See NDE website for the Approved Accommodations Document.

http://www.education.ne.gov/Assessment/NeSA_Accommodations.htm

Accommodations

15

Procedures for online schools with some students taking the paper/pencil test

All students contained in the NSSRS file for online schools will be loaded into the NeSA online testing system and listed in Student Editor.

PreID Labels provided for NeSA-Alternate Assessment students only. Use District/School Labels and fill in answer sheets for others.

Mixed Mode Testing

16

Procedures for online schools with some students taking the paper/pencil test

Do NOT edit/change online records for students taking the paper/pencil test – complete answer sheets.

Do NOT distribute Test Session Tickets to students taking the paper/pencil test – if printed, destroy them securely.

Mixed Mode Testing

17

Prepare Students for Testing Inform students of the scheduled test sessions in

advance. Explain to the students why they are being given

the test and how the results will be used. Students should realize that doing their best is

important.

18

Prepare Testing Locations

Plan ahead – check schedules. Organize test materials. Provide a testing location with good lighting and

comfortable seating and as free of outside disturbances as possible.

Remove visual aids/clues. Post a TESTING IN PROGRESS sign.

Prepare Testing Location

19

Test Security Test is not to be viewed by anyone prior to administration. NeSA-Reading, Mathematics, and Science materials may not be reproduced. No coaching or feedback with regard to content. Move around the testing site and be aware that students are following instructions.

See test administration manual for comprehensive test security information.

Test Security

20

Test Security Restrict electronic devices (e.g., Palm Pilots, cell phones, PDAs, wristwatches with electronic displays, calculators, iPods,

MP3 players, etc.) Recommend one assistant/proctor per 12-15 students, in addition to Test Administrator. Students must not be left alone with test materials. Students cannot take test materials out of the testing site.

Test Security

21

Live Demonstration of Online Testing Software

CAL Version 6.7

22

Student Tutorials and Practice Tests are currently available. Make sure students have practiced using software and tools. Use the NeSA shortcuts on the computer desktop to access the Practice Tests and

Tutorials.

Online Tutorials and Practice Tests

Practice Tests Tutorials

23


24

Online Tutorials and Practice TestsOnline Tutorials and Practice Tests

25


26


27


Sample Reading Item


28

Online Management Tools Data Tools- Add a Student- Student Editor

Online Management Tools

29

Online Management Tools Testing Main Page- Print Tickets

- Monitor Status

• Reactivate Tickets (same day)

• Student Status Spreadsheet

- View Results (Preliminary Individual Test Results and Group Summary) for Reading, Mathematics, and Science

- Audit Spreadsheet

Manage Testing

30

Online Testing Preparation

Primary Test Preparation Tasks

1. View/Edit student data

2. Add new students

3. Print Test Session Tickets

Online Testing Preparation

31

StudentEditor

32

View/Edit Student DataView pre-registered student data via Student Editor.

Start by searching for student records.Searches can be narrowed based on specific criteria and filters.Select how many student records to display per page.Edits made to student information during the NeSA-Writing window have not been retained.

View/Edit Student Data

33

34

35

View Student Data byDownloading the Student Data PDF

36

View and edit student data via the Student Editor tabs.

- Identification- Location- Demographic- Not Tested- Alternate Assessment- Accommodations – IEP/504 & Visual- Linguistic Support – ELL- Spanish

37

Edits made to student Identification, Location, and/or Demographic information will be reflected across all content areas.

Edits made to Not Tested, Alternate Assessment, Spanish, Accommodations, and/or Linguistic Support must be made for each content area to which they apply.

Any edits made to student data will NOT be updated in NSSRS. Notify the NDE if you find incorrect student information.

38

Identification Student ID and Name fields are taken directly from

NSSRS. NDE will review all mismatches.

Identification

39

Location District-level users can change a student’s school within

the district. School and grade are taken directly from NSSRS. NDE

will review all mismatches.

Location

40

Demographic Demographic fields are taken directly from NSSRS. NDE

will review all mismatches.

Demographics

41

Not Tested MUST select Not Tested codes by the end of the testing

window for any student in the system that does not take NeSA-Reading, Mathematics, and/or Science.

Not Tested

42

Alternate Assessment

Flag Alternate Assessment for Reading before testing. Test Session Ticket will not be printed for Alternate Assessments.

Alternate Assessment

43

Alternate Assessment or Spanish Flag Alternate Assessment for Mathematics and/or Science

before testing . Test Session Ticket will not print for Alternate Assessments.

Flag students who require a Spanish translation for Mathematics and/or Science before testing to get correct Test Session Tickets.

Alternate or Spanish Assessment

44

Accommodations – IEP/504 & Visual Flag Visual Accommodations for students before testing to

enable Visual Accommodations tools. Visual Accommodations tools are a form of Content

Presentation accommodations. Indicate other accommodations by the end of the testing

window for any student in the system that takes a test with accommodations.

Accommodations – IEP/504 & Visual

45

Linguistic Support - ELL LEP/ELL Eligible should be checked on the Demographic

tab for any students who receive Linguistic Support. Indicate Linguistic Support accommodations by the end of

the testing window for any student in the system that takes a test with accommodations.

Linguistic Support - ELL

46

Students can be added any time after Management Tools open and before the Testing Window ends (March 5- May 4).

If students are added after Test Session Tickets have been printed, tickets for individual students can be printed.

Make every effort to match new student data exactly to the data on file in NSSRS.

Add New Students via Add a Student

47

Add a Student

48

Manage Testing

Select Test Administration - 2012 NeSA-R,M,S. Functionality available:- Print Tickets- Monitor Status (and Reactivate)- View Results (NeSA-Reading, Mathematics, and

Science)- Audit Spreadsheet

49

Manage Testing

50

Print Test Session Tickets

Available Monday, March 5. Print tickets for both Test Sessions. Print tickets for all three subjects. Tickets are secure test materials. Recommend printing tickets one week prior to

initial test session.


51


Tickets can be printed by subject/grade or for individual students.

- Tickets will print for students at online schools who are taking the paper/pencil version of the test unless otherwise specified (either exclude from printing or destroy tickets after printing).

- No tickets will be printed for students flagged Alternate Assessment in Student Editor.


52

Print Test Session TicketsPrint Test Session Tickets

53

Print Test Session TicketsPrint Test Session Tickets

54

Print Test Session Tickets Prints 12 tickets per page. Ticket Packet includes: Administration Information, Summary,

Tickets for Session 1 and Session 2.

Example of Standard Session Ticket


55

Print Test Session Tickets Visual Accommodations and/or Spanish translation will be noted on Test Session

Tickets printed for students flagged with these accommodations. Make sure students’ computers comply with extra system requirements for Visual

Accommodations tools.

Examples of Visual Accommodations and Spanish Translation Test Session Tickets


56

Test Session Tickets

Test Session Tickets

57

Monitor Status of Test Sessions. View/Print Student Status Spreadsheet. Reactivate Test Session Tickets. Review Audit Spreadsheet. View Results.

Primary Test Administration Activities

58

Monitor StatusMonitor Status

59

Monitor Status

Monitor Test Sessions- Color coded testing status icons.- Test Sessions may be taken out of

order. View/Print Student Status Spreadsheet- Excel-compatible format of status screen.- Status, test duration, start times, and end

times by test session for each student.

Monitor Status

60

Monitor StatusMonitor Status

61

Reactivation Test Session Tickets (login passwords) are only active for 90

minutes after a student logs into test. Tests are not timed and students will never be forced out of a

test. Pause functionality (15 minutes). Inactivity of 15 minutes during testing will cause the system

to log student out of test. Internet connectivity issues and unexpected interruptions can

happen (fire drill, emergency, computer freezes up, power outage).

Reactivation

62

Reactivation

Reactivation of ticket will be required if it has been more than 90 minutes since login.

Same day only. Reactivations will expire at the end of day. District Assessment Contacts may email NDE at

[email protected] with any questions about reactivation procedures.

Reactivation

63

ReactivationReactivation

64

Reactivation

Same day reactivation only

Reactivation

65

View ResultsView Results

66

View Results Preliminary individual student test results and group

summary information for NeSA-Reading, Mathematics, and Science.

Students must complete both sessions. Student Test Results – Raw Scores and Percent

Correct (embedded field test items excluded). Students testing paper/pencil and/or taking the

Alternate Assessment are not included in Group Summary information.

View Results

67

View ResultsView Results

68

View Results

69

Audit SpreadsheetAudit Spreadsheet

70

Audit Spreadsheet

Use this report to verify that all students in your district, school, or grade have tested.

The Audit Spreadsheet is updated nightly.

Audit Spreadsheet

71

Online Testing: Wrap-Up Disposal of Test Session Tickets- Tickets are secure materials and must be distributed and

collected as such.- School Test Coordinator to collect and destroy. Online Manual for Test Coordinators and Administrators- Posted on NDE website, eDIRECT Documents, and

Documentation on CAL’s NeSA Main Page.- Provides information for test preparation and administration

directions for testing day.- Includes Directions for Administering the 2012 NeSA-Reading,

Mathematics, and Science Tests.

72

Contrasting GroupsStandard Setting Survey

Survey for NeSA-Science will be conductedMarch 7-23 via eDIRECT.

All Nebraska science teachers are eligible. Participants should attend 1 of 6 short WebEx

training sessions March 7-13.

Contrasting Groups Standard Setting Survey

73

Bookmark Standard Setting

Standard Setting for NeSA-Science will be conducted June 26 in Lincoln.

Panelists will be selected from the nominated pool so that the state is fully represented.

Bookmark Standard Setting

74

Reporting

Spring 2012 NeSA-Reading, Mathematics, and Science results will be reported in August pending establishment of Science Performance Level cut scores.

2012 NeSA-Reading, Mathematics, and Science Reporting Workshops will be conducted via WebEx August 7-9, 2012.

Reporting

75

2012 Reading, Mathematics, and Science ReportsImmediate Results for Online Testing via Management Tools

Test Results (Number & percent correct for students tested online) Group Summary

Reports Posted to eDIRECT in August Student Data Files Performance Level Summary (State, District, School) Reading and Mathematics Indicator Summaries (State, District, School) NEW! Science Grade Level Standard Summary (State, District, School) District Report of School Performance School Student Roster Individual Student Report also available online

Printed Reports Delivered in August Individual Student Report – 2 copies

76

Questions & Answers