2019–20 Computer‑based ELPAC Field Test Administration ......Summative ELPAC in February 2020 and the paper-pencil Initial ELPAC in July 2020. In addition to this field test, ETS

English Language Proficiency Assessments for California

2019–20 Computer‑based ELPAC

Field Test Administration Manual

© California Department of EducationPrepared by Educational Testing Service ®Posted September 2019


– ii –

Computer-based ELPAC Field Test Administration Manual Table of Contents Chapter 1. Computer-based ELPAC Field Test Overview ...................................................1

Introduction to the Computer-based ELPAC ..........................................................................2 About This Manual .............................................................................................................2

Student Eligibility and Participation in the Computer-based ELPAC Field Test ......................4 Field Test Administration Features .........................................................................................5

Form Assignment ...............................................................................................................5 Test Design and Administration Guidelines .......................................................................6 Technical Requirements ....................................................................................................7 Directions for Administration and Examiner’s Manuals ......................................................7 Test Scheduling .................................................................................................................8

Test Administration Roles and Responsibilities .................................................................... 11 LEA ELPAC Coordinator Responsibilities ........................................................................ 11 Site ELPAC Coordinator Responsibilities ......................................................................... 13 ELPAC Test Examiner Responsibilities ........................................................................... 16

Chapter 2. Computer-based Test Administration Preparation and Planning .................. 19 Preparing for the Computer-based ELPAC Field Test Administration .................................. 20

Using the Test Operations Management System (TOMS) to Prepare for the Field Test .. 20 Technology Requirements ............................................................................................... 24

Accessibility Resources ........................................................................................................ 25 Overview .......................................................................................................................... 25 Availability of Universal Tools .......................................................................................... 26 Availability of Designated Supports .................................................................................. 27 Availability of Accommodations ........................................................................................ 29

Training Resources .............................................................................................................. 30 Using the Computer-based ELPAC Training Videos ........................................................ 30 Accessing the ELPAC Training Tests .............................................................................. 30

Chapter 3. Test Security ...................................................................................................... 33 Test Security for the Computer-based ELPAC Field Test .................................................... 34

Security of the Test Environment ..................................................................................... 34 Test Security Incidents ..................................................................................................... 38

Using the Security and Test Administration Incident Reporting System (STAIRS) ............... 40 LEA ELPAC Coordinator STAIRS Responsibilities .......................................................... 40 Site ELPAC Coordinator STAIRS Responsibilities ........................................................... 41 Online System Appeal Types ........................................................................................... 41 ELPAC STAIRS Case Required Information .................................................................... 42 Steps for Submitting an Incident ...................................................................................... 43 Caution When Using the STAIRS Form ........................................................................... 49 Caution About Filing an Appeal ........................................................................................ 50 Post-decision Actions ....................................................................................................... 50 Reasons for Rejection ...................................................................................................... 50 Search Incidents and Check Statuses ............................................................................. 51 View an Appeal Status in STAIRS ................................................................................... 53


– iii –

Withdraw a STAIRS Case ................................................................................................ 55 Communicate with the CDE or CalTAC about a Case ..................................................... 56 Reports Generated ........................................................................................................... 57

Chapter 4. Administration of the Computer-based ELPAC Field Test to Students ........ 59 Using the Directions for Administration (DFA) ...................................................................... 60

Overview .......................................................................................................................... 60 Scoring the Speaking Domain Locally .............................................................................. 61

Administering the Kindergarten Through Grade Two ELPAC Writing Domain ..................... 63 Filling in Demographic Information ................................................................................... 63 Kindergarten through Grade Two Writing Directions for Administration (DFAs) ............... 67

Administering an Online Test Session for Listening, Reading, Speaking, and Grades Three Through Twelve Writing Domains ............................................................................ 68

Entering Student Responses into the System .................................................................. 69 Beginning the Test ........................................................................................................... 71 Monitoring Student Progress ............................................................................................ 86 How to Approve Print Requests ....................................................................................... 91 Ending a Test Session ..................................................................................................... 93

Chapter 5. Administration of the Paper-Pencil ELPAC Field Test .................................... 97 Preparing for the Paper-Pencil ELPAC Field Test Administration ........................................ 98

Responsibilities of the LEA ELPAC Coordinator—Before Testing ................................... 98 Responsibilities of the Site ELPAC Coordinator—Before Testing .................................. 100

Administering the Paper-Pencil ELPAC Field Test ............................................................. 109 Responsibilities of the LEA ELPAC Coordinator—During and After Testing .................. 109 Responsibilities of the Site ELPAC Coordinator—After Testing ..................................... 110

Appendices ......................................................................................................................... 113 Appendix A. Incident Types, Descriptions, and Actions in the ELPAC Field Test

STAIRS/Appeals Process ................................................................................................ 114 Appendix B. Incident Types and Questions on the ELPAC Field Test STAIRS/Appeals Form

......................................................................................................................................... 118

List of Tables Table 1. Number of Items and Estimated Testing Times for Field Test Forms ....................... 9 Table 2. List of Key Dates .................................................................................................... 10 Table 3. Accessibility Resources That Must Be Assigned in TOMS ..................................... 23 Table 4. Available Accessibility Resources for the Paper-Pencil ELPAC Field Test ............. 26 Table 5. Universal Tools Available for the Computer-Based ELPAC Field Test ................... 26 Table 6. Designated Supports Available for the Computer-based ELPAC Field Test ........... 27 Table 7. Requirements of the Test Environment Before Testing .......................................... 35 Table 8. Requirements of the Test Environment During Testing .......................................... 36 Table 9. Requirements of the Test Environment During and After Testing ........................... 37 Table 10. Requirements of the Test Environment After Testing ........................................... 38 Table 11. Definitions for Test Security Incidents ................................................................... 39 Table 12. Search for Incidents Fields ................................................................................... 52 Table 13. Search for Appeals Fields ..................................................................................... 54 Table 14. Demographic Fields on Kindergarten through Grade Two Writing Answer Book . 64 Table 15. Test Administrator Site Features .......................................................................... 87 Table 16. Columns in the Students in Your Operational Test Session Table ....................... 90


– iv –

Table 17. Student Testing Statuses ...................................................................................... 91 Table 18. Demographic Fields on Answer Book ................................................................. 104 Table 19. GIS Form Fields.................................................................................................. 112

List of Figures Figure 1. Assigning students to the ELPAC field test in TOMS ............................................ 22 Figure 2. [TOMS] button on elpac.org .................................................................................. 43 Figure 3. STAIRS tab on the TOMS navigation bar .............................................................. 44 Figure 4. Background Information screen in STAIRS ........................................................... 44 Figure 5. Testing Issues screen in STAIRS .......................................................................... 45 Figure 6. Follow up Testing Issues questions in STAIRS ..................................................... 45 Figure 7. Student Information screen in STAIRS .................................................................. 46 Figure 8. Download Template screen in STAIRS ................................................................. 47 Figure 9. Choose File screen in STAIRS .............................................................................. 47 Figure 10. STAIRS Submission Information screen in STAIRS ............................................ 48 Figure 11. Cases for Appeals screen in STAIRS .................................................................. 49 Figure 12. Search for Incidents screen in STAIRS ............................................................... 51 Figure 13. [View] and [Edit] icons in Search Results ............................................................ 53 Figure 14. Search for Appeals screen in STAIRS ................................................................. 53 Figure 15. Search for Incidents screen in STAIRS ............................................................... 55 Figure 16. STAIRS Summary screen in STAIRS .................................................................. 56 Figure 17. Notes tab in STAIRS ........................................................................................... 57 Figure 18. Comments screen in STAIRS .............................................................................. 57 Figure 19. Speaking domain student score sheet ................................................................. 62 Figure 20. Sample Answer Book front and back cover fields ............................................... 64 Figure 21. Test timeout warning message ............................................................................ 70 Figure 22. [Test Administrator Interface for All Online Tests] button .................................... 71 Figure 23. Test Administrator Interface Logon screen .......................................................... 72 Figure 24. Message from the Test Administrator Interface ................................................... 72 Figure 25. Operational Test Selection window ..................................................................... 73 Figure 26. Operational Test Selection screen....................................................................... 74 Figure 27. Top of the Test Administrator Interface ............................................................... 74 Figure 28. Student Sign In screen ........................................................................................ 75 Figure 29. Is This You? screen ............................................................................................. 76 Figure 30. Your Tests selection box ..................................................................................... 76 Figure 31. Waiting for TA Approval dialog box ..................................................................... 77 Figure 32. Approvals and Student Test Settings screen ....................................................... 77 Figure 33. Approvals and Student Test Settings screen ....................................................... 78 Figure 34. Part of the Test Settings page for a selected student .......................................... 79 Figure 35. Sound and Video Playback Check page ............................................................. 80 Figure 36. Recording Device Check page ............................................................................ 81 Figure 37. Text-to-Speech Sound Check page..................................................................... 82 Figure 38. Instructions and Help page .................................................................................. 83 Figure 39. Review Test Settings screen ............................................................................... 84 Figure 40. Instructions and Help screen ............................................................................... 85 Figure 41. Test Administrator Site layout .............................................................................. 86


– v –

Figure 42. Top of Test Administrator Interface screen .......................................................... 86 Figure 43. Monitoring student progress in the Test Administrator Interface ......................... 88 Figure 44. Monitoring student test status in the Test Administrator Interface ....................... 89 Figure 45. Student Print Request window ............................................................................ 92 Figure 46. [Approved Requests] button on Test Administrator Interface .............................. 92 Figure 47. Approved Requests window ................................................................................ 93 Figure 48. End Test page ..................................................................................................... 93 Figure 49. Test Summary page ............................................................................................ 94 Figure 50. Test Administrator Interface system banner ........................................................ 95 Figure 51. Test material cover samples .............................................................................. 101 Figure 52. Answer Book front and back cover fields ........................................................... 103 Figure 53. ELPAC GIS ....................................................................................................... 111


– vi –

Acronyms and Initialisms in the Computer-based English Language Proficiency Assessments for California Field Test Administration Manual

Term Meaning CAASPP California Assessment of Student Performance and Progress CALPADS California Longitudinal Pupil Achievement Data System CalTAC California Technical Assistance Center CCR California Code of Regulations

CDE California Department of Education DEI Data Entry Interface DFA Directions for Administration

EL English learner ELP English language proficiency ELPAC English Language Proficiency Assessments for California ELPSA English Language Proficiency and Spanish Assessments ETS Educational Testing Service GIS Group Identification Sheet LEA local educational agency STAIRS Security and Test Administration Incident Reporting System SSID Statewide Student Identifier TOMS Test Operations Management System

Chapter 1. Computer-based ELPAC Field Test Overview

Computer-based ELPAC Field Test Overview | Introduction to the Computer-based ELPAC

2 2019–20 Computer-based ELPAC Field Test Administration Manual Customization Copyright © 2019 by the California Department of Education

Introduction to the Computer-based ELPAC

Additional Resources in This Section: • English Language Proficiency Assessments for California (ELPAC) website—

https://www.elpac.org/

The ELPAC is the required state test for English language proficiency (ELP) that is given to students whose primary language is a language other than English. State and federal law requires that local educational agencies (LEAs) administer a state test of ELP to eligible students in kindergarten through grade twelve. The ELPAC is aligned with California’s 2012 English Language Development Standards and assesses students’ ELP skills in Listening, Speaking, Reading, and Writing. In November 2018, the State Board of Education approved the plan to transition the current paper-pencil ELPAC to a computer-based ELPAC. As part of the transition work to prepare for the operational computer-based ELPAC administration, Educational Testing Service (ETS) is conducting a combined Initial and Summative ELPAC field test of the ELPAC items in an online environment. The computer-based ELPAC will replace the paper-pencil Summative ELPAC in February 2020 and the paper-pencil Initial ELPAC in July 2020. In addition to this field test, ETS will release the computer-based ELPAC training tests in September 2019 and ETS will have an Accessibility Pilot during the October 2019 field test testing window. This pilot will provide an opportunity for test examiners and English learner students with disabilities to try out the full array of accessibility resources on the computer-based ELPAC training tests. The ELPAC website has more information about the Accessibility Pilot.

About This Manual This Computer-based English Language Proficiency Assessments for California Field Test Administration Manual provides information and instructions about test preparation and the administration of the computer-based ELPAC field test as well as the paper-pencil field test component (discussed in the Form Assignment section of this manual). The intended users of this manual are staff who play a role in the administration of the field test, including LEA ELPAC coordinators, site ELPAC coordinators, and ELPAC test examiners. This manual can also be used as a resource for test examiners who wish to administer the ELPAC training tests to students to help them become familiar with the format and functionality of the online test. For ELPAC, the training tests are available in computer-based format for the Listening, Reading, Speaking, and Writing (grades three through twelve only) domains. These tests and the Directions for Administration (DFA) can be accessed on the ELPAC website.

https://www.elpac.org/https://www.elpac.org/https://www.elpac.org/

Computer-based ELPAC Field Test Overview |

Introduction to the Computer-based ELPAC

2019–20 Computer-based ELPAC Field Test Administration Manual 3 Customization Copyright © 2019 by the California Department of Education

For specific questions not addressed in this manual, test examiners can contact their site ELPAC coordinator, site ELPAC coordinators can contact their LEA ELPAC coordinator, and LEA ELPAC coordinators can contact the California Technical Assistance Center (CalTAC). If administering the field test, follow the instructions and criteria laid out in this manual. For additional queries, the LEA ELPAC coordinator should contact CalTAC by phone at 800-955-2954, by email at [email protected], or by using the chat function linked on the ELPAC website. The California Department of Education English Language Proficiency and Spanish Assessments (ELPSA) Office is available for assistance with questions related to the ELPAC program policy requirements. For ELPAC policy questions, the LEA ELPAC coordinator should contact the ELPSA Office by phone at 916-319-0784, or by email at [email protected].

mailto:[email protected]://www.elpac.org/mailto:[email protected]

Computer-based ELPAC Field Test Overview | Student Eligibility and Participation in the Computer-based ELPAC Field Test


Student Eligibility and Participation in the Computer-based ELPAC Field Test

Additional Resources in This Manual: • English Language Proficiency Assessments for California (ELPAC) website—

https://www.elpac.org/ • Test Operations Management System (TOMS) website—https://www.elpac.org/

Students in grades kindergarten through high school who have an English Language Acquisition Status of English learner (EL), initial fluent English proficient, or “To Be Determined” are eligible to participate in the computer-based ELPAC field test. Student participation in the computer-based ELPAC field test is voluntary. In addition to taking the optional computer-based ELPAC field test in fall 2019, potential ELs, as identified by Home Language Survey or other means, enrolled in or assigned to grades kindergarten through high school must also take the paper-pencil Initial ELPAC, as required, during the 2019–20 ELPAC administration.

https://www.elpac.org/https://www.elpac.org/


Field Test Administration Features




https://www.elpac.org/ • California Assessment of Student Performance and Progress (CAASPP) and

ELPAC Technical Specifications and Configuration Guide for Online Testing web document—http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdf

• Test Operations Management System (TOMS) website—https://www.elpac.org/ • Preparing for the Computer-based ELPAC Administration Technology

Requirements web document—https://www.elpac.org/resources/ • Secure Browsers website—http://ca.browsers.airast.org/

Form Assignment Multiple test forms will be utilized for the computer-based ELPAC field test. To support the transition from paper-pencil test to computer-based assessment, each participating school will be assigned to one computer-based field test form for a grade or grade span. The form assigned will either be computer-based for all domains or a mix of paper-based and computer-based versions of the Oral or Written Language composites. The results from the paper-pencil and computer-based versions of the Oral and Written Language composites will be used as part of a mode comparability study to better understand how students perform on the paper-pencil test versus the computer-based assessment. Local educational agencies (LEAs) will receive their form assignments in September and must pay close attention to the instructions that call out which Directions for Administration (DFAs) to use at each grade level and which test form to administer at each grade level. Depending on the form assigned, the DFA and the test form might have different grade levels on the covers.

Field Test Forms Mode comparability forms for Oral Language (Listening and Speaking domains)—These forms include the reprint of the 2018–19 Summative ELPAC paper test materials (called Form C1) and computer-based test items (called Form C2) for only the Listening and Speaking domains. Schools assigned these forms will only administer the Listening and Speaking domains on both the paper and computer-based formats.

https://www.elpac.org/http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttps://www.elpac.org/https://www.elpac.org/resources/http://ca.browsers.airast.org/

Computer-based ELPAC Field Test Overview | Field Test Administration Features


Mode comparability forms for Written Language (Reading and Writing domains)—These forms include the reprint of the 2018–19 Summative ELPAC paper test materials (C1) and computer-based test items (called Form C3) for only the Reading and Writing domains. Schools assigned these forms will only administer the Reading and Writing domains on both the paper and computer-based formats. Please note that there will be no Writing domain to administer for kindergarten through grade two. Field test form for Summative ELPAC (called Form 1 [F1] or Form 3 [F3] for grades 11–12)—This form will include computer-based items that align with the 2018–19 Summative ELPAC blueprints and the current Initial ELPAC blueprints. For test development purposes, additional Speaking and Listening items are included in this form for grades three through twelve. The Writing domain will be on paper Answer Books for kindergarten through grade two. Field test form for Initial ELPAC (called Form 2 [F2])—This form includes computer-based items that align with the 2018–19 Summative ELPAC blueprints and the current Initial ELPAC blueprints. For test development purposes, additional Reading and Writing items are included in this form for grades three through twelve. The Writing domain will be on paper Answer Books for kindergarten through grade two.

Field Test Form Administration Participating schools assigned to the mode comparability forms will administer both the paper and computer-based tests for either the Oral or Written language domains. Some schools will be instructed to administer the paper test first, then the computer-based test, while others will be instructed to administer the computer-based test before the paper. Administration details will be included in the form assignment notification sent to LEAs in September. The schools that receive the Writing domain Answer Books for kindergarten through grade two should prioritize the administration of this domain to mail the completed Answer Books back to Educational Testing Service (ETS) in a timely manner.

Test Design and Administration Guidelines The computer-based ELPAC field test is an online, linear (nonadaptive), grade-level assessment for students in grades kindergarten through high school who are English learners. The mode comparability paper-pencil field test form will be administered using paper-based Answer Books and Test Books. The field test is designed for one-on-one administration between a single student and a test examiner for kindergarten through grade two and group administration for grades three through twelve. The exceptions are as follows:

• Speaking domain—One-on-one administration for all grades • Writing domain—Group administration is optional for grade two

For schools assigned the mode comparability paper-pencil field test form and the Written Language computer-based field test form, the kindergarten through grade two Writing domain will not be administered as there is no change in this test format. When the computer-based




ELPAC goes operational in 2020, the kindergarten through grade two Writing domain will continue to be a paper-based assessment. Individual student scores, school-level scores, and score reports will not be available to the LEAs for the computer-based ELPAC field test.

Technical Requirements The computer-based ELPAC is administered online and requires two internet-connected devices: a student testing device and a separate device that the ELPAC test examiner uses to start a test session through the Test Administrator Interface. ELPAC test examiners may also use their device to access the DFAs that are posted in TOMS and to access the Data Entry Interface (DEI) for entering the locally scored Speaking test scores (discussed more in the Scoring the Speaking Domain Locally section of this manual). The computer-based ELPAC requires the installation of secure browsers on student testing devices. These are the same secure browsers that are used for the online CAASPP assessments. Secure browsers are available for download on the Secure Browsers website. The general technical requirements and supported devices are also similar to those for the online CAASPP assessments. These are described in the CAASPP and ELPAC Technical Specifications and Configuration Guide for Online Testing. The computer-based ELPAC contains directions and stimuli that are provided via audio files within the student testing interface, so it is recommended that for one-on-one administrations the audio component be played on the device’s built-in or external speakers and that for group administrations headphones or headsets are used. The Speaking domain utilizes voice capture technology. LEAs are encouraged to administer the Speaking domain using student testing devices with built-in recording or microphone capabilities, or headphones or headsets with microphones, in an area where outside sounds are minimized. The Speaking domain must be locally scored, and scores must be entered into the DEI.

Directions for Administration and Examiner’s Manuals As the ELPAC tests are transitioned to computer-based assessment, the test administration scripts and test day instructions are also being transitioned from Examiner’s Manuals to DFAs. The DFAs for the computer-based ELPAC field test must be used by the ELPAC test examiner to administer tests to students. The DFA includes the script for the ELPAC test examiner to use at the beginning of testing and provides administration guidance for the day of testing. For the computer-based field test, there is a combined DFA for the Listening, Reading, and Writing domains and a separate DFA for the Speaking domain. The last page of the Speaking domain DFA contains a student score sheet which is provided for optional use by the test examiner to record a student’s Speaking scores in the moment. This student score sheet can then be used to enter the student’s Speaking scores into the DEI after the

http://ca.browsers.airast.org/http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdf



student’s test has been submitted (refer to the Scoring the Speaking Domain Locally section of this manual for this process). LEA ELPAC coordinators, site ELPAC coordinators, and ELPAC test examiners can access PDFs of the DFAs in the Resources menu in TOMS. DFAs will not be printed and shipped to the LEAs. For the LEAs or schools that are assigned to administer the mode comparability paper-pencil ELPAC form, printed Examiner’s Manuals will be shipped to the LEA along with the paper test materials (Answer Books and Test Books).

Test Scheduling Testing Window and Test Times The computer-based ELPAC field test window will be open from October 1 through October 25, 2019. LEAs may schedule testing according to local preference within this window and do not need to inform the California Department of Education or ETS. All testing must take place within this window. LEAs that have schools administering a mode comparability paper-pencil version of the ELPAC field test are asked to mail completed Answer Books to ETS at least once a week, upon completion of a paper-pencil administration. Refer to the ELPAC Field Test Return Instructions that was included with the paper test materials for detailed information regarding returning materials after testing. Contact the California Technical Assistance Center (CalTAC) if you need another copy of the return instructions.




Table 1 shows the number of items and the estimated time to complete each field test form for computer-based assessments, shown here as “CBA”; and paper-pencil tests, shown here as “PPT.” Schools should consider these estimated times when scheduling test sessions. The Summative and Initial field test forms should be administered over multiple test sessions or days.

Table 1. Number of Items and Estimated Testing Times for Field Test Forms

Variable

Oral Language

Mode Comparability

Form

Written Language

Mode Comparability

Form

Summative Field Test

Form Initial Field Test Form

Number of Items for K–Grade 2

32–39 CBA items 30–35 PPT items

17–32 CBA items* 22–33 PPT items*

64–86 items 63–88 items

Estimated Time for K–Grade 2

K: 25 minutes (CBA) K: 30 minutes (PPT) 1: 35 minutes (CBA) 1: 35 minutes (PPT) 2: 50 minutes (CBA) 2: 50 minutes (PPT)

K: 30–40 minutes (CBA) K: 35–45 minutes (PPT) 1: 35–45 minutes (CBA) 1: 30–40 minutes (PPT) 2: 45–55 minutes (CBA) 2: 40–50 minutes (PPT)

K: 75–85 minutes 1: 85–95 minutes 2: 110–120 minutes

K: 75–85 minutes 1: 85–95 minutes 2: 105–115 minutes

Number of Items for Grades 3–12

45–46 CBA items 32–35 PPT items

43–48 CBA items 32 PPT items

90–95 items 88–94 items

Estimated Time for Grades 3–12

3–12 CBA: 65–70 minutes 3–12 PPT: 50–55 minutes

3-12 CBA: 110–140 minutes 3-12 PPT: 90–120 minutes

3–12: 175–210 minutes

3–12: 175–210 minutes

*Reading only



Key Dates Table 2 lists key dates for the computer-based ELPAC field test administration:

Table 2. List of Key Dates Date Activity

September 3, 2019 Computer-based ELPAC Training Test is available September 30, 2019 Computer-based ELPAC Training Videos available for on-demand

viewing in Moodle September 3, 2019 Computer-based ELPAC field test student assignment available October 1, 2019 Computer-based ELPAC field test testing window opens October 24, 2019 Last day for computer-based ELPAC field test student assignment October 25, 2019 Computer-based ELPAC field test testing window closes (last day

testing may occur)

https://www.elpac.org/https://moodle.elpac.org/

Computer-based ELPAC Field Test Overview | Test Administration Roles and Responsibilities


Test Administration Roles and Responsibilities


https://www.elpac.org/ • Test Operations Management System (TOMS) website—https://www.elpac.org/ • Computer-based ELPAC Training Videos—https://moodle.elpac.org/

A successful administration of the computer-based ELPAC field test requires identifying the appropriate staff to fulfill specific roles and to work together. The three main roles involved with the administration of the field test are the following:

1. Local educational agency (LEA) ELPAC coordinator 2. Site ELPAC coordinator 3. ELPAC test examiner

For the 2019–20 field test, LEA ELPAC coordinators and site ELPAC coordinators that are new or returning users with access to TOMS will be required to electronically sign the ELPAC Test Security Agreement upon logging on to TOMS. In addition, any LEA ELPAC coordinators, site ELPAC coordinators, and ELPAC test examiners that have access to secure test materials, such as Directions for Administration (DFAs), Examiner’s Manuals, Test Books, or Answer Books, will be required to electronically sign the ELPAC Test Security Affidavit in TOMS. The subsections that follow outline the various responsibilities of each role.

LEA ELPAC Coordinator Responsibilities The LEA ELPAC coordinators were designated by the LEA superintendent or charter school administrator for the upcoming 2019–20 administration. In addition to electronically signing the test security forms, the LEA ELPAC coordinators must meet the requirements and fulfill the duties outlined as follows:

• Add site ELPAC coordinators and ELPAC test examiners into TOMS

• Coordinate with the site ELPAC coordinator to create walk-in field test registrations for students in TOMS, if necessary

• Verify and assign designated supports and accommodations to students in TOMS

• View the Computer-based ELPAC Training Videos and ensuring that site ELPAC coordinators in their LEA also have viewed this video

https://www.elpac.org/https://www.elpac.org/https://moodle.elpac.org/https://moodle.elpac.org/



• Ensure adequate test materials and pre-identification (Pre-ID) labels are on hand and redistributed throughout the LEA during the testing window as needed (for the mode comparability study)

• Ensure all test materials are returned to the LEA ELPAC coordinator, ensuring Answer Books are shipped to ETS for scoring, and ensuring that secure, nonscannable test materials are returned to ETS or locally destroyed (refer to the ELPAC Field Test Return Instructions that was included with the paper test materials for detailed information regarding returning and destroying materials after testing)

• Report all test security irregularities and breaches (including social media discussion or posting photos of test materials) that occur before, during, or after test administration to the California Department of Education within 24 hours of discovery, using the online Security and Test Administration Incident Reporting System (STAIRS) process available in TOMS (California Code of Regulations, Title 5 [5 CCR], Section 859[e])

• Assume general oversight responsibilities for all administration activities in their LEA schools and ensuring that students have a positive test experience

LEA ELPAC Coordinator Checklist LEA ELPAC Coordinator Activities Target Completion Date

Coordinate the scheduling of testing for all eligible students with the site ELPAC coordinators at each school, taking factors into consideration that include the following: • The number of available testing devices and testing

stations • The time required to take a domain • The number of students being tested

As soon as possible

Learn about the computer-based ELPAC field test: • Watch the Computer-based ELPAC Training Videos. • Review this manual.

As soon as possible after materials are available

Confirm that students are assigned for testing in TOMS. As soon as possible after TOMS is available on September 3, 2019

Coordinate the distribution of paper test materials and Pre-ID labels to schools (for mode comparability study).

As soon as possible after materials are received

https://moodle.elpac.org/



LEA ELPAC Coordinator Checklist (continuation)

LEA ELPAC Coordinator Activities Target Completion Date Ensure that site ELPAC coordinators have installed

supported web browsers and secure browsers on student testing devices.

2 weeks before testing

Communicate with the site ELPAC coordinators and ELPAC test examiners to identify the number of headsets needed to take the listening portions of the assessment.

2 weeks before testing

Ensure that site ELPAC coordinators have familiarized themselves and their ELPAC test examiners with the five components they need for computer-based ELPAC testing: 1. Secure browser (through which students will

access the testing interface) 2. Test Administrator Interface 3. Data Entry Interface (DEI) 4. DFA posted in TOMS and Examiner’s Manuals for

paper-pencil test administration 5. Computer-based ELPAC Training Videos

3–5 days before testing

Assume general oversight responsibilities for all paper and computer-based ELPAC field test administration activities in LEA schools.

October 1–October 25, 2019

Coordinate the return of paper test materials to ETS (for mode comparability study)

At least once a week, upon completion of a paper-pencil test administration

Site ELPAC Coordinator Responsibilities The site ELPAC coordinator is designated by the LEA ELPAC coordinator. All site ELPAC coordinators must electronically sign the ELPAC Test Security Agreement and the ELPAC Test Security Affidavit located within TOMS. The site ELPAC coordinator must meet the requirements and fulfill the duties outlined as follows:

• Identify ELPAC test examiners and ensuring that they view the Computer-based ELPAC Training Videos

• Add ELPAC test examiners into TOMS and ensure that they have received and tried using their logon credentials, and that they have reviewed and electronically signed the ELPAC Test Security Affidavit in TOMS (5 CCR Section 850[w])

https://moodle.elpac.org/https://moodle.elpac.org/https://moodle.elpac.org/



• Verify that student demographic information from the California Longitudinal Pupil Achievement Data System is appearing correctly in TOMS

• Create or approve testing schedules and procedures for the school (consistent with state and LEA policies)

• Work with technology staff to ensure that devices are configured for testing and any technical issues are resolved

• Receive and store paper test materials in a secure location until needed for testing (for the mode comparability study)

• Coordinate the return of Answer Books for scoring and the return of secure, nonscannable test materials for destruction with the LEA ELPAC coordinator

• Address testing problems, as needed

• Mitigate and report all test security incidents in a manner consistent with state and LEA policies

• Assume general oversight responsibilities for all administration activities in their schools

• Assume general oversight responsibilities for all ELPAC test examiners

Note: LEA ELPAC coordinators, who also serve in the role of the site ELPAC coordinators, should be familiar with tasks and responsibilities of the site ELPAC coordinator.

Site ELPAC Coordinator Checklist Site ELPAC Coordinator Activities Target Completion Date

Inform staff at the test site about the computer-based ELPAC field test.

As soon as possible

Coordinate the scheduling of testing for all eligible students with the LEA ELPAC coordinator, taking into consideration factors that include the following: • The number of available testing devices and testing

stations • The time required to take the assessment • The number of students being tested

As soon as possible



Site ELPAC Coordinator Checklist (continuation one)

Site ELPAC Coordinator Activities Target Completion Date Learn about the computer-based ELPAC field test:

• Watch the Computer-based ELPAC Training Videos.

• Review this manual.


Identify ELPAC test examiners at each school: • Prepare ELPAC test examiners. • Provide ELPAC test examiners with TOMS user

accounts. • Direct ELPAC test examiners to this manual and

training resources, including the Computer-based ELPAC Training Videos.


Identify student testing devices and ensure the installation of the secure browser. Identify an equal number of devices that ELPAC test examiners are to use to start test sessions using the Test Administrator Interface.

Two weeks before testing

Communicate with the ELPAC test examiners to identify the number of headsets needed to take the listening portions of the assessment.


Receive paper test materials and Pre-ID labels from the LEA and ensure they are stored securely until needed for testing.

As soon as possible after receiving materials

Ensure that the site ELPAC coordinator and ELPAC test examiners have been familiarized with the five components needed for the computer-based ELPAC field test: 1. Secure browser 2. Test Administrator Interface 3. DEI 4. DFA posted in TOMS and Examiner’s Manuals

for paper-pencil test administration 5. Computer-based ELPAC Training Videos

Three to five days before testing

https://moodle.elpac.org/https://moodle.elpac.org/https://moodle.elpac.org/https://moodle.elpac.org/https://moodle.elpac.org/



Site ELPAC Coordinator Checklist (continuation two)

Site ELPAC Coordinator Activities Target Completion Date Assume general oversight responsibilities for all paper

and computer-based ELPAC field test administration activities at the school.

October 1–October 25, 2019

Return paper test materials to the LEA after testing is complete.

As soon as possible after testing is complete

ELPAC Test Examiner Responsibilities An ELPAC test examiner is an employee of an LEA or an employee of a nonpublic, nonsectarian school, who has been trained to administer the computer-based ELPAC field test. The ELPAC test examiner responsibilities include the following:

• Electronically signing the ELPAC Test Security Affidavit (5 CCR Section 850[w]) in TOMS

• View the Computer-based ELPAC Training Videos

• Administer the paper or computer-based ELPAC field test in accordance to the guidelines outlined in this manual

ELPAC Test Examiner Checklist ELPAC Test Examiner Activities Target Completion Date

Work with the site ELPAC coordinator or LEA ELPAC coordinator to obtain a username and password for TOMS, which will enable access to the Test Administrator Interface.

One to two weeks before testing

Read and electronically sign the ELPAC Test Security Affidavit in TOMS.

As soon as possible

Learn about the computer-based ELPAC field test: • Watch the Computer-based ELPAC Training Videos. • Review this manual.


https://moodle.elpac.org/https://moodle.elpac.org/



ELPAC Test Examiner Checklist (continuation)

ELPAC Test Examiner Activities Target Completion Date Become familiar with the computer-based ELPAC field

test testing systems and tools: • Secure browser • Test Administrator Interface (to administer test

sessions) • DEI • DFA posted in TOMS and Examiner’s Manuals for

paper-pencil test administration • The Computer-based ELPAC Training Videos


Verify that students have access to headsets needed to take the listening portions of the computer-based assessment.


Confirm the students being tested are correctly assigned in TOMS.

One to five days before testing

Confirm possession of the correct paper test materials and that they are ready to administer for the mode comparability study. Or Ensure devices are turned on and the testing system is working for computer-based testing.

Day of testing, before seating student for testing

For computer-based testing, start a test session in the Test Administrator Interface and ensure that students are logged on using the secure browser on the testing device.

Day of testing, with student present

For both paper and computer-based testing, begin the test administration with students. Follow the directions and scripts in the Examiner’s Manual for the paper-pencil test and read the DFA posted in TOMS for the computer-based test.

Day of testing, with student present

https://moodle.elpac.org/



This page is left blank intentionally.

Chapter 2. Computer-based Test Administration Preparation and Planning

Computer-based Test Administration Preparation and Planning |

Preparing for the Computer-based ELPAC Field Test Administration




https://www.elpac.org/ • California Assessment of Student Performance and Progress (CAASPP)

Bandwidth Checker web page—linked on http://www.caaspp.org/about/bandwidth-checker.html

• California Department of Education (CDE) California Longitudinal Pupil Achievement Data System (CALPADS) web page—http://www.cde.ca.gov/ds/sp/cl/

• Secure Browsers website—http://ca.browsers.airast.org/ • CAASPP and ELPAC Technical Specifications and Configuration Guide for Online

Testing web document—http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdf.

• Preparing for the Computer-based ELPAC Administration Technology Requirements web document—https://www.elpac.org/resources/

• Test Operations Management System (TOMS) website—https://www.elpac.org/

This section provides an overview of the various tasks and actions local educational agencies (LEAs) should complete to prepare for administering the computer-based ELPAC field test.

Using the Test Operations Management System (TOMS) to Prepare for the Field Test TOMS is a secure website that permits authorized users from LEAs to perform a number of tasks for the ELPAC. For the computer-based ELPAC field test, TOMS will assign test forms to schools, determine the quantity of paper forms per grade or grade span to be shipped to LEAs for the mode comparability study, create a pre-identification label file for mode comparability schools, and create registrations for eligible students. Student demographic data from CALPADS is uploaded into TOMS on a nightly basis, so it is important to keep it up-to-date.

Usernames and Passwords Usernames and passwords are created in TOMS after an LEA ELPAC coordinator or site ELPAC coordinator has submitted users for access. For the computer-based ELPAC field test, ELPAC test examiners can use this username and password to log on to the Test

https://www.elpac.org/http://www.caaspp.org/about/bandwidth-checker.htmlhttp://www.caaspp.org/about/bandwidth-checker.htmlhttp://www.cde.ca.gov/ds/sp/cl/http://www.cde.ca.gov/ds/sp/cl/http://ca.browsers.airast.org/http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttps://www.elpac.org/resources/https://www.elpac.org/

Computer-based Test Administration Preparation and Planning | Preparing for the Computer-based ELPAC Field Test Administration


Administrator Interface, which is necessary to generate a test session ID and approve students for testing. For more information about the different user roles in TOMS, refer to the contextual help and page instructions in TOMS.

Student Test Assignment in TOMS Based on field test recruitment, TOMS will identify the LEAs and schools that have agreed to participate in the field test. Specific test forms will be assigned to these LEAs and registrations will be created in TOMS for the eligible students. The LEA ELPAC coordinators and site ELPAC coordinators must use TOMS to confirm that all eligible students have been assigned to take the ELPAC field test. Please note that LEAs cannot edit registrations for students that have been assigned to the field test. LEA ELPAC coordinators and site ELPAC coordinators for schools assigned to the computer-based field test forms (F1, F2, and F3) can use TOMS to create walk-in field test registrations for students that were not originally identified as eligible at that LEA. For walk-in registrations, the ELPAC field test assignment can be configured on a student-by-student basis within the TOMS user interface. Figure 1 shows the student [Test Assignments] tab in TOMS through which the assignment can be made. Information about making student test assignments in TOMS can be found in the contextual help and page instructions in TOMS.



Figure 1. Assigning students to the ELPAC field test in TOMS

Student Test Settings in TOMS Select non-embedded accommodations and select embedded and non-embedded designated supports are available for students taking the computer-based ELPAC field test. The accessibility resources listed in Table 3 must be assigned in the [Test Settings] tab of the Student Profile page in TOMS. For more information about available accessibility resources, refer to the Accessibility Resources section of this manual. Information about setting up student test settings in TOMS can be found in the contextual help and page instructions in TOMS.




Table 3. Accessibility Resources That Must Be Assigned in TOMS Non-embedded

Accommodation Embedded

Designated Support Non-embedded

Designated Supports • Alternate Response

Options • Scribe • Speech-to-Text

• Color Contrast • Masking • Mouse Pointer • Pause or Replay Audio—

Listening domain • Pause or Replay Audio—

Speaking domain • Permissive Mode • Print Size • Streamline • Turn off Any Universal

Tool(s)

• Amplification • Color Contrast • Color Overlay • Designated Interface

Assistant • Magnification • Medical Supports • Noise Buffers • Print-on-Demand • Read Aloud for Items

(Writing domain) • Separate setting

Configuring student test settings in TOMS ensures that students receive the assigned embedded accessibility resources for the online assessments. Non-embedded resources also must be recorded in TOMS and provided to the student locally. Any changes to student test settings in TOMS must be completed before the student can test. The update, once made, may take up to 24 business hours to appear in the Test Administrator Interface. Failure to correct test settings before testing could result in the student not being provided with the needed accommodations, designated supports, or both at the time of testing. This is considered a testing irregularity. There are two methods that LEA ELPAC coordinators and site ELPAC coordinators can use to set non-embedded accommodations and embedded and non-embedded designated supports for students in TOMS:

1. Spreadsheet upload: Use this method when multiple students in the LEA or at the test site are having test settings assigned.

2. One-by-one: Use this method when a few students in the LEA or at the test site are having test settings assigned.

The ELPAC training tests are fully accessible, which means that all the embedded and non-embedded universal tools, designated supports, and accommodations resources that will be available for the operational computer-based ELPAC assessments are available for the training tests. Student test settings that have been applied in TOMS for the 2019–20 Summative ELPAC will be available in the ELPAC training test environment for students. Refer to the Accessing the ELPAC Training Tests section of this manual for more information on the training tests.



Technology Requirements Prior to the computer-based ELPAC field test administration, LEA ELPAC coordinators and site ELPAC coordinators must review the technology infrastructure at their schools to ensure it meets the minimum requirements for administering the computer-based ELPAC field test. The CAASPP and ELPAC Technical Specifications and Configuration Guide for Online Testing provides the technical specifications for online testing. This includes information about internet and network infrastructure requirements, hardware and software requirements, and secure browser installation.

Bandwidth Checker The bandwidth checker, linked on the Bandwidth Checker web page on the CAASPP Portal, can assist technology coordinators to assess network readiness by performing a real-time check of a school’s network bandwidth. Note that technology coordinators may want to run this test more than once, and at different times of the day, because estimates change as the network conditions change, varying from run to run. The CDE also hosts a Smarter Balanced Technology Readiness Resources web page, which includes links to tools, requirements, and topics that LEAs will find useful in planning for the 2019–20 online ELPAC testing.

Secure Browsers All students must use a secure browser to access the computer-based ELPAC field test. All testing devices must have the correct secure browser installed prior to assessment. School technology coordinators are responsible for ensuring that each device to be used for testing at the school is properly secured by installing the most current secure browser. Secure browsers are available for download on the Secure Browsers website. Information about installing and configuring the secure browsers is available in the CAASPP and ELPAC Technical Specifications and Configuration Guide for Online Testing. The secure browser is designed to support test security by prohibiting access to external applications or navigation away from the assessment.

http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/about/bandwidth-checker.htmlhttp://www.caaspp.org/http://www.cde.ca.gov/ta/tg/sa/sbac-itr-index.asphttp://ca.browsers.airast.org/http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdf


Accessibility Resources



Additional Resources in This Manual: • California Assessment of Student Performance and Progress (CAASPP) and

English Language Proficiency Assessments for California (ELPAC) Accessibility Guide for Online Testing web document—https://www.elpac.org/

• Test Operations Management System (TOMS) website—https://www.elpac.org/ • Matrix Four web document—https://www.cde.ca.gov/ta/tg/ep/

Overview Accessibility resources are access features or supports of the assessment that are either provided as digitally delivered components of the secure browser (embedded supports) or separate from the secure browser (non-embedded supports). Accessibility resources allow students to participate in an assessment that can generate results that are a fair and accurate estimate of each student’s achievement. Universal tools, select designated supports, and select accommodations will be available for the ELPAC field test. Students may use the embedded universal tools within the test delivery system, but also have the option to use non-embedded universal tools. The accommodations and designated supports for the computer-based ELPAC field test must be assigned in TOMS. The ELPAC training tests are fully accessible and all embedded and non-embedded universal tools, designated supports, and accommodations will be available to students. For the paper-pencil field test administrations (as part of the mode comparability study), non-embedded universal tools, designated supports, and accommodations will be available. Designated supports and accommodations for students taking the paper-pencil field test do not need to be assigned in TOMS. Please note that braille and large-print test materials will not be available for the field test. Instead, these accommodated versions of the computer-based ELPAC will be part of a separate study. In addition, embedded accommodations are not available for the computer-based ELPAC field test.

https://www.elpac.org/https://www.elpac.org/https://www.cde.ca.gov/ta/tg/ep/

Computer-based Test Administration Preparation and Planning | Accessibility Resources


Table 4 provides the non-embedded universal tools, designated supports, and accommodations that will be available to use with the paper-pencil field test form.

Table 4. Available Accessibility Resources for the Paper-Pencil ELPAC Field Test Non-embedded Universal

Tools Non-embedded

Designated Supports Non-embedded

Accommodations • Breaks • Highlighter • Line Reader (grades

3–12) • Mark for Review (grades

2–12) • Oral Clarification of Test

Directions by the Test Examiner in English

• Scratch paper • Strikethrough (grades

3–12)

• Amplification • American Sign Language

or Manually Coded English

• Color Overlay • Magnification • Masking • Medical Supports • Noise Buffers • Pause or Replay Audio—

Listening domain • Pause or Replay audio—

Speaking domain • Read Aloud for items

(Writing domain) • Separate setting

• Alternate response options

• American Sign Language or Manually Coded English

• Breaks • Scribe • Word Processor (Writing

domain) (grades 3–12)

Availability of Universal Tools Universal tools are available to all students by default, although they can be disabled if a student finds them distracting. Each universal tool falls into one of two categories: embedded and non-embedded. Embedded universal tools are provided through the student testing interface (via the secure browser), although they can be turned off by a test examiner, if necessary. Please note that students assigned to take the paper-pencil field test form will not have access to embedded universal tools. Non-embedded universal tools are provided at the test site-level and must be coordinated and delivered by a site ELPAC coordinator or ELPAC test examiner. Table 5 lists the available universal tools for the computer-based ELPAC field test.

Table 5. Universal Tools Available for the Computer-Based ELPAC Field Test Universal Tool Embedded Non-embedded

Breaks Yes Yes Digital notepad Yes No Expandable Items Yes No




Table 5 (continuation)

Universal Tool Embedded Non-embedded Expandable Passages Yes No Highlighter Yes No Keyboard Navigation Yes No Line Reader (grades 3–12) Yes No Mark for Review (grades 2–12) Yes No Oral Clarification of Test Directions by the Test Examiner in English

No Yes

Scratch Paper No Yes Strikethrough (grades 3–12) Yes No Test Navigation Assistant No Yes Writing Tools (grades 3–12) Yes No Zoom (in or out) Yes No

Availability of Designated Supports Designated supports are available to all students and must be set by a test examiner in the test settings in TOMS. The designated supports each fall into one of two categories: embedded and non-embedded. Embedded designated supports are provided through the student testing interface (via the secure browser). Students assigned to take the paper-pencil ELPAC field test will not have access to embedded designated supports. Non-embedded designated supports are provided at the test site-level and must be coordinated and delivered by a site ELPAC coordinator or ELPAC test examiner. Table 6 lists the available designated supports for the computer-based ELPAC field test.

Table 6. Designated Supports Available for the Computer-based ELPAC Field Test Designated Supports Embedded Non-embedded

Amplification No Yes

Color Contrast Yes Yes

Color Overlay No Yes

Designated Interface Assistant No Yes

Magnification No Yes

Masking Yes No

Computer-based Test Administration Preparation and Planning | Accessibility Resources


Table 6 (continuation)

Designated Supports Embedded Non-embedded Medical Supports No Yes

Mouse Pointer (size and color) Yes No

Noise Buffers No Yes

Pause or Replay Audio—Listening domain Yes No

Pause or Replay Audio—Speaking domain Yes No

Permissive Mode Yes No

Print Size Yes No

Print-on-Demand No Yes

Read Aloud for items (Writing domain) No Yes

Separate Setting No Yes

Streamline Yes No

Turn off any Universal Tool(s) Yes No

Requesting Approval for and Using Print-on-Demand Materials For those students assigned to the computer-based ELPAC field test who have the need for a paper copy of passages or items, permission for the students to receive this designated support must be requested by the local educational agency (LEA) ELPAC coordinator at least two days prior to testing by contacting the California Technical Assistance Center (CalTAC). The LEA ELPAC coordinator must also assign this resource for the student in TOMS. The print-on-demand non-embedded designated support is provided at the test site-level and must be coordinated and delivered by an ELPAC test examiner. Note the following about print-on-demand:

• Print requests must be approved and processed by the test examiners during test administration.

• The decision to allow students to use print-on-demand must be made on an individual student basis.

• Because items are printed individually, utilizing the print-on-demand functionality does not allow a printed version of the online test to be created prior to testing.

• A very small percentage of students should need this designated support. • The use of this designated support may result in the student needing additional time to

complete the assessment.




Once a student is approved to receive the printing of test items or passages, that student may send a print request to the test examiner during testing by selecting the print icon on the screen. This request needs to be made for each individual item. Follow these guidelines when using the print-on-demand designated support:

1. Before the test examiner approves the student’s request to print a test item or stimulus, the test examiner must ensure that the printer is on and is monitored by staff who have been trained using the test examiner training modules for the test.

2. Immediately after printing a print-on-demand request, the file should be securely deleted from the test examiner’s device in such a way that the file does not remain in a temporary storage file where it can be undeleted.

The test examiner must collect the previously printed item from the student after the next item’s print request. Printed items must be securely stored and then securely destroyed after the test session. Refer to the How to Approve Print Requests section for more information on print-on-demand.

Availability of Accommodations Accommodations are changes in procedures or materials that increase equitable access during the ELPAC assessments. Accommodations are available to students who have a documented need for the accommodations via an individualized education program or Section 504 plan. It is important to keep student data in the California Longitudinal Pupil Achievement Data System current—including participation in a special education or Section 504 plan program—to ensure that students remain eligible to test with the appropriate test settings. What follows are the available non-embedded accommodations for the computer-based ELPAC field test; embedded accommodations are not available for the computer-based ELPAC field test:

• Alternate Response Options • Scribe • Speech-to-Text

Computer-based Test Administration Preparation and Planning | Training Resources


Training Resources

Additional Resources in This Manual: • Test Operations Management System (TOMS) website—https://www.elpac.org/ • Matrix Four web document—https://www.cde.ca.gov/ta/tg/ep/ • CAASPP and ELPAC Technical Specifications and Configuration Guide for Online

Testing web document—http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdf

• Preparing for the Computer-based ELPAC Administration Technology Requirements web document—https://www.elpac.org/resources/

This section provides an overview of the tasks and actions local educational agencies (LEAs) should complete to prepare for a successful ELPAC field test administration. All LEA ELPAC coordinators, site ELPAC coordinators, and test examiners are responsible for ensuring all appropriate trainings have been completed. Such training should include, but not be limited to, training on item security and professional conduct associated with the administration of standardized assessments.

Using the Computer-based ELPAC Training Videos The Computer-based ELPAC Training Videos will be available on the Moodle training site. These training videos help LEA ELPAC coordinators, site ELPAC coordinators, and ELPAC test examiners become familiar with the necessary requirements for administering a successful computer-based ELPAC field test administration. The training videos, which will be available starting September 30, can be accessed through a standard internet browser by visiting the Moodle training site.

Accessing the ELPAC Training Tests Online training tests are available for the ELPAC assessments and can be accessed from the ELPAC website. Training tests are for test examiners and students to become familiar with the format and functionality of the online test. This resource is available by grade/grade span (kindergarten, one, two, three through five, six through eight, nine through ten, and eleven through twelve). Directions for Administration are available on the ELPAC website. The training tests can be used as a “guest” without logon credentials and using a supported web browser; note that Internet Explorer is not a supported web browser. If users want to access the training tests as a test examiner—required if they want to administer a training test that uses the text-to-speech resource—a logon will be required.

https://www.elpac.org/https://www.cde.ca.gov/ta/tg/ep/http://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttp://www.caaspp.org/rsc/pdfs/CAASPP-ELPAC.tech-specs-and-config-guide.2019-20.pdfhttps://www.elpac.org/resources/https://moodle.elpac.org/https://moodle.elpac.org/https://www.elpac.org/https://www.elpac.org/resources/practicetests/


Training Resources


The training tests do not require use of the secure browser, but some accessibility resources, such as text-to-speech, are only available through the secure browser. Braille (i.e., refreshable or embossed), where available, can be accessed using a web browser. The training tests have the same embedded designated supports and accommodations that will be available for the operational Summative ELPAC in spring 2020.

Computer-based Test Administration Preparation and Planning | Training Resources


This page is left blank intentionally.

Chapter 3. Test Security

Test Security |

Test Security for the Computer-based ELPAC Field Test


Test Security for the Computer-based ELPAC Field Test The English Language Proficiency Assessments for California (ELPAC) is a secure test. All local educational agency (LEA) ELPAC coordinators and site ELPAC coordinators are required to read and electronically sign the ELPAC Test Security Agreement and ELPAC Test Security Affidavit prior to accessing test materials. All ELPAC test examiners are required to read and electronically sign the ELPAC Test Security Affidavit prior to testing and handling test materials.

Security of the Test Environment A secure online testing environment is a state in which a device is restricted from accessing prohibited computer applications (local or internet-based) or copying or otherwise sharing test data. The purposes of this environment are to maintain test security and provide a stable testing experience for students across multiple platforms. The security of assessment instruments and the confidentiality of student information are vital to maintaining the validity, reliability, and fairness of the results. All test items and test materials are secure and must be appropriately handled. Secure handling protects the integrity, validity, and confidentiality of assessment items, prompts, and student information. Any deviation in test administration must be reported as a test security incident to ensure the validity of the assessment results. It is the responsibility of each person participating in the administration of any of the ELPAC field test assessments to immediately report any violation or suspected violation of test security or confidentiality. The site ELPAC coordinator is responsible for immediately reporting any security violation to the LEA ELPAC coordinator.

Test Security |



Table 7 through Table 10 describe security requirements for the test environment during various stages of testing. The test environment refers to all aspects of the testing situation while students are testing and includes what a student can see, hear, or access (including access via technology).

Before Testing Table 7. Requirements of the Test Environment Before Testing

Requirement Description Instructional materials removed or covered Instructional materials must be removed or

covered, including but not limited to information that might assist students in answering questions that is displayed on bulletin boards, chalkboards or dry-erase boards, or on charts (e.g., wall charts that contain literary definitions, maps, mathematics formulas, etc.).

Student seating For group administrations, students must be seated so there is enough space between them to minimize opportunities to look at each other’s work—for example, students may be assigned staggered seating or be seated in every other chair or workstation position—or they should be provided with table-top partitions.

Signage If helpful, place a “TESTING—DO NOT DISTURB” sign on the door or post signs in halls and entrances rerouting hallway traffic to promote optimum testing conditions. Site ELPAC coordinators or ELPAC test examiners should post the “Unauthorized Electronic Devices May Not Be Used at Any Time During the Testing Session” signs so that they are clearly visible to all students. A master of this sign can be downloaded from the Manuals and Instructions web page on the California Assessment of Student Performance and Progress Portal.

http://www.caaspp.org/administration/instructions/

Test Security | Test Security for the Computer-based ELPAC Field Test


During Testing Table 8. Requirements of the Test Environment During Testing

Requirement Description Quiet environment Provide a quiet environment void of talking or

other distractions that might interfere with a student’s ability to concentrate or might compromise the testing situation.

Student supervision Students must be actively supervised by a trained test examiner and are prohibited from access to unauthorized electronic devices that allow availability to outside information, communication among students or with other individuals outside the testing environment, or photographing or copying test content. This includes any device with cellular, messaging, or wireless capabilities, but is not limited to cell phones, smart watches, personal digital assistants, tablets, iPods, cameras, and electronic translation devices.

Access to allowable resources only Students must only have access to and use of allowable resources that are permitted for each specific test (or portion of a test). This includes access to medical supports, which may be integrated into other technology devices. Use of such devices may require additional monitoring to maintain test security.

Access to assessments Unauthorized staff or other adults must not be in the room during testing. Only students who are testing can view items.

Testing through secure browser Administration of the computer-based ELPAC field test is permitted only through the student interface via a secure browser or a method of securing the student device.

Test Security |



During and After Testing Table 9. Requirements of the Test Environment During and After Testing

Requirement Description No copies of test materials Unless needed as a print-on-demand

designated support, no copies of the test items, stimuli, reading passages, or writing prompts may be made or otherwise retained.

No access to digital, electronic, or manual devices

No digital, electronic, or manual device may be used to record or retain test items, reading passages, or writing prompts. Similarly, these materials must not be discussed with or released to anyone via any media, including fax, email, text message, social media websites, etc.

No retaining, discussing, or releasing test materials

Descriptions of test items, stimuli, printed reading passages, or writing prompts must not be retained, discussed, or released to anyone.

No reviewing, discussing, or analyzing test materials

LEA ELPAC coordinators, site ELPAC coordinators, ELPAC test examiners, and other staff may not review, discuss, or analyze test items, stimuli, reading passages, or writing prompts at any time, including before, during, or after testing. Students may not discuss or share test items, stimuli, reading passages, or writing prompts with anyone during or after testing.

Keeping all test materials secure at all times Printed materials for the mode comparability study, print-on-demand designated support, scratch paper, the Directions for Administration, and documents with student information must be kept in a securely locked room or locked cabinet that can be opened only with a key or keycard by staff responsible for test administration.

No retaining of test “tickets” or any materials created to assist students with logging on to the assessments

All students’ ID information must be collected at the end of each test session, stored securely, and then destroyed securely.

Test Security | Test Security for the Computer-based ELPAC Field Test


After Testing Table 10. Requirements of the Test Environment After Testing

Requirement Description No test materials used for instruction Test items, stimuli, reading passages, or

writing prompts must not be used for instruction.

Destroy test materials securely Printed test items or passages, scratch paper, notecards or paper that include student logon information, must be collected and inventoried and then immediately shredded upon a student’s completion of the test. Printed Directions for Administration must be shredded at the end of the field test window. Printed materials for the mode comparability study should be handled per the instructions in the Administering the Paper-Pencil English Language Proficiency Assessments for California Field Test section of this manual.

Test Security Incidents Test security incidents, such as irregularities and breaches, are behaviors prohibited either because they give a student an unfair advantage or because they compromise the secure administration of the assessments. Whether intentional or by accident, failure to comply with security and administration rules, either by staff or students, constitutes a test security incident. Irregularities and breaches need to be reported in accordance with the instructions in this section for each severity level. Beginning with the ELPAC field test, LEA ELPAC coordinators or site ELPAC coordinators will use the online ELPAC Security and Test Administration Incident Reporting System (STAIRS) form in the Test Operations Management System (TOMS) for reporting test security incidents and irregularities that occur during testing on computer and paper-based tests. Some incidents may require that an appeal be submitted to reset, reopen, or restore (if a test had been reset in error) a computer-based test. After the details of the incident have been entered, an email will be sent describing what action should be taken, either to have the L

Documents

2019–20 Computer‑based ELPAC Field Test Administration ......Summative ELPAC in February 2020 and the paper-pencil Initial ELPAC in July 2020. In addition to this field test, ETS