English Language Proficiency Assessment (ELPA) Online Bureau of Assessment and Accountability

SUCCESS BY YOUR STANDARDS™

English Language Proficiency Assessment (ELPA)

OnlineBureau of Assessment and Accountability

Informational Presentation

Spring 2013

Overview

• ELPA Online• Key Online Activities and Timeline• Advantages and Benefits to Online Testing• Online Testing Administration System• Student Online Test Delivery System • Hardware & Software Requirements• Time Commitments• Next Steps

Spring 2013 ELPA 2

ELPA Online

• ELPA Online testing – English Learners (EL/LEP)

• Listening, Reading, Writing and Speaking• Levels III, IV, V only

– Level III – Grades 3-5– Level IV – Grades 6-8– Level V – Grades 9-12

– Assessment window: (paper/pencil/online)

March 4 – April 12, 2013

– Districts choosing not to participate in Online will be expected to assess EL/LEP students on ELPA paper-pencil

Spring 2013 ELPA 3

Key Online Activities and Timeline

• Fall/Winter – October 2012 – ELPA Online Informational Webinars offered– October 19, 2012 – Deadline to complete Sign-up Survey– January 11, 2013 – Participating schools/students finalized

(closing of pre-ID window)– January/February 2013 – Training Webinars

• Spring – March 4 - April 12, 2013 – Spring ELPA Testing Window

Spring 2013 ELPA 4

Advantages and Benefits of Online Testing

Spring 2013 ELPA 5

Advantages & Benefits

• Positive Student Feedback -Over 90% of students found the online testing system easy to use. -Overwhelming number of students who used online tools, buttons and actions found them easy to use.

• Increased Student Engagement“Students were more engaged.”

“…students enjoy taking the test on the computer much more than paper and pencil.”

• 78% of English Learners (ELs) favored testing online vs. traditional paper-pencil

Spring 2013 ELPA 6

Survey comments

Spring 2013 ELPA

• Administrators rated the level of student computer skills as 85% Experienced or Very Experienced.

• Administrators expressed some concerns regarding student typing skills for constructed response items.

-tests are not timed -no limitations for student responses -student feedback positive

• Administrators reported that students liked the online test and were more comfortable using technology.

7

Student Preference

Computer vs. Paper-Pencil

Answer OptionsResponse Percent

Response Count

On the computer 78.8% 2915Paper and pencil 4.5% 167Either way 16.7% 619

2011

2012

Computer vs. Paper-Pencil

Answer OptionsResponse Percent

Response Count

On the computer 78.1% 691Paper and pencil 4.4% 39Either way 17.5% 155

Spring 2013 ELPA 8

Advantages & Benefits

• Decreased Administrative Burden-No more time-consuming packaging and shipping of all assessment materials.

-No need to instruct students on how to properly complete their answer document.

-No need to check a student’s testing materials for stray pencil marks or incomplete bubbles.

-Minimal time commitment required of District & School IT Coordinators

Spring 2013 ELPA 9

Advantages & Benefits

• District Feedback

Spring 2013 ELPA 10

System Overview

Spring 2013 ELPA 11

Online Testing System Overview

• Two main online components of the iTester System to be used for the ELPA Online:

– Student Test Delivery System (iTester Student)

– Administration System (iTester Admin)

• Roles & Responsibilities

Spring 2013 ELPA 12

District Roles

• DTC – District Test Coordinator• STC – School Test Coordinator• DITC – District IT Coordinator• SITC – School IT Coordinator

Miscellaneous responsibilities include pre and post assessment activities such as software/hardware set-up, scheduling of testing sessions in computer labs, monitoring student assessment, updating demographic information, and end of testing secure materials return.

Spring 2013 ELPA 13

Student Online Test Delivery System (iTester Student)

• STCs will print test tickets prior to the test administration window.

• Students will sign in using the same User Name and Password to access all four test sections and practice test.

• Students must take a Practice Test before taking the actual tests.

Spring 2013 ELPA 14

Student Online Test Delivery System (iTester Student) (cont.)

• Single form for each Level III, IV, and V.

• Same number of items as in the paper/pencil test.

• Online Item types match paper/ pencil items: – Multiple-choice– Constructed response

• Like the paper/pencil tests, all tests (except the Listening Test) have a Teacher Script to guide students through the testing.

• A TAM for the online assessments will be provided.

Spring 2013 ELPA 15

Student Online Test Delivery System (iTester Student) (cont.)

•The Listening Test and Speaking Story Retell sections will require headphones and sound cards for all students. (Listening CD is replaced with online digital audio.)

•Headphones will be required for the ELPA Online Test Administration.

•Microphones will NOT be required for the ELPA Online Test Administration.

Spring 2013 ELPA 16

Student Online Test Delivery System (iTester Student) (cont.)

• The Speaking Test will require 2 computers for each individual administration.

• Students will be presented with the Speaking prompts online.

• Teachers will have an online score-entry interface that replaces the scoring that is recorded on the answer documents in a paper/pencil administration.

Student

Teacher

Spring 2013 ELPA 17

Online Administration System (iTester Admin)

• The Administration System is used to manage users, students, and scheduling testing times.

• Each user (e.g. DTC, STC, Admin, etc.) will have custom features based on their roles and responsibilities.

Spring 2013 ELPA 18

Online Administration System (iTester Admin)

• The Administration System provides an easy

to use interface for setting up teachers and testing groups,

and updating student demographic information.

• District, School, and Student information will be

imported from the Pre-ID files for selected schools.

Spring 2013 ELPA 19

Minimum Workstation and Network Requirements

Hardware Requirements Windows Apple / Macintosh

Operating System Windows 2000 or higher OS 10.4.X or higher

Java Version Java Version 1.5 Java Version 1.5

Processor Pentium III 500 MHz or higher

G4 500 MHz or higher

Memory 512 MB or higher 512 MB or higher

Devices Mouse / Pointing Device / Keyboard

Mouse / Pointing Device / Keyboard

Audio Headphones / Speakers Headphones / Speakers

Screen Resolution 1024 x 768 1024 x 768

Internet Connection 1.5 mbps or higher 1.5 mbps or higher

Spring 2013 ELPA 20

Time Commitments

Spring 2013 ELPA

Task Estimated DurationDownload & Install Test Accelerator 1 hourOption 1: Download and install iTester Client on a network shared workstation

½ hour

Option 2: Download and install iTester Client on each individual workstation

½ hour per machine

Setup each workstation to point to application, assign permissions and access rights for workstations

½ hour

Perform Workstation Readiness 10 minutes per machine (15 workstations = 2 ½ hours)

Site Certification 3 minutes, 18 seconds Total (with option 1) Approximately 4 ½ hours

21

District Feedback

Spring 2013 ELPA

• [Allow for live District representative to comment here about their positive experiences in the technical support side.]

22

Frequently Asked Questions and Next Steps

Spring 2013 ELPA 23

Frequently Asked Questions

• Can laptop computers be used? • Can a wireless computer lab be used? • What happens if a problem occurs while testing?• How are student responses transmitted?

• ELPA Customer Support & Technical assistance is available during

pre-assessment set-up and throughout the assessment window

Spring 2013 ELPA 24

Next Steps

• Review– ELPA Online Sign-up Survey– ELPA Frequently Asked Questions (FAQ’s)– Located at: www.michigan.gov/ELPA

• Deadline to complete Sign-up Survey – October 19, 2012• http://www.surveymonkey.com/s/ELPASpring2013SignupSurvey

• Stay tuned for notifications for:– Next steps – Training sessions (January/February 2013)

Spring 2013 ELPA 25

Questions?

Jennifer Paul – ELL Assessment Consultantpaulj@michigan.gov

517-335-3967

Jason Kolb – ELPA Analystkolbj1@michigan.gov

Bureau of Assessment and Accountability (BAA)Michigan Department of Education (MDE)

www.michigan.gov/ELPA

Questar Assessment, Inc. Customer Support ELPACustomerSupport@QuestarAI.com

877-560-8378, Option 5

Spring 2013 ELPA 26

Information

ELPA Online Sign-up Survey & Frequently Asked Questions (FAQ’s)

http://www.michigan.gov/ELPA

Questar Assessment, Inc. Customer Support email ELPACustomerSupport@QuestarAI.com

ELPA Spring 2013 Sign-up Survey

http://www.surveymonkey.com/s/ELPASpring2013SignupSurvey

Spring 2013 ELPA 27

Questions & Answers

Thank you for joining us!

Spring 2013 ELPA 28