Presented by Cindy Hurley Instrument to Measure Standards 1 1

Presented by

Cindy Hurley

Instrument to Measure StandardsInstrument to Measure Standards

11

AIMS HS

• Writing– One extended writing prompt– Multiple choice

• Reading – Multiple choice

• Mathematics– Multiple choice

22

AIMS HS

• Writing, Reading, Mathematics

• Administered in the Fall– All 11th and 12th graders who have not yet

met the standard– 11th and 12th graders who have met the

standard, but not yet exceeded, may retake to improve score

33

Fall 2011 AIMS HS Test

44

Test Coordinator Responsibilities

• Read the Test Coordinator’s Manual and the Test Administration Directions

• Make sure all test administrators have signed a security agreement and attended a pretest workshop training.

• Additional responsibilities can be found on pages 2 and 3 of the Test Coordinator Manual (TCM)

TCM Page 2

55

Test Coordinator Responsibilities

• Test Coordinators are responsible for:

– Assigning Test Administrators and Proctors for each testing room

– Confirming all Test Administrators and Proctors are:• Employees of school.• Trained in Fall 2011 AIMS HS test

administration and test security proceduresTCM page 7

66

Test Dates and Times

• Writing – Tuesday, October 25– One testing session of 3 hours

• Reading – Wednesday, October 26– One testing session of 2 hours

• Mathematics – Thursday, October 27– Two testing sessions of 90 minutes

TAD page 3

TCM page 4

7

• Only students in cohort 2013, 2012, or below are permitted to test

• Cohort 2013 are generally 11th graders

• Cohort 2012 or below are generally 12th graders

• When a student’s cohort and grade are not aligned, the student’s cohort is used to determine eligibility to participate in AIMS HS

Cohorts to Test

88

Students to Test

• Cohort 2013, 2012, or below

– Students who have not met the standards in writing, reading, or mathematics portions of AIMS HS are expected to test for the specific content area.

TAD page 2

99

Students to Test

• Cohort 2013, 2012, or below

– Students who want to move from the “Meets the Standard” to the “Exceeds the Standard” have the option of retesting

– Only students in cohort 2013 can opt to retest for the in-state scholarship…the value drops to 25% of in-state tuition for cohort 2013 graduates

TAD page 2

1010

Students to Test

• Some non-enrolled students may participate in AIMS testing at your school/district:– Private schooled students– Home schooled students– “Completer” students

• Schools must set up procedures for these students to pre-register

11

Preparing Testing Rooms

• Test Coordinators and Test Administrators are responsible for:

– Determining suitability of each testing room– Verifying rooms are a comfortable and

distraction-free environment– Verifying that all visual aids displayed in the

testing room that could assist students have been removed or completely covered

TAD page 7

TCM page 7

1212



– Verifying seating arrangements that make it difficult for students to look at the answers of others

– Verifying that seating arrangements allow test administrators to walk by each student

TAD page 7

TCM page 7

1313



– Verifying that backpacks and unnecessary materials, including cell phones, are stored appropriately before testing

– Testing protocol is followed at all times

TAD page 7

TCM page 7

1414

Test Coordinator Site Training

• Training for Test Administrators and Proctors must include a thorough review of:– Test security procedures– Test administration procedures– Correct use of testing accommodations– Procedures for use of Pre-ID labels– Procedures for bubbling of student

demographic data and use of standard accommodations

– Handling unexpected or unusual situationsTCM page 8

1515

Test Coordinator Site Training

• District Test Coordinators are responsible for seeing that all Test Administrators have:– A copy of the Test Administration Directions

prior to testing– A list of students testing in their room– Sign-in and sign-out sheet for students testing

in their room– All necessary supplies necessary for testing

TCM page 8

1616

Test Security

1717

Test Security Agreement

• Signing the Test Security Agreement acknowledges that:

– Necessary precautions must be taken to safeguard test materials

– Access to test materials is restricted

– All test materials shall be kept under lock and key except during actual test times.

1818


• Signing the Test Security Agreement acknowledges that school staff will:– Participate in training activities prior to

administering the test.– Follow Test Preparation and Administration

Practices.– Review Test Administration Directions prior to

testing.– Follow all instructions in the Test

Administration Directions including reading the directions to students exactly as scripted.

TAD page 6

TSA

1919


• Anyone handling the AIMS tests in any way must sign the security agreement

• Security Agreements are kept on file at the school site for 6 years

• The Principal copy is the only one that is returned to Cindy during check-in of materials

2020

Test Materials Security

• Keep test materials in secure, locked storage except during actual test administration times

• Follow proper procedures for ensuring the security of test materials before, during, and after the test administration

TAD page 4

2121

Testing Accommodations

October

25

AIMS H

S

Writ

ing

Signin

/Sig

n

out Shee

t

Studen

t

Signin

Signout

Name

October

25

AIMS H

S

Writ

ing

Signin

/Sig

n

out Shee

t

Studen

t

Signin

Signout

Name

2222

Accommodations

• All Test Administrators must read and be familiar with:

Testing Accommodations:

Guidelines for 2011-2012

2323

Universal Test Administration Conditions

• Universal test administration conditions that are in a student’s IEP are not considered testing accommodations so do not need to be marked

• May be offered to any student in order to provide a comfortable and distraction-free testing environment

TAG page 4

2424

Standard Accommodations

• Accommodations may not provide verbal or other clues or suggestions that hint at or give away the correct response to the student

• Not all accommodations appropriate for instruction are appropriate for use during state testing

TAG page 5

2525


• It is the responsibility of the Test Administrator to see that: – Students who qualify for testing

accommodations receive them. – Students who do not receive accommodations

are not affected.

TAG page 5

2626


• Standard accommodations are available to:

– Students with certain injuries

– English Language Learners

– FEP Year 1 and Year 2 students

– Students with an IEP or 504 plan

TAG pages

6-72727

Recording Accommodations

• Test administrators must record the use of standard accommodations in section K of the AIMS demographic data grid on the student answer document

• Detailed directions for marking the use of standard accommodations is on pages 36-37 of the Test Administration Directions.

TAD pages

36-37

28

Recording Accommodations

• Accommodations are listed in the Accommodations Guidelines with a number that will correspond to the bubble in the answer document

TAD pages

36-37

TAG

# Standard Accommodation – ELL/FEP Content Areas

4 More breaks and/or several shorter sessions W, R, M, S

5 Simplify language in English for the scripted directions or the directions that students read on their own as needed upon student request

W, R, M, S

6 Read aloud in English the writing prompt, mathematics test items,+ or science test items,+ as needed upon student request

W, M, S

7 Provide a word-for-word published, paper translation dictionary W, R, M, S

8 Exact oral translation of the scripted directions or the directions that students read on their own as needed upon student request

W, R, M, S

2929

Receiving Materials

3030

Delivery Window

• Anticipated Delivery Windows:– October 3 – 6 to Testing Warehouse– October 11 – 12 to school sites– Email will be sent notifying you when

boxes are on their way

TCM page 9

3131

Delivery of Test Materials

• White Boxes – Test Coordinator Kit– Test Coordinator’s Manual and Pre-ID labels

(header sheets and bands have been removed for use in warehouse)

• Brown Boxes – Test books, answer documents, and Test

Administration Directions

• Save all boxes for use in returning materials to Pearson.

3232

Inventory Test Materials

• Open up Box 1(white box) immediately

– Based on packing list, check that you will have have enough materials to cover testing needs

– If it appears you will be short any test materials, notify Cindy by email no later than

Oct. 14, 4 PM

33

• After submitting any shortages to Cindy, inventory all the brown boxes as soon as you able to

• Note any discrepancies on your packing list (inventory sheet)

• Save all packing lists and bring with you on return of materials

Inventory Test Materials

34

Student Demographic Data

3535

For schools that number test books and/or answer documents:

– Use only these boxes for numbers.

3636

Student Bar Code (Pre-ID) Labels

• Student Information in SAIS by September 9th will receive student Pre-Id Labels

• Labels are content specific. Students receive one label per content area

• Be sure only a trained person applies the student ID label

3737

Student Bar Code (Pre-ID) Labels

• The content area on the pre-id label must match the content area on the answer document.

TAD page 9

3838

SignatureTeacherSchoolDistrict

If you have a

bar code label, use it.

Student must write

name on line labeled

“Student Name.”

TAD page 8-9

3939

Student Demographic Data Grid

• For students without a student bar code (Pre-ID) label, the grid on the back must be completed by school personnel. See Test Administration Directions pp. 34-35.

• NEVER should there be a label on the front and student demographic bubbled in on the back (except accommodations for the K box).

TAD pages

9, 33-36

4040

For Incorrect Labeling

• DO NOT attempt to remove the label

• NEVER EVER black out the label

INSTEAD:• Cover the incorrect pre-ID label with a blank

white label. Then hand bubble the correct student information on the back of the answer document

4141

If a Label is Blacked Out

Warning:

When test materials are returned to warehouse, be prepared to fill out the demographic grid for any labels that are discovered to be blacked out

4242

TAD page 36

Enrollment Bubble (G)

Complete only if the student is not enrolled at the school where the test is administered.

This bubble is

rarely marked.

This bubble is

rarely marked.

4343

Day of Testing

4444

Student Sign - In

• Students must sign-in to each testing session

• Keep all sign-in sheets until the end of the school year

• These sign-ins are often referred to when score reports are returned and score issues arise

4545

Test Materials

• AIMS HS includes three test books and three answer documents:Writing, Reading, Mathematics

• All answer documents are machine-scorable and only answers marked with a No. 2 pencil will be scored

TAD page 4

TCM page 13

4646

Test Materials

• Test materials needed for each testing room include:– Supply of sharpened, standard, wooden

graphite-based No. 2 pencils with erasers– Pencil sharpener or additional supply of

pencils– A “Testing – Do Not Disturb” sign– Commercially published dictionaries and

thesauri for use on the writing test only

TAD page 5

TCM page 5

4747

Resources

Unacceptable Resources• Electronic devices, including, but not limited to,

computers, calculators, cell phones, and portable music players, are prohibited during AIMS testing

• Mathematics manipulatives, charts, and aids, including, but not limited to: a ruler, a number line, a compass, and an abacus

• Extra paper or scratch paper

TAD page 11

4848

Resources

AIMS HS Mathematics Test

• The AIMS HS Mathematics Reference Sheets may remain posted in the testing room

TAD page 11

4949

Monitoring

• AIMS is a standardized test

• Test Administrators must follow the directions exactly as stated in the Test Administration Directions

• Test Administrators must read the script exactly as presented in the Test Administration Directions

TAD page 8

SAY

5050

Monitoring

During testing, test administrators should:

• Supervise and constantly monitor test rooms at all times

• Answer student questions that pertain only to the clarification of test administration directions

TAD page 9

5151

Monitoring

• Test administrator can help students understand directions but cannot:– Explain concepts– Explain test questions– Explain answer choices– Give any other help that could influence

the student's response

TAD page 9

5252

Student Conduct

• Students who engage in behavior not consistent with acceptable classroom behavior should be subject to established school disciplinary procedures after completion of testing.

• Disrupt testing• Refuse to participate• Cheat• Use an electronic device

TAD page 11

5353

Student Conduct

• For a disruptive student or a student suspected of cheating, the Test Administrator must:– Remove any inappropriate resources (cell phones,

calculators, etc.) - or stop the disruption– Allow students to continue testing (in a different location if

appropriate)– Document as many details as possible concerning the

incident– Notify the District Test Coordinator of the incident as soon as

possible

TAD page 11

5454

Leaving the Test Room

• Students may be allowed to leave the testing room during testing to go the restroom, if necessary.

• Only one student may leave at a time.• The student’s test book and answer document

must be collected before the student leaves the room and then given back to the student upon returning to the room.

• During stretch break (writing/reading) students may not leave testing room.

TAD page 12

5555

Student Conduct

• Students who leave school during testing before completing a particular content area are ineligible to continue the test for that content area.

• The Test Administrator should inform the student that he/she will not be permitted to finish that content area.

• Student must sign-out and indicate that testing was not completed.

TAD page 12

5656

Student Conduct

• The Arizona Department of Education recommends that a student’s parent(s) or guardian(s) receive written notification of the incident that resulted in the student leaving testing early. This should include any disruptive or inappropriate behavior, and the student’s consequences.

TAD page 11

5757

Testing Incidents

• Testing incidents that need to be brought to Cindy for review would include, but are not limited to:– Possible cheating.– Inappropriate accommodations,– Administration errors.

• When requested to do so: complete and email a “Testing Incident Report Form” to Cindy

5858

This Incident Report will be emailed to you if neededThis Incident Report will be emailed to you if needed

5959

As Students Finish Testing

• Students are to close their test book

• Place answer document face down on top of test book

• Raise their hand.

• Test Administrator will collect the test materials

TAD –

scripted

directions6060


• Test Administrators must:– Have students sign-out indicating that they

have turned in their test book and answer document

– Verify that students have put their name and other information on the front of the test book

– Verify that students have put their name and other information on the front of the answer document

6161


• Students are to remain quiet until the end of the testing session

• Students may read or do class work silently while waiting for the scheduled test session to end

• Electronic devices may not be used during this time

6262

End of Testing Session

• When students have finished or the allotted time for the session has ended:– Follow procedures for students who need

additional time to finish– Collect all remaining test materials from the

students– Account for all test books and answer

documents prior to dismissing students

TAD –

scripted

directions6363


• Inspect test materials using the checklist on page 36 of the TAD

TAD pages

366464

Transferring Responses

• Student responses must be transferred to a standard answer document if:

– Braille or a large print version of test was given

– Certain accommodations were given where the student did not use a regular answer document

– The student used assistive technology

6565

Special Circumstances

Contaminated Materials• Do not return test materials contaminated with

blood, vomit, or other bodily fluids

• Transfer student responses to a clean answer document

• Destroy contaminated test materials securely at school

TAD page 10

TCM page 13

6666


• All test materials must be returned to test coordinator at the end of the testing session.

• No test materials may be left in a testing room overnight.

TAD –

scripted

directions6767

Returning Test Materials

6868

Organizing Answer Documents

• Arrange all used answer documents (scorables) face up:- Separate by content area with a colored

sheet of paper

- Within each content area, sort by cohort

2013, 2012, or below and write on the sheet the

number of answer documents in each stack

• Have a separate stack of Unused answer documents

6969

Organizing Nonscorables

• Organize nonscorable (every thing that is not an answer document) materials by document type

– Used and unused test books– Used and unused large print and Braille test

materials– AIMS HS Test Administration Directions– AIMS HS Test Coordinator’s Manuals– Unused Pre-ID labels– Return all Pearson test boxes

7070

Email or call to schedule a

time to return all materials

On

Oct. 28Oct. 31

7171

Packaging and Retrieval Errors

• If test materials are not packaged correctly or are late, then the district may

– be charged for late scoring and/or an additional pick-up.

– receive only student reports in January.

TCM page 27

7272

Reports

7373

Score Reports

Online Reports due to DistrictDecember 8

Paper reports due to DistrictDecember 15

7474

Common Errors Spring 2011

• Inappropriate materials included with scorables

• Pre-Id Label is different from gridded information

• Labels were blacked out resulting in no score or wrong student receiving score

7575

Need Help?

• Test security• Accommodations• General test questions• Administering tests

Cindy Hurley

225-5418

76

The End!

77