1 Middle School BAC Training 2013 FALL TESTING. JCPS TESTING UNIT Jacque Queenan – Assessment Support Technician Tammy Durham – Clerk II Ryan Goepper

1

Middle School BAC Training

2013 FALL TESTING

JCPS TESTING UNIT

• Jacque Queenan – Assessment Support Technician

• Tammy Durham – Clerk II

• Ryan Goepper – Data Management/Research Technician

• Jessica Lyons – Data Management/Research Technician

• Donna Heun– Data Management/Research Technician

• Erica Thompson – District Assessment Coordinator 2

Testing Unit location 3001 Crittenden Drive, Building 7(Entrance just beyond Gate 3 - Kentucky Exposition Center

3

4

5

Topics for Today

• Assessment Updates• ACT EXPLORE• Alternate K-PREP/Alternate Assessment

Administration Code• Advance Program Testing• Administration Code Training• Inclusion of Special Populations Training

6

Assessment Updates

7

9

REQUIRED TESTING FOR SPECIAL POPULATIONS

• Alternate Assessment (1%)• ACCESS for English Language Learners

• W-APT• ESL teachers in 39 schools will train for and administer the required WIDA W-

APT this year. This is an effort to test those students who may have been missed by not enrolling through the ESL Intake Center.

• ESL teachers must keep test materials under “single-lock” when not in use.• Marti Kinny’s office is coordinating this effort.

• ACCESS for ELLS• IMPORTANT NOTE: There will be no extra “outside” assistance this year with the

administration of ACCESS for ELLs.

• Alternate ACCESS FOR ELLS

OTHER TESTING (High Schools/Special Schools should be administering ANY appropriate test(s) in order to assist a student in becoming college/career ready)• COMPASS, KYOTE• ASVAB, WorkKeys• KOSSA, Industry Certifications

10

Key Assessment Themes

• DATA QUALITY—collaborative process between OAA and school/district staff to ensure accurate reporting of test results

• TEST SECURITY—checks and processes to monitor appropriate administration of state-required tests

11

12

Timeline for ReportingAll dates are

tentative.

Data Quality

Accurate student level information• Infinite Campus and • Student Data Review and Rosters (SDRR) Application

• Test Rosters• Data Review

• Before public reporting—September 23-27 release to schools

• After public reporting—10 days after public release

13

Test Security• Seating Charts will be required for all state-required test

administrations.

• Seating charts are required for optional tests that will be included in accountability if the test is administered by the school.

• Testing Unit will collect and maintain in case of potential investigations.

• Customized seating charts are on our Testing Unit website.

14

Administration Code and Inclusion Regulations Training

Fall Testing 2013 15

Test Security

• Ensuring training of appropriate school/district staff in testing regulations:

• Administration Code• Inclusion Regulation

• 2009 versions are the most current.• FYI – Regulations being opened for revision this

year BUT we will operate under the 2009 version ALL year.

• Use the Allegation Reporting form again this year to report possible violations of either regulation.

16

16

Administration Code and Test Security

• Appropriate training required for anyone administering ACT EXPLORE/ACT PLAN or EOC or optional tests

• Signatures on Administration Code• Documentation of training-group signature form

provided by Testing Unit.

18

Inclusion Regulation

• 2009 Inclusion of Special Populations Regulation (ACT EXPLORE/ACT PLAN, EOC)

• Anyone assisting with testing accommodations must be trained annually

• Documentation of training-group signature form provided by Testing Unit.

19

Alternate Assessment Administration Code and Test Security

• Appropriate training required for anyone administering Alternate K-PREP (Attainment Tasks/Transition Attainment Record)

20

SCHOOL REPORT CARDKentucky’s System for Data ReportingAnticipated release is the week of September 23rd

21

21 22

Opening PageWelcome and Links to Additional Information

23

• Annual Measurable Objective goal • (1.0 improvement in Overall Score for below

Proficient; .5 improvement for Proficient and above)

• New labels available with two years of data• Progressing and High Progress

• SRC provides more detail • Trend and disaggregated data

SRC New for Year 2

24

PearsonAccessReports

25

Test Results• Published reports are pre-generated reports and data

extracts. • To view a published report :• Go to Test Results > View Published Reports to see a list of

available reports. • Select “District” or “School” from the View By options set. • Click the organization name to see a list of reports for that

organization. • Click the Report Name to view.

26

27

26

28

K-PREP Student Report-Grade 4

29

Performance Levels:

N, A, P & Dfor each subject

area

District will receive 2

print copies-

1 school copy

1 parent copy

K-PREP Student Report-Grade 4

30

29

Lexile® and Quantile®

scoresNational Percentile

Ranking

Student Growth

Percentile-New on report

this year (grades 4 – 8 only)

K-PREP Student Listing Report-Grade 6

31

Alternate K-PREP

students receive a

total score

K-PREP School Summary Report

32

Status of Reporting Category-

New this year

Alternate K-PREP Report-Grade 8

33

Attainment Tasks

Results

Alternate K-PREP Report-Grade 8

34

Transition Attainment

Record (TAR)Explore (8), Plan (10) and ACT (11)

CIITSContinuous Instructional Improvement Technology System

35

CIITS & Assessments

• Supports classroom formative assessments and district/school benchmark assessments.

• Contains professional development opportunities.• Additional items (~2,000) are under review.• Purchased items are correlated(not congruent) to standards.• Any item may be edited or changed by a teacher.• Formative Item Pool (FIP) from QualityCore End-of-Course is

available for the four EOC courses.• A teacher/school/district may choose to share their items and

tests.• Over 150,000 assessments have been created.

36

37

CIITS Assessment Reports• Report Bank contains new pre-formatted reports.• Additional reports will be added as more data becomes

available, such as K-PREP Longitudinal Reporting and College/Career Ready.

• Feedback and suggestions are welcome.

38

CIITS CONTAINS VALUBLE ENROLLMENT DATA

39

Useful during student

accountability work

ACT EXPLORESeptember 16, 2013

-September 27, 2013

39

Be sure to read your ACT EXPLORE Supervisor’s Manual carefully!

This is an “off the shelf” manual that is not customized for the state of Kentucky. Certain points in this presentation will override information in the manual. 40

IGNORE• All directions concerning payment of ACT

EXPLORE fees.

• All instructions about ordering research and reporting services

• All references to a Local School Norms Request Form

• All directions about calling ACT

• All directions about mailing things to ACT 41

Test materials from previous years MUST NOT be used.

SHRED them – they cannot be scored.

ACT EXPLORE uses a new test form each year.

42

EXPLORE MaterialsTest materials and Pre-ID labels arrive in separate shipments directly to Testing Unit.

Original Materials Arrive At Schools Via Regular Pony Run – •SIGNATURE REQUIRED when delivered to schools via JCPS pony. •Alert your front office staff! •Materials MUST be kept secure once they reach your school.

Ordered in August

43

September 9th

Supplemental Orders

•No overage sent to Testing Unit • Inventory your materials right away• Email Erica Thompson if you have extra test

books/answer folders• School headers and answer folders with pre-printed

labels MAY NOT be shared between schools

•Overnight shipping no longer available• 3-5 day delivery to districts

New this Year…

44

ACT EXPLORE MATERIALS• Explore Supervisor’s Manual and Packet• Why Take Explore?• Instructions for Completing your Answer Folder• Explore test books• Answer folders - one per student testing• Any accommodated materials ordered• Explore Scoring Envelope• Explore School Header• Explore Posters• Student Pre-ID labelsThe polymailer envelope will be kept at the Testing Unit.

45

Supplemental Orders• Print a list of your 8th graders from IC immediately after

you receive your test material shipment . • How many test materials do you need?• Inventory using the Materials Packing list.

• Discrepancies? Call the JCPS Testing Unit immediately.

• Compare your inventory with the number of sets of materials needed for your school.• Do you have enough test materials?

If you need to order additional materials, call us immediately.

The JCPS Testing Unit has NO overage of ACT EXPLORE testing materials.

46

• After inventory your test materials, reseal the carton(s) and lock them in a secure place.

• Protect the materials from damage, from possible theft or loss and from any conditions that could allow prior knowledge of the tests.

TEST MATERIALSSecurity of Materials

47

• If more than one testing room is to be used - • Count out the appropriate quantities of materials before testing• Record the number of test booklets assigned to each room

• Give the test booklets to the room supervisors personally.

• Write student names on their individual test booklets (name labels that you create can be used also). • Test booklets must be returned to students after their individual

student reports arrive.

TEST MATERIALSDistribution, Security & Organization

48

• Never leave test booklets in an unattended room.

• Do not transfer test materials to any other school• Consult the JCPS Testing Unit if you have LOTS of

extra test materials.

• Current test booklets should be securely stored after test administration and must returned to students with their score reports.

TEST MATERIALSDistribution, Security & Organization

49

Nonparticipation• Nonparticipation could include reasons such as:

• First year LEP • Foreign exchange student • Medical exemption• Extraordinary Circumstances exemption• Alternate Assessment ?

• Document on SDRR• Do not return answer sheets for students that are not

participating. (This includes Alternate Assessment Students.)

50

Medical Exemptions

Extraordinary Circumstances Exemptions

Nonparticipation

51

Students with a

Medical Exemption

52

53

Extraordinary Circumstances

Exemptions

54

Medical Emergencies

55

Students with a

Medical Emergency

56

Contact the JCPS Testing Unit immediately for approval of Medical Emergency accommodations.

Student Data Reporting and Review (SDRR)

• ACT EXPLORE rosters completed on SDRR• https://oaa-adc.education.ky.gov/ • Nonparticipation marked on SDRR• Accommodations marked on SDRR• Rosters MUST be completed by midnight on

Friday, September 27, 2013

57

57

ACT EXPLORE Reminders

• Do NOT return used test booklets. Hold and return to students with their Student Reports

• Keep all accommodation kit materials to return with student reports including CDs, large print and Braille.

• Destroy any unused materials58

“Off Grade Level” TestingEXPLORE Sample Tests

• EXPLORE Sample Tests can be given at “off grades” (6th, 7th)• JCPS purchased ACT EXPLORE sample tests two years

ago for this purpose.• 8th grade ACT EXPLORE tests cannot be reused for this

purpose.• Any additional use of the ACT PLAN is considered

a violation of copyright law.• Off-grade administration cannot be done prior to the

grade 8 administration.• “Off grade level” administration DURING OR AFTER the

grade 8 test window is acceptable.• 8th graders MAY NOT participate in any sort of ACT

EXPLORE practice or sample test prior to or during the fall testing window.

59

Copyright Issues

• Recent questions about the reuse of materials or items prompted a review and discussion of ACT, Inc. copyrights

• Do not use items/tests as “bell ringers,” sponge activities or as part of ongoing instruction.

• Tests are not to be reused in any way.• Destroy any remaining materials. Test

items should not be used or reproduced in any way to avoid violating copyright laws.

60

ACT EXPLORE REPORTS

ACT will ship school reports to district offices approximately 10 business days after receipt of answer documents.

61

Supervisor = BAC62

63

ACT ExploreSupervisor’s Manual Highlights

64

Important Note: Supervisor’s Manual

Page 5

4B – If a student does not have a Pre-ID Label, a responsible adult must grid the identifying information, NOT the student.

65

Important Note: Supervisor’s ManualUse OPTION #3 for Verbal Instructions for students

Page 25 - After reading this box

- Skip to Page 30 and start with Option 3 with the block below

66

TEST SCHEDULING(1 Day or 2 Day Administration)

Test during the first week of the testing window if possible.

67

TEST SCHEDULING(1 Day)

Administer in this order:

1. Student Information Section and any other Noncognitive components

2. Four academic tests (English, Mathematics, Reading and Science) are administered in the order in which they appear in the test booklet.

68

TEST SCHEDULING(2 Days)

Day One1.Student Information Section and other Noncognitive components are administered.Day Two1.Four academic tests (English, Mathematics, Reading and Science) are administered in the order in which they appear in the test booklet.

69


• Academic tests must NOT be administered prior to the Student Information Section and other Non-cognitive components for any student.

• The four academic tests (English, Mathematics, Reading and Science) MUST all be administered on the same day.

70


71

• OLD MATERIALS (any materials prior to 2013)

• Should be shredded• Cannot be scored

• ACT EXPLORE uses a new test form each year (Form 05B for 2013)

TEST MATERIALS

72

SPECIAL MATERIALS AVAILABLE

BrailleLarge Print test book

Audio CDReader’s Scripts

TEST MATERIALS

73

EXPLORE ANSWER FOLDERS

BEFORE ADMINISTRATION BEGINS

• Adhere Student Pre-ID Labels or (if no label is received for a given student) complete all appropriate boxes (shown later)

• Use SSID (NOT JCPS ID)

• ACT EXPLORE answer folders MUST be returned in the same order as the names appear on the SDRR roster

74

Students With Labels

• Adhere the Pre-ID Label to the appropriate place on the ACT EXPLORE answer folder.

• DO NOT print or bubble anything else on the front page of the ACT EXPLORE answer folder.

• EXPLORE form 05B – Do not have to bubble 75

Answer Documents

Orientation of Pre-ID Labels

Adhere the label so that the instructions on the answer folder and the student’s name

can both be read “right side up.” 76

TOP OF LABEL

BOTTOM OF LABEL

PRE-ID LABEL WITH INCORRECT INFORMATION

• If there is a mistake on a student label:

• Do not use the label

• Prepare answer document for student by bubbling in boxes A, B, D & E and G - H with student/school information.

77

Students Without Labels

• Prepare answer document for student by bubbling in boxes A, B, D & E and G - H with student/school information.

• Add student to the ACT EXPLORE roster in SDRR.

78

79

Answer Documents

Answer Documents

80

Reporting Accommodations on answer folder (OPTIONAL)

Special accommodations are at the discretion of school personnel for

students with a current IEP or 504 Plan.

ACCOMMODATIONS MUST be documented on SDRR.

81

Answer Documents

82

ACT EXPLORE Test Book Cover

83

Student will be asked to read and copy a certification statement indicating they understand:•the testing rules•that testing items are confidential and may not be shared in any manner• that they are the student whose name appears on the test booklet

Selecting andTraining Testing Staff - p. 3

•A room supervisor is needed in each testing room to read directions and monitor students. If test rooms are likely to have more than 25 students, additional personnel should be assigned to assist the room supervisor.

•Be sure that all personnel who will assist with testing are familiar with the contents of the Room Supervisor’s Manual. 84


•To protect both the examinees and the supervisor from questions of possible conflict of interest, the room supervisor must:

•NOT be a relative or guardian of an examinee in their assigned room

•NOT be a private consultant or individual tutor whose fees are paid by the examinee or examinee’s family 85


Train testing staff

Prior to testing, testing staff must read and be familiar with the Test Administration Manual and the script. 86


Remember -

•Anyone assisting with test administration MUST be trained in the Administration Code. People providing accommodations must also be trained in Inclusions of Special Populations.

87

Preparing Students for the Test Day

A few days prior to the test day, distribute copies of “Why Take EXPLORE?” and instruct students to bring the following:

• Two #2 pencils with erasers• Calculator with the four basic functions plus square root

function (schools may provide)• A watch to pace themselves (optional)

88

Your school is responsible for providing the following in each testing room – p. 6

a supply of # 2 pencils (no ink or mechanical pencils)

pencil sharpener two reliable timepieces (watch, stopwatch or

interval timer) scratch paper supply of calculators for use during the mathematics

test chalkboard or bulletin board for posting Start and

Stop times for each test 89

STUDENT ILLNESSPage 21 –Mark in Supervisor’s Manual

If a student becomes ill and asks to leave the room after starting the timed academic tests – •Collect the student’s answer folder and test booklet•Mark the time that the student leaves the room on his/her test booklet

If the student returns and continues testing, the time lost may NOT be made up. Record the lost time on the Testing Irregularity Report.

If the student DOES NOT return until the next day, the student may complete the section(s) of the test missed during a makeup session. Only allow the amount of time the student missed.

90

Makeup Testing – p. 13Makeup testing must be done for studentswho are absent on the test date or for students who become ill during the test.

Use a separate seating chart for makeup testing.

Makeup testing should be completed as soon as possible and MUST be completed:

(a) By the end of the testing window(b) In accordance with the standard test administration procedures described in the Test Supervisor’s Manual. 91

ACT EXPLORE Procedures Checklist

• Supervisor’s Manual p. 62

92

Post-Test Activitiesto Be Completedby the BAC

93

Voided Tests Codes – p. 21

If you believe you have reason to appropriately void any of the content sections on ACT EXPLORE (i.e. student caught cheating), contact the JCPS Testing Unit immediately.

94

Answer Documents

PAGE 21 – SUPERVISOR’S MANUAL

CONTACT THE ERICA THOMPSON BEFORE VOIDING ANY SECTION OF THE TEST.

THIS IS VERY RARE!

VOIDING TEST SECTIONS

95

Eligibility for Special Testing Accommodations

Students with IEPs, 504 Plans or PSPs

96

Testing with Accommodations

Accommodations• Same as those allowed on K-PREP

last spring

Accommodated test forms • All test forms are the same 97

Testing with AccommodationsNot in your packet – Mark in Supervisor’s Manual

Reader’s Script May be used ONLY to read test questions in a SEPARATE ROOM for the ONE STUDENT to whom it is assigned.

Page 15 –Supervisor’s Manual

98


Use of this script for group testing is NOT allowed.

If the script is read (or signed) to more than one student in the same room, scores for all these students will be cancelled automatically.

99


For students who use a large-print response worksheet, item responses must be carefully transferred by a responsible adult to a standard ACT EXPLORE answer folder for scoring.

ACT will not score a large-print worksheet or transfer responses to a standard answer folder.

100

EXPLORE ROSTERS

• Complete rosters in Student Data Review and Reporting (SDRR).

• Roster window will be open

Sept. 9th – Sept. 27th

https://oaa-adc.education.ky.gov

101

EXPLORE Rosters

•Complete in SDRR:•Name•Date of Birth•Testing Location•Exemptions•Accommodations??

ACT EXPLORE Rosters

Your ACT EXPLORE Roster on SDRR must include every student listed in Infinite Campus as being enrolled in your school as an 8th Grader on the 1st day of the Fall Testing Window.

New this year – Demographics will be pre-populated in SDRR. Changes to demographics MUST be made in Infinite Campus. A nightly pull from IC will be done to update SDRR.

103

ACT EXPLORE Rosters

• Accountability will be based on 100 instructional days from the prior year.

• The Office of Assessment and Accountability will match students tested to prior school year data (We completed this work last spring).

• Accountability work will be completed, tentatively, in January 2014.

104

Materials Return• ACT EXPLORE Tyvek envelopes:

• Student answer folders• School Headers• Testing Irregularity Forms/Comment Forms (if

applicable)• JCPS envelope for other materials listed on the

check in sheet. • Materials will be hand-delivered to the JCPS

Testing Unit according to the schedule shown on the next slide.

• Materials return will be BY APPOINTMENT ONLY. 105

DO NOT SEAL

ENVELOPES

Materials Return• Tuesday, October 1st

Schools administering ACT EXPLORE

• Wednesday, October 2nd Schools administering ACT PLAN

• Thursday, October 3rd Schools administering both ACT EXPLORE

and ACT PLAN

106

Materials Return• Appointments will be ONE HOUR in length.• Appointment Request Forms will be sent via

email and returned through the Testing Unit fax (3775).

• Appointments will be assigned in the order they are received.

107

Completing your School Header form

• To facilitate scoring of your answer folders in a timely fashion, fill out your School Report Header completely and accurately.

• If you cannot locate this form, please call JCPS Testing Unit @ 485-3388.

108

School Header Form

If not already present, carefully remove your Pre-ID label from your PACKING SLIP and place it inside the four corner brackets

Return with your test materials. 109

110

School Header FormBox C, F, G, H and I MUST be completed in exactly the same way for every school in the district.

The information needed to complete Box B and Box K is found on your packing slip.

111

Scheduling Testing Sessions

• Preparing testing rooms

•Examples of seating arrangements

• Students should all face the same direction during testing

• Use of calculators 112

Room Supervisors – p. 25

• Read directions exactly as they are written (Use Option #3)

• Monitor students

113

Posted Instructional Materials Posted Instructional Materials

• REMOVE OR COVER: • Maps, posters, charts or any content

related materials (per Administration Code regulation)

• Periodic Tables need not be covered.114

Calculators – p. 9

115

Use of Calculators – p. 9

ACT has LOTS of rules about calculators!! Read them carefully.

116

Calculators – p. 9• Students should have calculators available for this

test.

• Calculators need the four basic functions (addition, subtraction, multiplication, division), plus a square root function.

117117

Use of Calculators – p. 9

•Students should use the type of calculator with which they are most comfortable. If the school normally provides calculators for students, then the same calculators should be provided on the test day.

•If the students normally provide their own, or if any student would feel more comfortable using their own calculators, he/she should bring and use his/her own calculator on the test day.

118

Use of Calculators – p. 9Use of Calculators – p. 9

•A supply of calculators with at least the four basic functions, plus a square root function, should be available on test day to lend to any student who did not bring a calculator, whose calculator does not perform the necessary function or whose calculator malfunctions during the test.

•It is advisable that all calculators be checked prior to testing to be sure they are working properly.

119

Use of Calculators

•Read the information on Pages 9 and 10 of the Supervisor’s Manual and be sure to follow the instructions to the letter.

120

Other ACT EXPLORE Test Administration PoliciesSupervisor’s ManualPages 19 - 22

• Unauthorized testing aids• Questions/Guessing• Rest Period• Leaving the room during testing• Announcement of Time

Remaining• Electronic Devices• Reporting Irregularities in Test

Administration

• Student Challenge of Test Items

• Mistiming• Defective Test Booklet or

Answer Folder• Voiding Tests or Answer

Folders• Student Who Becomes Ill• Prohibited Behavior

121

Defective Answer Folder

If an answer folder needs to be replaced, have a responsible adult (NOT THE STUDENT) transfer all information to the new answer folder after the timed portion of testing is completed.

122

Forms to be Completed by the Room Supervisor

Supervisor’s Comment Form (if necessary)Page 63 of the Supervisor’s Manual

Testing Irregularity Report (if necessary)Page 65 of the Supervisor’s Manual

123

Checking Folders(Room Supervisor Responsibility)This will be very helpful when you organize materials from all classrooms.

1. Turn all answer folders the same way with the same side up, alphabetizing the answer folders by student last name.

2. Make sure there is one answer folder for each student who took the test.

124

Checking Folders(Room Supervisor Responsibility)This will be very helpful when you organize materials from all classrooms.

Check the answer folders for the following and correct as necessary:

• Are answers marked with a soft-lead pencil? If astudent used a pen or marker, use a soft-lead (no. 2) pencil to mark over his or her answer choices.

• Have all stray marks or doodles been erased?

• Are all marks neat and dark, filling the answer spaces completely?

125

Checking Folders(Room Supervisor Responsibility) This will be very helpful when you organize materials from all classrooms.

Room Supervisors separate used and unused test materials and return all materials to the Building Assessment Coordinator.

126

Finishing Folders(BAC Responsibility)

• ALPHABETIZE ANSWER FOLDERS BY SCHOOL, BY STUDENT LAST NAME.

• Materials should be appropriately packed for return to the JCPS Testing Unit.

• Complete SDRR ACT EXPLORE rosters by midnight on Friday, September 27th.

127

Packing Materials to Return to JCPS Testing Unit

1. Place answer folders in ACT Tyvek envelopes

2. DO NOT seal the envelopes 3. DO NOT mail the answer folders to ACT4. Return the answer folders to the JCPS

Testing Unit during your assigned Materials Return Appointment

128

CHECK IN SHEET

129

ALL answer folders mailed back will be scored, blank or not

Unused test booklets, unused answer folders, etc. should be destroyed, NOT returned

130

Disposition of Other Testing Materials• Keep totally voided answer folders for your records or

destroy them.

• Used test booklets should be kept at the school to return to students when they receive their test scores.

• Keep ALL accommodation materials to return to students when they receive their test scores.

• Discard unused test booklets after all students have received their reports and test booklets.

• All other materials should be destroyed.

131

Final Steps

•The JCPS Testing Unit will print a copy of your SDRR roster to use during materials check in.

•It is highly recommended that you download a copy of your own ACT EXPLORE SDRR roster (MS excel format) for your own records.

132

Score Returns

Approximately 10 days after receipt of test materials school reports ship from ACT to district offices.

133

Group Seating Chart – p. 1

134

Group Seating Chart – p. 2

135

136

Just give us a call or send us an email….

JCPS Testing Unit485-3388

137