Embed Size (px)
Citation preview
QualityCore –Spring 2013 Test Administration TrainingJanuary 28, 2013
Joe Dell Brasel, Ed.D.Principal ConsultantACT Atlanta [email protected]
Jennifer StaffordPolicy AdvisorKentucky Department of Education [email protected]
KD
E:O
AA
1/2
3/2
01
3
Agenda• What’s New• Constructed Response Announcement• Testing Windows and Sessions• Responsibilities and Deadlines• Accommodations• Materials
• Group Headers• Labels• Answer Documents
• Return Shipping• Prohibited/Acceptable Materials• Resources
KD
E:O
AA
1/2
3/2
01
3
2
What’s New• When students are tested• Constructed Response shift to local administration• Multiple Choice test format combination• KDE/ACT upload of student accounts• Window 6 (June 16-July 16) Computer Based Testing Only
KD
E:O
AA
1/2
3/2
01
3
3
When Students are Tested• Policy Change: Students are tested at the completion of all
coursework.• No longer calculate if 55%
Example 1 Example 2 Example 3
Student passes semester 1 Student passes semester 1 Student passes trimester 1
Student passes semester 2 Student fails semester 2 Student fails trimester 2
Student takes exam Student retakes semester 2 Student takes trimester 3
Student takes exam Student retakes trimester 2
Student takes exam
KD
E:O
AA
1/2
3/2
01
3
4
New FeaturesCurrently Available• Batch printing for student reports (directions shared in
January 7 DAC Monday E-mail)• Combined MC/MC into one booklet
In Development• iPad application K
DE
:OA
A 1
/23
/20
13
5
End-of-Course - Dual Purpose• Instruction
• Objectives• Syllabus• Course Outline• Instructional Units• Formative Item
Pool/Benchmark Assessments
• Accountability• Student• School• District• State
KD
E:O
AA
1/2
3/2
01
3
6
Issues with Constructed Response• Critical for Instruction
• Super Scale Score• Student Motivation• Security of CR Items
• Logistics• State Guidelines• Two Separate Scores
• Paper Based Testing
KD
E:O
AA
1/2
3/2
01
3
7
Local Administration Instructional Value• Constructed Response administered locally will render
more instructional value.• Students, parents, teachers have student work to score and
analyze.• Teachers can identify strengths and weaknesses in student
writing.• Instruction can be based on current data. K
DE
:OA
A 1
/23
/20
13
8
Constructed Response Shift to Local Administration
• Constructed Response will not be part of state administered assessment.
• Students will take multiple choice sections for state accountability.
• Schools will receive Scale Score (MC/MC).• The 2012-13 grading scale aligns more closely to the
performance levels (NAPD). • Schools can have a better idea of performance levels.
KD
E:O
AA
1/2
3/2
01
3
9
Constructed Response Shift to Local Administration (continued)
• Constructed Response should be administered at the local level• Local administration and scoring • Included in student’s final exam grade• Instructional Value
• Encourage schools to revisit EOC policies• Review the policy which created the percentage of the EOC
into the student’s grade
KD
E:O
AA
1/2
3/2
01
3
10
Constructed Response Shift to Local Administration (continued)
• Local staff may obtain from various locations• Formative Item Bank (Vantage System)• Benchmark Assessment (Vantage System)• Local Source
• Text Book• Locally Developed• Open Source K
DE
:OA
A 1
/23
/20
13
11
Constructed Response Shift to Local Administration (continued)
• Materials Order process will be the same without constructed response.
• Computer Based testing for EOC would yield no shipment from ACT. Support materials and manuals are available online.
• For paper based testing, schools will only receive one Answer Sheet and one set of student labels.
• It will simplify returning materials.• For computer-based testing of multiple-choice items, student
results are available in the online system within 24 hours.
KD
E:O
AA
1/2
3/2
01
3
12
Constructed Response ImplicationsWindow 4
February 1 – March 15
• Constructed Response test booklets will be shipped by ACT in early part of window
• DACs hold at district office
• Manuals do not reflect change
Window 5 & 6April 15-June 15 & June 16-July 15
• Constructed Response test booklets will not be shipped by ACT
• DACs will not receive CR test booklets
• Manuals will reflect change
KD
E:O
AA
1/2
3/2
01
3
13
Two Sessions• Two separate EOC sessions
• Multiple Choice 1 (Paper or Computer)• Multiple Choice 2 (Paper or Computer)
Policy Change: School staff may choose to combine paper and CBT for Multiple Choice.• Sessions are 45 minutes each
• Paper sessions are timed by the test administrator.• Computer sessions are timed automatically by the computer.
KD
E:O
AA
1/2
3/2
01
3
14
Testing Sessions• Paper Testing:
• ALL students must be tested at the same time, in the same content area.
• Computer Testing:• Multiple testing sessions can be utilized in a single day.• New Policy: The first computer based test must begin at the
same time as the paper based test.
• Note: A 10-15 minute break is allowed between test sessions.
KD
E:O
AA
1/2
3/2
01
3
15
Testing Windows (Includes Paper and Computer Testing)
• Six EOC test windows per year • August 1-September 15 (new) • October 1-November 16• December 1-January 15• February 1-March 15• April 15-June 15• June 16-July 15 (Computer Based Only)
• Within each window, schools choose a 10-day window (consecutive days) to complete the four tests, including make-up sessions.
• Within the 10-day window, schools choose 1 day per content area.• MC1 and MC2 must be given in order on the same day.• May schedule multiple content tests on same day.
KD
E:O
AA
1/2
3/2
01
3
16
Non-Traditional Windows (Includes Paper and Computer Testing)
• Six EOC test windows per year • August 1-September 15 (new) • October 1-November 16• December 1-January 15• February 1-March 15• April 15-June 15
• June 16-July 15 (Computer Based Only)• Within each window, schools choose one day per student(s) to
complete sessions.• MC1 and MC2 must be given in order on the same day.• May schedule multiple content tests on same day.
KD
E:O
AA
1/2
3/2
01
3
17
Traditional vs. Non-Traditional? • High Schools with only Traditional Courses: Use school’s
10-day window• Alternative Schools with only Non-Traditional Courses: Use
State’s broader window• Schools with both Traditional and Non-Traditional Courses:
Use both school’s 10-day and State’s broad window
KD
E:O
AA
1/2
3/2
01
3
18
Steps for Ordering• Confirm Unit Usage (DACs/Designee)• Create/Upload Users & Teachers (DACs/Designee)• Create/Upload Students (KDE/ACT, Local)• Create Class Test Rosters (Local)• Finalize Class Rosters (Local)
Note: Valuable Resources are located at: www.act.org/stateservices/kentucky
KD
E:O
AA
1/2
3/2
01
3
19
Responsibilities
• District or School Administrator: • Conduct Administration Code and Inclusion Training• Confirm Unit Usage per school
• Determine Paper or Computer Testing• Estimate Number of Students Testing
• No automatic overage. DAC/BAC should order additional tests per school.
• Determine Testing Dates
• Create/Upload Students (New enrollees)
KD
E:O
AA
1/2
3/2
01
3
20
Create and Upload Students• KDE will extract from Infinite Campus (IC) students
enrolled in IC at the high school level within each district.• ACT will create student accounts at the appropriate school. • Student grade levels will reflect current status in IC.
Accounts for students enrolled after this date will need to be created by the school.
Note: Middle school students taking courses for high school credit will not be included.
KD
E:O
AA
1/2
3/2
01
3
21
Create and Upload Students (continued)• KDE/ACT Upload of student accounts
• Spring—Data pull from IC Dec. 15 in Vantage early February • 2012 High School Graduates will remain in the Vantage system
for one year.
KD
E:O
AA
1/2
3/2
01
3
22
Responsibilities• School Administrator:
• Create Class Roster Name: • Options• Name by school, course, teacher, and period
• i.e. CCHS, Algebra II, C. Greer, period 5
• Name by school, course, per teacher• i.e. CCHS, Algebra II, C. Greer
• Name by school, course• i.e. CCHS, Algebra II
• Note: Separate class roster for extended time for computer based (specific timing).
KD
E:O
AA
1/2
3/2
01
3
23
Responsibilities• School Administrator or Teacher:
• Finalize Class Rosters • Verify all students to be tested are on roster• No roster in SDRR at this time• Print or save electronic copy to use as a reference for
accountability in SDRR at the end of school year. • Create seating chart
KD
E:O
AA
1/2
3/2
01
3
24
Test Form Changes
KD
E:O
AA
1/2
3/2
01
3
25
Target DatesDeadlines for April 15 – June 16
End-of-Course Testing
Begin Testing the Week of: April 15 April 22 April 29 May 6 May 13 May 20 May 27 June 3 June 10Confirm Unit Usage February 18 February 25 March 4 March 11 March 18 March 25 April 1 April 8 April 15
Create/Upload Users & Teachers Should be CompleteCreate/Upload Students March 4 March 11 March 18 March 25 April l1 April 8 April 15 April 22 April 29Create Class Test Rosters March 11 March 18 March 25 April 1 April 8 April 15 Aprill 22 April 29 May 6
*Finalize Class Rosters March 15 March 22 March 30 April 5 April 12 April 19 April 26 May 3 May 10
*Finalize Class Rosters must be completed four (4) weeks plus one day prior to testing. Other dates are targets for workload management.
KD
E:O
AA
1/2
3/2
01
3
26
Target DatesDeadlines for June 17 – July 15
End-of-Course Testing
Begin Testing the Week of: June 17 June 24 July 1 July 8 July 15
Confirm Unit Usage April 22 April 29 May 6 May 13 May 20
Create/Upload Users & Teachers Should be CompleteCreate/Upload Students May 6 May 13 May 20 May 27 June 3Create Class Test Rosters May 13 May 20 May 27 June 3 June 10
*Finalize Class Rosters May 17 May 24 May 31 June 7 June 14
*Finalize Class Rosters must be completed four (4) weeks plus one day prior to testing. Other dates are targets for workload management.
KD
E:O
AA
1/2
3/2
01
3
27
Special Populations Regulation • Inclusion of Special Populations in the State-Required Assessment
and Accountability Programs
• No changes to the Inclusion of Special Populations Regulation (February 2009)
• Accommodations must be identified in a student’s Individualized Education Program (IEP), 504 Plan or Program Services Plan (PSP) to be provided on the End of Course assessment
KD
E:O
AA
1/2
3/2
01
3
28
Accommodated TestingPaper Only
• R = Reader• A = Audio• B = Braille• LP = Large Print • Scribe
Paper and Computer• Extended Time• Paraphrasing• Manipulatives• Prompting/Cueing• Behavior Modification• Interpreter (sign
language)• Dictionaries/Thesauri
KD
E:O
AA
1/2
3/2
01
3
29
Ordering Accommodated Test Materials• Navigate to http://www.act.org/stateservices/kentucky• Select the Resources tab (top right side of screen)• Select Test Accommodations (left side of screen)• Download and complete the KDE Accommodated Testing
Materials Order Form. Once the order form is completed, e-mail it to [email protected]
Note: This process is for accommodated materials, not test booklets. Paper units must be allocated to the school and students must be on finalized roster for order to be complete.
KD
E:O
AA
1/2
3/2
01
3
30
Ordering Accommodated Test Materials Deadline
• This includes ordering of reader scripts.
• Fax Form to QualityCore Customer ServicesForm available at: http://www.act.org/stateservices/kentucky/accommodations.html
Begin Testing the Week of: April 15 April 22 April 29 May 6 May 13 May 20 May 27 June 3 June 10
Accommodations Order March 11 March 18 March 25 April 1 April 8 April 15 April 22 April 29 May 6
Begin Testing the Week of: June 17 June 24 July 1 July 8 July 15
Accommodations Order May 13 May 20 May 27 June 3 June 10
KD
E:O
AA
1/2
3/2
01
3
31
Exemption Types• Medical Exemption choice requires more detailed
information, including Date of Diagnosis and Hospitalization. More detailed descriptions are needed for approval.
• Extraordinary Circumstance (Other Exemption) choice has open field to enter information.
• For both types of exemptions, see the associated Medical Exemption and Extraordinary Circumstance forms on the KDE web site and in the Forms section of the DAC/BAC.
• SDRR will be open for exemption applications in Spring.
KD
E:O
AA
1/2
3/2
01
3
32
Exemption Information• Student identifying information
• Name• SSID• Grade• Gender• DOB• School Name• Test Type• Exemption Type
• Explanation of Medical or Extraordinary issue• Relevant dates
1. Keep paper form on-file in the district.
2. Enter information electronically into SDRR.
An Exemption Request is NOT automatically approved. K
DE
:OA
A 1
/23
/20
13
33
Receiving/Storing MaterialsFebruary 1 – March 15• Shipment going to DACs will be identified with course name, school and
BAC’s name for easy distribution• Check shipment contents
• Testing Boxes• Test Booklets
• Miscellaneous Boxes• Two Answer Folders (MC1/MC2 and CR)• Pre-ID Labels• Reference Sheets--Algebra II• Test Supervisor’s Manual (MC) and Room Supervisor’s Manual (one per 25 students
(MC))• School Header• Group Header
• Box 1 Contains Packing List
Store SECURELY
LOCKED storage
Discrepancies—Call (866)764-7228
KD
E:O
AA
1/2
3/2
01
3
34
Group Headers• One per class, per roster
• One for MC1/MC2
• Example: If Ms. Jones has 3 Algebra II classes, there will be 3 separate Group Headers.
• 3 MC Group Headers
KD
E:O
AA
1/2
3/2
01
3
35
B: Test Roster Name
D: Vantage Test Assignment
Roster ID
Information for Group Headers
Vantage Test Assignment
Roster ID
Test Roster Name
KD
E:O
AA
1/2
3/2
01
3
37
Pre-ID LabelsFebruary 1 – March 15• Arrive in Miscellaneous Box(s)• One per student answer folder
• MC1/MC2
• Errors on label• Do not edit • Make corrections online within class roster
• No Label • Add new students online
KD
E:O
AA
1/2
3/2
01
3
38
Answer Document and Labels • Affix label to answer folder.
Do not bubble student
information
Return Shipping:Group Headers
Group Header 1
MC/MC English 10 KD
E:O
AA
1/2
3/2
01
3
40
Return Shipping• Packing
• Envelopes• Used Answer Documents (MC1/MC2)• Testing Irregularity Report
• Instructions on pages 12-17 of Test Supervisor’s Manual
• Boxes• Used and unused tests booklets in the boxes stamped with their
course names• Unused answer documents and manuals in the boxes stamped
“Miscellaneous”• Instructions on pages 12-17 of Test Supervisor’s Manual
KDE and ACT recommend return shipping from the school.
KD
E:O
AA
1/2
3/2
01
3
41
Packaging and ShippingApril 15 - June 15
• One document per student per test• Test booklet pre-printed with student and teacher name• Answer sheet pre-filled with student information• Answer sheet bound as perforated sheet into test booklet• Reference Sheet for Algebra 2 bound as perforated sheet into
test booklet• One document per Test Supervisor
• Test Supervisors Manual• Pre-filled School Header• Pre-filled Group Rosters
• All shipped from the printer• More information to come on what shipment will look like
KD
E:O
AA
1/2
3/2
01
3
42
Window 6: June 16-July 15• Policy Change: Computer Based Testing Only
• Return of student scores• Guarantee from ACT to provide accurate data• Ensures students’ scores will be included in accountability
KD
E:O
AA
1/2
3/2
01
3
43
Supplemental Order Process• E-mail: [email protected]• Quantity needed per course• See example below:
MASON COUNTY SCHL DISTMASON COUNTY HIGH SCHOOL
Biology suborder 8233 10 testsEng 10 suborder 8232 4 testsMay 5—May 16
KD
E:O
AA
1/2
3/2
01
3
44
Irregularities• A disturbance or distraction occurs that could affect one or
more students’ scores.• A student becomes ill and discontinues testing.• A student questions or challenges a test item.• A student uses unauthorized testing aids.• Complete a Testing Irregularity Report (Test Supervisor’s
and Room Supervisor’s Manuals) KD
E:O
AA
1/2
3/2
01
3
45
MaterialsComputer
Prohibited• Notes• Foreign language or English
dictionary• Electronic devices and cell phonesAllowed• Scratch Paper-Please collect and
destroy securely.• Calculators• Reference Sheets (Algebra II)
Pencil/PaperProhibited• Scratch paper• Notes• Foreign language or English dictionary• Electronic devices and cell phonesAllowed• Scratch work is to be done in the test
booklet.• Calculators• Reference Sheets (Algebra II)
KD
E:O
AA
1/2
3/2
01
3
46
Practice Online Testing• Coordinate with District Technology Coordinators to verify
workstations are ready for online testing• CBT Launch Demo PPT• QC CBT QuickStart LaunchTest
• Teachers/Students may use the Launch Demo to practice the system.
KD
E:O
AA
1/2
3/2
01
3
47
KD
E:O
AA
1/2
3/2
01
3
48
Test Security• Appropriate training for Administration Code and Inclusion
Regulations• Signatures on Administration Code and Inclusion Training• Seating charts that reflect everyone in each testing room
(adults and students)
KD
E:O
AA
1/2
3/2
01
3
49
Seating Chart
KD
E:O
AA
1/2
3/2
01
3
50
Resources• Kentucky QualityCore Website
www.act.org/stateservices/kentucky
• Kentucky Department of Educationhttp://education.ky.gov/AA/distsupp/Pages/EOC.aspx
KD
E:O
AA
1/2
3/2
01
3
51
Contact InformationACT
• ACT Customer Services: • E-mail:
• Phone: (866)764-0228
• Joe Dell Brasel, Ed.D.• E-mail:
KDE• Assessment Support and
Research:• E-mail:
[email protected]• Phone: (502) 564-4394
• Jennifer Stafford• E-mail:
KD
E:O
AA
1/2
3/2
01
3
52
