Upload
jasmine-oconnor
View
215
Download
0
Tags:
Embed Size (px)
Citation preview
Proctoring the Spring 2011
Measurements of Student Progress (MSP)Grades 3–8Paper/Pencil
This presentation is provided to assist in the training of proctors and should be augmented with special consideration
appropriate for your local district
Critical Information for Proctors
Student Success
Office of Superintendent of Public Instruction
March 23, 2011
Errata Grade-Band 3-5 Page 116
Accommodated kits for students registered through the WAMS Online Test Registration system include a Pre-ID standard form test booklet.
Test booklet labels and Return Shipping labels are color coded to ensure that receipt and scoring of all returned material is accurately processed.
The latest version of the Washington State Accommodations Guidelines for Statewide Assessments combines IEP, 504 and ELL accommodations.
Test booklet back covers (demographic page) have been revised. Student demographic and test status are now specific to the grade level and content.
Proctors sign and submit Test Security Assurance Forms. The completed form must include an explanation of boxes checked “No” and notation of missing materials.
Updates from 2010
The Assessments Test Preparation Question Format Response Formats and Tools
Page number reference Page number reference in the Directions for in the Directions for
Administration manual Administration manual
Intent of the Assessment: To ensure the best opportunity for students to Demonstrate what they know and are able to do.
Part 1—Overview
It is desirable for students to be given a certain amount of practice so they will be familiar with the format of questions on state assessments.
Students need to be given practice with multiple-choice, short answer, completion and essay formats in regular instructional activities. Such test preparation activities should be viewed as being a continual process, not something that is only done immediately prior to testing.
Students who will be testing online must be provided at least one opportunity to review the Online Demo and Tutorials for the particular subjects in which they will test.
Changes for 2010 and Beyond http://www.k12.wa.us/assessment/StateTesting/default.aspx
Teacher Resource Tool available athttp://www.k12.wa.us/teacherresourcetool/default.aspx
Test Preparation
MSP Question Format Multiple-choice items have either three (grades 3, 4 and 5) or four (grades 6, 7 and 8)
response options. For these questions, students must choose the best answer and completely fill in the circle next to the answer. Any unwanted marks must be erased completely.
Short-answer questions ask students to supply the answer. Dependent on content area, answers may be in the form of words, phrases, sentences, numbers and/or pictures/diagrams.
Completion questions ask students to supply the answer, which may be in the form of a word, phrase, short sentence and/or numeric answers on the answer line or in the box provided.
Essay questions in writing at grades 4 and 7 require students to write an essay in response to two prompts.
Stand-alone questions on the reading assessments are not connected with a passage. Stand-alone questions on the science assessments are not connected with a scenario. Stand-alone questions ask students to choose the best answer or write a word or phrase for completion.
Review sample questions at the beginning of each content area in the DFA manuals
Only No. 2 pencils may be used on state assessments. These procedures also apply to the rough drafts and final copies of writing assessments.
This limitation is based on scoring and testing protocols. Scanning of test booklets may be compromised by use of certain writing instruments. Further, the use of a particular writing instrument may guide or clue a student to a particular type of prewriting activity, in turn influencing the student’s response.
Students may use a No. 2 pencil to underline or check/circle items or key words for future reference, but care should be taken not to make marks near circles on multiple choice questions or penetrate the paper.
Response Formats and Tools
These procedures also apply to the rough drafts and final copies of writing assessments.
Test Security
State Laws Governing All test content is confidential and secure. No part of any test content may be reproduced or transmitted in any form or by any means, electronic or mechanical, including photocopying, recording or placement in any information storage and retrieval system. This includes but is not limited to e-mail and text messaging.
Ensuring Test SecurityTest material must be maintained in a secure manner and not revealed to students prior to testing.Students must not be given inappropriate assistance during the time they are taking the test.The test has to be maintained in a secure manner before and after administration because test questions are reused over time.
**Staff are not permitted to read, inspect, discuss or transmit secure test content**
Confidentiality Follow your building testing security plan Ensure confidentiality of test booklets
under your control
Generally Recognized Standards Ensure access, not advantage Provide appropriate allowable
accommodations
Confidentiality and Generally Recognized Standards
Teachers are expected to provide students with an opportunity to acquire the knowledge and skills that will be assessed, primarily by providing students with a rich instructional program.
Teachers may not, under any circumstances, use secure test content for instruction of students.
Teachers shall maintain the confidentiality of individual students’ results. Teachers may help students improve test-taking skills by:
Teaching students test-taking strategies; Providing practice assessments that demonstrate various item formats;
and Using resource materials such as assessment questions from the public
domain.
Responsibilities of Teachers
Test proctors are educational practitioners who: Must attend required training and read all assigned training materials; Provide a positive test taking environment; Administer assessments according to the Directions for Administration manual
and any supplemental materials provided by OSPI; Ensure that assessment documents are given only to the student identified in
the coding; Maintain confidentiality concerning secure content; Document and report any testing irregularities/breach in test security; Sign and submit Test Security Assurance Forms. The completed form must
include an explanation of boxes checked “No” and notation of missing materials.
Examples of Prohibited Activities Reviewing, revealing or copying test content. Causing achievement to be inaccurately measured or reported. Copying or reading student responses.
Responsibilities of Test Proctors and Staff
Because cell phones, iPods® and other communications devices have the capability of transmitting secure test content, they must be turned off and kept out-of-view and out-of-reach, until the testing session has completed and secure materials have been collected.
Use of cell phones during testing will result in an irregularity and possible invalidation.
It is important that school administrators and staff establish and communicate this policy to students.
Backpacks, bags and purses must be kept a distance from the student so that items may not be retrieved without leaving the seat.
Communication Devices and Backpacks
Participation in Testing and Special Education MSP/WAAS Participants New Non-English Proficient (NNEP) Absenteeism
Part 3—A: Preparation for Testing
All students enrolled during the testing window must participate in the MSP, MSP-Basic or WAAS-Portfolio assessment. Students are pre-registered and will receive Pre-ID test booklets or Pre-ID adhesive labels.
Testing and special education: IEP teams review the available performance data and identify the most appropriate testing option for students in grades 3-8, in the content area for which they qualify for and receive special education services.
Measurements of Student Progress Without accommodations With accommodations
WAAS Portfolio MSP-Basic —Level 2 “Basic” meets standard
MSP/WAAS Participants
NNEP students are those who first enrolled in a U.S. public school within the past 12 calendar months. They are not required to take the reading and writing assessment. Please keep in mind that these students test their second year in school..
The No Child Left Behind Act (NCLB), however, does require NNEP students to take the mathematics and science assessments. Test scores, including those in mathematics, are not counted in any way (i.e., Report Card or AYP results). If they do not take the mathematics MSP, they will be counted in AYP as non-participants. As you know, NCLB requires 95% participation.
New Non—English Proficient (NNEP) Students
All GradesStudents who are absent with a valid excuse and do not take the assessment will not be included in the proficiency portion of AYP or state results. However, they will be counted as non-participants for AYP purposes. Absences need to be reported, on the back cover (demographic page) of the student test booklet, either as excused or unexcused. This documentation must follow local school board policy on excused absences.
Grades 3–8Students in grades 3–8 must be given an opportunity to make up missed
sections of the assessment. Make-up session for students who miss one or more parts of the assessment must be scheduled after the initial administration. Students who miss a first-day writing session but are present for the second-day may be tested along with other students and make up the first session at a later time.
Absenteeism
Guidelines for scheduling the Assessments Test Preparation Communicating with Parents and Students Identifying Proctors, Scribes, Volunteers Preparing Students for State Assessments
Part 3—Before TestingB: Testing Schedules
The standardized schedule helps ensure the security of the assessment content and contributes to the validity and accuracy of student scores.
The MSP is an untimed test. Estimated timeframes are for planning purposes.
10–15 minute supervised breaks are allowed. Caution against discussing test content. Students generally remain in classroom; however, they may be permitted to leave the room, if supervised.
Administration of all tests begins soon after the start of the school day.
All late starts and early dismissals must be canceled on testing days as well as interruptions in testing for specialists or teacher planning.
Contact your assessment coordinator for direction on accommodating students who arrive after testing begins.
Follow your school testing plan for students who need additional time. Each test must be completed during the regularly scheduled day in which it was begun, unless specified in the students’ IEP or 504 Plan.
Guidelines for Scheduling the Assessments
Statistical Sample Schools (SSS) MSP Writing SS: Schools identified begin testing on April 12th and end testing
on April 20th (early window, expedited return).
Data Recognition Corporation (DRC) has prescheduled your carrier pick-up of grades 4 and 7 participating Statistical Sample Schools.
Writing (limited)- 4/21*Only schools identified on the Early SSS Writing list: EarlySSSWritingMSP
Completed test booklets return on April 21st If a student is unable to be assessed during this
window, return test booklet(s) to your school assessment coordinator for retention. The student may be assessed during the standard or makeup schedule.
April 2011
Su M Tu W Th F Sa
1 2
3 4 5 6 7 8 9
10 11 1212 1313 1414 1515 16
17 1818 1919 2020 2121 22 23
24 25 26 27 28 29 30
* All other writing material administered May 2nd through May 19th (district approved schedule) and returns on standard schedule. Date selected in WAMS.
Part 3 -Section C: Ensuring a Proper Testing Environment
All testing locations must be posted with a Testing—Do NOT Disturb sign. When placing the sign, care should be taken not to obscure windows. This posting assists in preventing interruptions in testing and facilitates the monitoring of testing by administration.
Remove or cover aids or prompts in the classroom that may help students answer test questions.
The following are samples of items permitted:
Alphabet Simple number line Verbatim Copy of the ‘Writing Checklists’ Glossaries for Non-Mathematics and Non-Science terms Mathematics Formula Sheet
My Word ListCompareContrastConnectAnalyzeInterpretSynthesizeEvaluate
State assessments must be administered by trained staff members (e.g., teachers, ESAs, EAs, substitute teachers) of a school district under the general supervision of a certificated employee.
Student teachers and interns have a contractual relationship with the school district—even though they are not paid employees—and may assist in the administration of the assessments.
Volunteers may not administer or assist in the administration of any state assessments. Volunteers may assist in the supervision of students who need a break or have completed testing.
Identifying Test Proctors and Scribes
Mathematics Tools Science Tools Writing Tools Scratch Paper Calculators
Part 3 Section D: Tools and Manipulatives
Dictionaries and ThesaurusesFor the Writing Assessments, students may use a commercially published thesaurus or dictionary. Teacher- or student-created dictionaries are not permitted.
For the Reading, Mathematics or Science Assessments, dictionaries and thesauruses are not allowed on any session.
Scratch Paper For the Writing Assessments, at least 3 sheets of yellow, lined letter-size (8 ½”
x 11”) scratch paper should be provided.
Refer to Washington State’s Accommodation Guidelines for Statewide Assessments for tools available to students receiving Special Education or ELL Services: http://www.k12.wa.us/assessment/AlternativeAssessment/Accommodations.aspx
Writing Tools
No. 2 Pencils ONLY Pens, highlighters, markers, mechanical pencils, crayons, and pencils of 2.5, 3.0 etc.,
are NOT permitted; they will not be picked up by the scanners. Students may use a No. 2 pencil to underline or circle key words in the assessment
directions.
Scratch PaperFor the Reading, Mathematics and Science Assessments, no additional paper of any kind is allowed, including lined or unlined scratch paper, patty-paper, wax paper or transparencies.
For the Writing Assessment, students must be provided scratch paper for the prewriting and first drafts of each session. It is suggested that you provide at least 3 sheets of yellow, lined letter-size (8 ½" x 11“) scratch paper so that it can be easily identified and removed for shredding.
Providing Testing Materials
Calculators are permitted on the following assessments
Mathematics (use optional) Grades 7 and 8 (MSP)
Science (use optional) Grades 5 and 8 (MSP)
Calculators are NOT permitted on the following assessmentsMathematicsGrades 3, 4, 5 and 6
Proctors are required to review the calculator section of the DFA for policies on use of and types of calculators allowed on state assessments.
Students must be thoroughly familiar with the operation of the calculator they plan to use on the test.
Calculators
Section E: Testing Materials
MSP and Accommodated CD Forms Follow your school testing security plan for tracking materials to ensure materials
are accounted for and returned to your school assessment coordinator. Follow building protocol for students who need additional time. Each student test for MSP (including Braille, large print and accommodated CD)
has a unique security barcode number printed on the front cover, upper right hand corner.
New this yearAccommodated materials (Translated Mathematics and
Science CDs, large print and Braille) will now be packaged as pre-Identified kit (zip-lock baggy) with a standard form test booklet.
Tracking Secure Test Materials
Storage and Handling of Secure Materials
All test booklets, alternate assessments and accommodated forms must be kept under secure, locked, limited access conditions at all times.
Test Proctor is responsible for: Becoming proficient with the school’s secure test material handling plan Daily accounting of all secure test material is critical. Ensuring secure storage of all test materials Ensuring accuracy of student demographic information Documenting test irregularities and security breaches Completing Test Security Assurance Form, including an explanation for boxes
checked “no” and notation of missing materials.
All missing materials must be immediately reported to your school assessment coordinator.
Distributing and Collecting Booklets Handling Defective Booklets During Testing Monitoring and Certifying Test Administration Reporting perceived Error on a Test Documenting Irregularities
Part 4—During Testing
The reading, mathematics and science assessments are to be given in one session. The writing assessments are to be given in two sessions.
Reading, mathematics and science test booklets must be collected after the completion of the testing day and returned to your school assessment coordinator according to your school’s secure test material handling plan.
Writing test booklets must be collected after the completion of session one and stored in a secure, locked, limited access area. Be sure to verify that the correct booklet is given to student identified.
Return to your school assessment coordinator at completion of session two, according to your school’s secure test material handling plan.
Distributing and Collecting Booklets
It is possible that a student might receive a defective test booklet or that a test booklet may become damaged during testing. If a test booklet is incomplete or defective, the proctor should:
Obtain a new test booklet from your school assessment coordinator;Verify the student’s demographics are gridded on the back cover of the replacement booklet;Document the testing irregularity in the “Notes: Proctor/Coordinator Use” box on the front cover of the replacement booklet;Tell the student to continue with the replacement copy, beginning after the last question answered in the defective booklet; andBand both the replacement and damaged/incomplete booklets together prior to returning to school assessment coordinator for transcription.
Handling Defective Booklets During Testing
Monitoring & Certifying Test Administration
Locations where testing is occurring must have a “Testing – Do Not Disturb” sign posted on the door to allow administrator monitoring and prevent unnecessary interruptions You may not paraphrase questions or read the questions to students.
Test proctors and monitors must observe students to ensure:
Students are engaged with the assessment and working independently
Students are using only a No. 2 pencil
Students are not using cell phones or other electronic devices, other than approved calculators.
You may not read or comment on student essays, point out incorrectly answered question or point out questions that have not been answered.
Reporting Perceived Error on a Test
If there appears to be an error on the assessment, instruct students to complete that section of the assessment. Assure the student that items found to contain errors will not be counted toward their score. Do not attempt to provide your own remedy.
Alert your school and/or district assessment coordinator. Include the following information: content, grade level, form letter, test question number and page number. For security concerns, DO NOT copy the problem, share with colleagues or transmit this information via e-mail or text messaging.
The district assessment coordinator will complete a Test Question Ambiguity Form.
The state will provide a remedy if needed for all students in the state.
Collect materials from students immediately after completion of testing.
Collect all Writing scratch paper, Mathematics Formula Sheets and Glossaries. Check to be sure that all papers are accounted for, then immediately and securely shred them.
Account for all secure materials.
Keep large print/Braille tests and accommodated forms (CDs) with the Standard Form A test booklet when returning to your school/district assessment coordinator.
Return all test materials to the school assessment coordinator.
Complete and submit a Test Security Assessment Form to your school assessment coordinator.
After Testing
Part 8: Resources
Test Proctor Checklists Accommodations Available to All Students Test Administration Irregularities Process Sample Test Booklet Covers Test Proctor and Classroom Testing Resources WAAS-DAPE Deliverables, DFAs and Test Booklets
Wider Access
Accommodations Available for Students Receiving Services
Documenting Accommodations
Scribing Student Work
ii: Universal Accommodations Available to Any Student
The goal of the Washington Comprehensive Assessment Program is to assure every student has the opportunity to participate in the assessment, without providing a special advantage.
Refer to the Washington State Accommodations Guidelines for Statewide Assessments for specific accommodations available to students receiving Special Education Services and English Language Learners.
The Checklist for accommodations available for all students is available in the Resources section of the DFA.
Assure Wider Access
In addition to these procedures for wider access available to all students, several individualized accommodations may be used for students with limited English and students with disabilities.
Special populations in Washington State include the following: Students in Special Education Programs Students with 504 Plans English as a second language/bilingual students
Accommodations Available for Students Receiving Services
Refer to the Washington State Accommodations Guidelines for Statewide Assessments for accommodations for students with and IEP, 504 or ELL plan. http://www.k12.wa.us/assessment/AlternativeAssessment/Accommodations.aspx
Mark the accommodations used During Testing Box 6 must be completed on the back cover (demographic page) when a is provided a listed accommodation.
Important Note: Refer to the Washington State Accommodations Guidelines for Statewide Assessments
When Speech Recognition Software or other assistive technology When Speech Recognition Software or other assistive technology is used, ensure all secure test information has been deletedis used, ensure all secure test information has been deleted
Documenting Accommodations
www.k12.wa.us/assessment/AlternativeAssessment/Accommodations
Scribing should only be used for students who are unable to write their own responses in the test booklet. The need for a scribe must be documented on the students’ IEP or 504 Plan.
Scribing should not be used to compensate for:Poor handwritingPoor spellingDifficulty with writing organization and slow productionStudent’s resistance to performing writing tasks
Partial Scribing may be used if documented in the students’ IEP or 504 PlanTranscribing Student Work from a Computer
Scribing for Students
Broken or Sprained Arms and HandsStudents with a Broken Arm, Hand, etc may use a scribe on state assessments. Follow the steps outlined below:
1. The district should consider whether the student needs accommodations for general classroom instruction and, if so, create a 504 plan.
2. The school assessment coordinator must complete an Individual Testing Irregularity Report and submit it to the district assessment coordinator.
3. Document the scribing in the “Notes: Proctor/Coordinator Use” box on the front cover of the student test booklet and include the reason for scribing (e.g., student broke arm, hand, etc.). Documenting this accommodation will assist us if we receive scoring alerts from our contractor when the work in the booklet does not appear to be that of a student.
Section iii: Documenting Test Administration Irregularities
Consult your School Assessment Coordinator regarding all irregularities. All testing irregularities must be documented on the front cover of test
booklets in the “Notes: Proctor/Coordinator” box. All individual and group testing irregularities must be gridded on the
back cover (demographic page) of the student test booklet(s). These irregularities must be promptly documented on forms located at
www.k12.wa.us/TestAdministration/FormsReports/
Refer to Section R13-16 of the Directions for Administration manual for additional information regarding testing irregularities.
Notify administration and parents of all potential invalidationsNotify administration and parents of all potential invalidations
For Assistance
Resource flow chart:1. Review your district materials
2. Proctors: Contact your school assessment coordinators
3. School assessment coordinator: Contact your district assessment coordinator
OSPI will refer calls from other district and school staff to their district assessment coordinator.