TEST SECURITY ETHICS OF TESTINGKSDE Required Training2013-2014

Agenda• Current understanding about the new assessments! –

Information as of end of December, 2013

• Love it or List it?

• What’s new!

• Questions!

• More Information for those new to testing.

KSDE Decision – See Handout• On December 10, 2013 KSDE BOE voted to the following:1. Recommendation to allow for multiple

assessments at the high school level. KSDE will submitting an amendment to our waiver this winter for approval of this option.

2. CETE was voted to develop a Kansas assessment for grades 3-8 and high school.

2013 – 2014 Reading and MathTwo Assessment Options – provided to principals/schools:

• Option 1: KSDE Transition Assessment for Reading and Math• Administration time – 2 class periods per subject area (estimated

time 60 minutes per class period) – could take up to 4 totals hours to

• Option 2: Smarter Balanced Assessment for Reading and Math• Administration time – about 3.5 class periods per subject area

(estimated time 60 minutes per class period) – could take up to 7 total hours to take both tests

Developing Your Test Schedule• Buildings can plan their schedules for the assessments

and those will have to be turned into District Office for monitor purposes.

• Testing Window for Transition Test – March 10 to May 2nd

• Testing Window for Smarter Balanced – March – June• Testing Window for KELPA – February 3 – May 2

• Will also be asking for proctors/monitors, and schedule for students having accommodations

Are you going to Love it or List it?

Purpose• Test security is essential to obtain reliable and valid scores for accountability purposes. Accordingly, the Department of Education must take every step to assure the security and confidentiality of the state test materials. It is the responsibility of individuals who develop the tests, who administer the tests, and/or those who use the results to follow test security laws, regulations, and procedures.

Test Security, Ethics of TestingTraining Requirements

• All test coordinators must be trained yearly!• All staff who administer a state assessment must be trained yearly!

Training Requirements• District Test coordinators are responsible for local training

of teachers and building test coordinators. This must be done yearly and documentation of training must be provided during Monitor Visits!

• Staff Training must include: • Test Security• Ethics of Testing• Providing Accommodations – NO HUMAN Readers but

any staff member who provides accommodations for students must be trained in Test Security and Ethics!

Agreement to Abide by…

Any staff member who administers a

state assessment must sign an agreement to abide by form.

District and Building Test Coordinator’s Responsibilities

• Assessment Coordinator/Director Test Security and Ethics Task List – “Things to Do!”

• Posted on KSDE web site!• District testing director responsible for/overseeing test security/ethics

UpdatedFact Sheet…

Take time now to read and discuss the FACT SHEET!

FACT Sheet – NEW or AH, HA’sClassroom Teacher/Test Proctor responsibilities: • Follow test procedures outlined in the Examiner’s Manual and ethical practices for

testing. • Follow procedures outlined by District/Building Test Coordinator. • Follow established District/Building procedures for collecting and destroying

(shred) student notes, scratch paper, and drawings, etc. upon completion of each test part and the entire test.

• Teacher/test proctor should actively monitor the testing environment by moving around the room.

• Teacher/test proctor may not say nor do anything that would let a student know whether an answer is correct.

• Teacher/test proctor may not ask students how they got an answer. • Teacher/test proctor may not tell students to redo a specific item or to review any

specific part of the test once testing has begun. • Teacher/test proctor should verify the End Review Screen upon completion of the

test to see that all test questions have been answered before a student exits the test.

Test Security: Monitor Visits• State-trained monitors will monitor testing sessions in 5-

10% of buildings.

• KSDE will again do a combination of volunteers and random selections.

• The random sample will be a stratified sample—representative of small/large, rural/urban, elementary/middle/high, area of the state, etc.

• Visits are not optional—but they are also definitely NOT painful!

Monitor Visits• Please contact Mary Matthew to volunteer your school. • School Selection (sample) will by made by January 15 at

KSDE. FYI - If we don’t volunteer someone will be selected by KSDE!

• Monitor Team Members:• KAAC – Kansas Assessment Advisory Council• We will match monitors with buildings in January. • Monitors will contact districts test coordinators to obtain testing

schedule and set up visits.• PLEASE let monitors know if building testing dates change.

Monitor Checklist

Please review the Monitor Checklist to

become familiar with

requirements!

Monitor Checklist – what’s new?Verifies: District/Building test

coordinator has on file documentation of the need for each

Text to Speech (read-aloud) accommodation.

Observes Administration of a Text to Speech (Read Aloud) Accommodation: Please note method: Individually administered, Used Audio – No Human Reader, HeadsetsEvidence of Documentation provided matches District Coordinator information

NO HUMAN READERs• It is important to note that you may not read anything to

students except the directions!

• For any student who needs a Text to Speech (Read Aloud) Accommodation this must be done using the Audio feature of the new KITE system.

• Students must be registered for this feature and this was done after you complete and send in your Individual Student Improvement Plan to the District Office

What did we (Kansas) learn from our Monitor Visits in 2012-2013?

• Eighty-one (81) visits were scheduled statewide in a variety of schools from small rural districts to larger urban districts across the state.

• 60% of the schools selected during the 2012-2013 school year were unannounced visits. 6 schools did not receive visits due to scheduling issues.

• Visits were conducted at all levels: elementary, middle level and high school.

• Overall the visits were a success with only a few incidents reported as potential security breaches or areas to consider for strengthening the Test Security Plan for all districts across the state!

Positive Lessons Learned/Things to Consider/Incidents/Concerns

• People out in the field have taken Test Security seriously and are doing an excellent job of protecting the integrity of our assessments and assessment system.

• It was noted that districts and schools had good systems in place for providing training, distribution and collection of testing materials and reactivation!

Positive Lessons Learned/Things to Consider/Incidents/Concerns

• Three-fourths of the schools provided two test proctors in each testing room.

• This continues to be an excellent practice that is used across KS schools! Having two test proctors present should be considered as a Best Practice and when possible be the preferred method of testing.

Positive Lessons Learned/Things to Consider/Incidents/Concerns

• Although an improvement from the 2010-2011 and 2011-2012 school year, it was noted in a few reports that directions for testing were not read from the manual.

• Reading, Reviewing, Understanding the Examiner’s Manual – find time to do this before you sign off! (we hope these will be available mid January 2014)

Positive Lessons Learned/Things to Consider/Incidents/Concerns

• Once again, it was noted that test proctors should not be sitting at their desk, but should be up and moving around to monitor the testing environment.

Testing Fact Sheet states: • Actively monitor the testing session. Moving around the room encourages students to focus on their own work.

During/After Test Administration• Teachers (Test Proctors) should actively monitor the

testing environment by moving around the room.

• The teacher may verify the End Review Screen (KITE) to see that all test questions have been answered before a student exits the test. They may not go back and review each question individually with the student.

• Touching the MOUSE…• Student drives the mouse – not the teacher!• Exceptions…

Positive Lessons Learned/Things to Consider/Incidents/Concerns

• Schools did an excellent job of making sure students were not sitting side-by-side who had the same test form.

• Seating charts were provided at the time of monitor visits and monitor visitors were able to observe students being assigned different computers for testing based on ticket numbers.

Calculator Use

• Calculators – when calculators are provided by the school they should be “cleared” before the next group of students enters the testing environment.

• NO Problems noted in 2012-2013!

• Calculators in 2013-2014 – • New information posted on the KSDE website

Students may not bring and use a personal calculator! They must use the one in the test program.

Reporting Item Issues• Tremendous effort goes into the review of state

assessment items, but occasionally there is an error or a typo which gets by. Both KSDE and CETE want to be informed of item issues for review and follow-up.  If an error is verified it will be corrected and if necessary student scores will be adjusted.   However, due to test security issues we expect administrators and teachers to abide by the Test Security and Administration guidelines in the Examiner’s Manual. .

Process outlined on the Test Security Fact Sheet

Report Problem to District Test Coordinator (Stacey Hedges) who

forwards information to KSDE, CETE.

Positive Lessons Learned/Things to Consider/Incidents/Concerns:

• Test reactivation – it was noted in almost three-fourths of the reports that reactivation of tests were conducted at a centralized location separate from the school site (district office) and if reactivation was conducted at the building level this was done in a separate location from the actual testing room.

• Reactivation logs were kept with information noting reason for reactivation. It was noted reactivations should occur prior to examining student learning results.

Reactivation• The district testing coordinator is responsible for establishing the

process/system used by the district for reactivating students for the KCA. Some districts allow building test coordinators to do this. Others only allow the district office to reactivate. Teachers may not reactivate.

• Best practice is to have two people present when reactivating a student test. Teachers may not reactivate.

• If there is a need to reactivate a test session for a student, contact your district or building test coordinator and give them the student’s name, grade, subject, and the reason for reactivation. Reactivations will be done by District Test Coordinator

• A reactivation log must be kept on file with the District Test Coordinator.

Scores• Transition Assessment Scores -- No scores will be

made available until June or after! We might receive percent correct scores! If this changes we will let you know!

• New cut scores and four new performance bands are being established! (previously we had 5 performance level bands)

Performance on Old vs. NewOld State Assessment

2002-2013

Exemplary

Exceeds

Meets

Approaching

Warning

New State Assessment2014-2015

Exceeds

Meets

Below

Warning

Love it or List it – Answer Key!

“Imagine the Possible”

Possible vs. Impossible

Impossible Means:

“Felt to be incapable of being done, attained, or fulfilled”

Key word “Felt To Be” -- Doesn’t mean couldn’t be

What is felt to be impossible:

New Standards, New Tests, New Testing Software, New Evaluation Process, New Accreditation, New AMO Accountability,

Most of these we can’t control….so

We need to focus on what we can control…

Doing what is best for kids and Focusing on what we do best!!

EFFECTIVE TEACHING!

So Here is the Challenge:

“Become a “Possiblitarian”.

No matter how dark things seem to be or actually are, raise your sights and see

possibilities--always see them, for they’re always there.”

Norman Vincent Peale

Questions…