Transcript
Page 1: CESP Study Session #2 January 2017

www.caveon.com1

Certified Exam Security Professional

CESP Exam Prep Session #2

Competencies 6-10

Page 2: CESP Study Session #2 January 2017

www.caveon.com2

Today’s Presenter

Jamie Mulkey, Ed.D.Executive Director, CESP

Program

Page 3: CESP Study Session #2 January 2017

www.caveon.com3

Agenda• Exam Overview• The second five competencies• Important resources for you• Dissect DOMC questions• Allow you to ask questions• Additional support

Page 4: CESP Study Session #2 January 2017

www.caveon.com4

CESP Overview

• Fifteen competencies• Adaptive Test• All DOMC items– www.trydomc.com

Page 5: CESP Study Session #2 January 2017

www.caveon.com5

Today’s focus:

• Competency 6: Exam Publication and Storage of Test Content at Testing Locations

• Competency 7: Exam Administration• Competency 8: Data Forensics• Competency 9: Physical Security• Competency 10: Information

Technology Security

Page 6: CESP Study Session #2 January 2017

www.caveon.com6

Super DOMC

Page 7: CESP Study Session #2 January 2017

www.caveon.com7

Competency 6: Exam Publication and Storage of Test Content at Testing Locations• CCSSO - Operational Best

Practices for Statewide Large-Scale Assessment Programs 2013– Ch 10-12

• The ITC Guidelines on the Security of Tests, Examinations, and Other Assessments– Pp 15-17

• The Standards for Educational and Psychological Testing

Page 8: CESP Study Session #2 January 2017

www.caveon.com8

DOMC practice item #1

A testing organization that administers computer-based exams wants to decrease the likelihood of items being stolen at the time of test publication and distribution.

Will this help decrease items being stolen?

Page 9: CESP Study Session #2 January 2017

www.caveon.com9

DOMC practice item #1Polls 1, 2 & 3

Page 10: CESP Study Session #2 January 2017

www.caveon.com10

Competency 7: Exam Administration

• Handbook of Test Security • Chapter 3, 4, 7• TILSA Guidebook• p15-16• The ITC Guidelines on the

Security of Tests, Examinations, and Other Assessments

• Proctoring Best Practices

Page 11: CESP Study Session #2 January 2017

www.caveon.com11

DOMC practice item #2Is this statement about proctoring a high-stakes computerized test accurate?

Page 12: CESP Study Session #2 January 2017

www.caveon.com12

DOMC practice item #2Polls 4, 5 & 6

Page 13: CESP Study Session #2 January 2017

www.caveon.com13

Competency 8:Data Forensics• Handbook of Test Security (Chapter 8)• Unlocking the mystery of the validity triangle

(Webinar)• Considering how to detect cheating? Policies and

procedures first (Blog)• Keeping your Rock Garden Tidy; Measure and

Manage your Test Security Risks (Blog)• A Method for Measuring Performance

Inconsistency by Using Score Difference (Whitepaper)

• A Method for Detecting Pre-knowledge of Exam Content Using Response Latencies (Whitepaper)

• NEW! Handbook of Quantitative Methods for Detecting Cheating on Tests (Educational Psychology Handbook)

Page 14: CESP Study Session #2 January 2017

www.caveon.com14

DOMC practice item #3

Would this data forensics analysis result cause you to suspect that an examinee was attempting to copy items from nearby test taker?

Page 15: CESP Study Session #2 January 2017

www.caveon.com15

DOMC practice item #3Polls 7, 8 & 9

Page 16: CESP Study Session #2 January 2017

www.caveon.com16

Competency 9: Physical Security

• Handbook of Test Security (Chapter 7)

• TILSA Guidebook (Section 10)

• The ITC Guidelines on the Security of Tests, Examinations, and Other Assessments

Page 17: CESP Study Session #2 January 2017

www.caveon.com17

DOMC Practice item #4

A company is considering the installation of card key access for its test publication department.

What will this security measure likely provide to the testing organization?

Page 18: CESP Study Session #2 January 2017

www.caveon.com18

DOMC practice item #4Polls 10, 11 & 12

Page 19: CESP Study Session #2 January 2017

www.caveon.com19

Competency 10: Information Technology Security

• Handbook of Test Security (Chapter 7)• TILSA Guidebook (Section 11)• Risk Management - The Keys to

Secure Data Management (Whitepaper)

• Risk Management: Catch Me If You Can, the Top ten Cheaters on High Stakes Exams (Blog)

Page 20: CESP Study Session #2 January 2017

20

DOMC practice item #5

www.caveon.com

• The test development department of an assessment program experienced a breach: A secure item bank file that was sent to a commercial print vendor was accidentally placed on a non-secure server and subsequently leaked to the Internet.

• Will instituting this procedure reduce the likelihood of a similar breach in the future?

Page 21: CESP Study Session #2 January 2017

www.caveon.com21

DOMC Practice item #5Polls 13, 14 & 15

Page 22: CESP Study Session #2 January 2017

• Cost of exam is $175 for each attempt

• Must have a background check prior to becoming certified

• You may attempt the exam 2 times

• Three month wait after 2nd failed attempt

• No more than 5 attempts without permission

Exam Cost and Retake Policy

www.caveon.com

Page 23: CESP Study Session #2 January 2017

www.caveon.com23

Obtaining Level 2 Certification• Must obtain a score of

170 on the exam• May retake exam up to

two times, after passing the level 1 exam

• 3 month waiting period after 2nd failed attempt

Page 24: CESP Study Session #2 January 2017

www.caveon.com24

Additional Support• Join the LinkedIn CESP

group – discuss test security topics

• Receive our monthly CSI Newsletter

• Contact us: [email protected]

Page 25: CESP Study Session #2 January 2017

www.caveon.com25

Next Steps• Obtain resources• Network with others

interested in the exam

• Set a schedule for reading/studying on a regular basis

Page 26: CESP Study Session #2 January 2017

www.caveon.com26

Thank you!

Next Exam prep session: TBA

Jamie Mulkey, Ed.D.Executive Director, CESP Program

[email protected]