CESP Study Session #1 October 2016

  • View
    32

  • Download
    1

Embed Size (px)

Text of CESP Study Session #1 October 2016

Slide 1

www.caveon.com1Certified Exam Security ProfessionalCESP Exam Prep Session #1

Competencies 1-5

TristianHow the webinar idea came aboutWe know people are struggling with DOMC and trying to find time to prepare for the examGives people an opportunity to help themselves project manage

1

www.caveon.com2

Todays PresenterJamie Mulkey, Ed.D.Executive Director, CESP Program

TristianIntroduce Jamie as the Executive Director2

AgendaExam OverviewThe first five competenciesImportant resources for youDissect DOMC questionsAllow you to ask questionsAdditional supportwww.caveon.com3

We will not focus on the registration mechanics or the candidate handbook.3

CESP Overviewwww.caveon.com4

Fifteen competenciesAdaptive TestAll DOMC items

Important to practice with item type. Test taking strategies will differ from MC test item taking4

General ResourcesStandards for Educational and Psychological TestingCopyright Registration of Secure TestsExam Security Breach Summarieswww.caveon.com5

Why each of these resources is important to study5

Competency 1: Exam Security BasicsHandbook of Test Security - Chapters 3 and 6TILSA GuidebooksTest Security and the 2014 Testing Standards - Presentation by Wayne Camarawww.caveon.com6

DOMC practice item #1A college admissions testing program was alerted through an anonymous email that students are posting test questions to a specific social media site. Subsequent investigation confirmed that this site had been operational for approximately 6 months, and several forms of the testing program's exam have been affected.

Is this a proper recommendation for how the program should respond to the threat found on this social media site?www.caveon.com7

When we take a MC test, we are able to see all distractors and eliminate options. However, with DOMC, you need take each option at its face value and decide if its correct or not.1 yes2 yes3 no7

www.caveon.com8DOMC practice item #1Polls 1, 2 & 3

John8

DOMC practice item #1

Is this a proper recommendation for how the program should respond to the threat found on this social media site?

Send a DMCA letter to the social media site to have the test content taken down.Run routine data forensics analyses to detect if test takers are scoring well on the posted items.Randomize the order of the presentation of test questions.

Polls 1, 2 & 3

www.caveon.com9

1 yes why correct2 yes why correct3 no why incorrect

Does anyone have any questions? Please type in text box9

Competency 2: Exam Security PlanningHandbook of Test SecurityBook - Chapter 6 pp 127-146TILSA GuidebookAppendices C & DThe ITC Guidelines on the Security of Tests, Examinations, and Other AssessmentsBook - pp 9-14

www.caveon.com10

DOMC practice item #2You've been asked by your manager, the Director of Test Security, to create an outline for a Test Security Plan.

Should this be included in your outline of the plan?www.caveon.com11

1 yes2 no3 no11

www.caveon.com12DOMC practice item #2Polls 4, 5 & 6

John12

DOMC practice item #2

Should this be included in your outline of the plan?

the test security goals for the organizationa list of all the test administration site locations and addressesthe steps for test publication

Polls 4, 5 & 6

www.caveon.com13

1 yes why correct2 no why incorrect3 no why incorrect13

Competency 3: Legal considerationsHandbook of Test SecurityChapter 11Protecting Your Tests Using Copyright LawWebinar Exam Integrity Investigations: An Introduction to the EssentialsWebinar Copyright Registration of Secure TestsCaveon Data Forensics Legal Defensibility

www.caveon.com14

DOMC practice item #3A former item development contractor for a testing program has written a test preparation guide in order to prepare candidates for an exam that the contractor helped to create. The program is concerned that the items in the book will be substantially similar to actual items on the test.

Is this action one that the testing program can take to prevent or minimize this type of security problem?www.caveon.com15

1. yes2. No3. Yes 15

www.caveon.com16DOMC practice item #3Polls 7, 8 & 9

John16

DOMC practice item #3

Is this action one that the testing program can take to prevent or minimize this type of security problem?

Require the item development contractor to enter into a non-disclosure agreement with the testing program.When the contractor leaves the company, require that the item development contractor give a license to the program for all rights to the items that the contractor created.Require the item development contractor to enter into a no-competition agreement with the testing program.

Polls 7, 8 & 9

www.caveon.com17

1. yes2. No3. Yes 17

Competency 4: Exam Planning and DesignThe Discrete Option Multiple Choice Test Item: An Important Step in Test and Item DesignHandbook of Test SecurityChapter 3 p64-71Overexposure - A Problem for Certification Testswww.caveon.com18

DOMC practice item #4www.caveon.com19A professional credentialing testing program manager wants to know how a test's design can be implemented so that it will deter the improper use of Internet braindump sites by program constituents.

Is this correct advice to offer to the program manager?

19

www.caveon.com20DOMC practice item #4Polls 10, 11 & 12

John20

DOMC practice item #4www.caveon.com21

Is this correct advice to offer to the program manager?

Add inconspicuous characters and text to the exam items in order to determine when and where the items were stolen.Implement Trojan Horse items, and use the resulting scoring information to invalidate scores where appropriate.Place a score hold on all exams until they can be validated.

Polls 10, 11 & 12

21

Competency 5: Exam DevelopmentThe ITC Guidelines on the Security of Tests, Examinations, and Other Assessmentspp 16-18Number of short blogs

www.caveon.com22

DOMC Practice item #5Is the following a practice you would recommend to a test development manager in order to improve test development security when facilitating a remote test item review session?

www.caveon.com23

1 yes2 no

23

www.caveon.com24DOMC Practice item #5Polls 13, 14 & 15

John24

DOMC Practice item #5Is the following a practice you would recommend to a test development manager in order to improve test development security when facilitating a remote test item review session?

Item reviewers should only review a portion of the total number of items in order to limit item exposure.Item reviewers are allowed to download items onto their personal computer in order to review and make changes.Give item reviewers access to a secure shared file where the items reside.

Polls 13, 14 & 15

www.caveon.com25

1. yes2. no3. yes

25

Cost of exam is $175 for each attemptNEW! Must have a background check prior taking the examYou may attempt the exam 2 times Three month wait after 2nd failed attemptNo more than 5 attempts without permission

Exam Cost and Retake Policywww.caveon.com

26

Obtaining Level 2 CertificationMust obtain a score of 170 on the examMay retake exam up to two times, after passing the level 1 exam3 month waiting period after 2nd failed attemptwww.caveon.com27

Additional SupportJoin the LinkedIn CESP group discuss test security topicsReceive our monthly CSI Newsletter Contact us: info@cespcert.org

www.caveon.com28

28

Next StepsObtain resourcesNetwork with others interested in the exam Set a schedule for reading/studying on a regular basiswww.caveon.com29

Thank you!Next Exam prep session: Wed, Nov 16, 2016

Jamie Mulkey, Ed.D.Executive Director, CESP Programjamie.mulkey@cespcert.org www.caveon.com30