Slide 1
www.caveon.com1Certified Exam Security ProfessionalCESP Exam Prep Session #2
Competencies 6-10
TristianHow the webinar idea came aboutWe know people are struggling with DOMC and trying to find time to prepare for the examGives people an opportunity to help themselves project manage
1
www.caveon.com2
Todays PresenterJamie Mulkey, Ed.D.Executive Director, CESP Program
TristianIntroduce Jamie as the Executive Director2
AgendaExam OverviewThe second five competenciesImportant resources for youDissect DOMC questionsAllow you to ask questionsAdditional supportwww.caveon.com3
We will not focus on the registration mechanics or the candidate handbook.3
CESP Overviewwww.caveon.com4
Fifteen competenciesAdaptive TestAll DOMC itemswww.trydomc.com
Important to practice with item type. Test taking strategies will differ from MC test item taking4
Todays focus:Competency 6: Exam Publication and Storage of Test Content at Testing LocationsCompetency 7: Exam AdministrationCompetency 8: Data ForensicsCompetency 9: Physical SecurityCompetency 10: Information Technology Security
www.caveon.com5
Super DOMCwww.caveon.com6
Competency 6: Exam Publication and Storage of Test Content at Testing LocationsCCSSO - Operational Best Practices for Statewide Large-Scale Assessment Programs 2013Ch 10-12The ITC Guidelines on the Security of Tests, Examinations, and Other AssessmentsPp 15-17The Standards for Educational and Psychological Testingwww.caveon.com7
Suggested additional webinar: The Handbook of Test SecurityWebinar -Download slides(.pdf)
7
DOMC practice item #1 www.caveon.com8A testing organization that administers computer-based exams wants to decrease the likelihood of items being stolen at the time of test publication and distribution.
Will this help decrease items being stolen?
A testing organization that administers computer-based exams wants to decrease the likelihood of items being stolen at time of test publication and distribution.
Will this help decrease items being stolen?1 yes - Conduct secret shopping at several identified testing sites in order to determine if item harvesting is prevalent.2 no - Restrict access to the testing organization's item banking system to only key personnel.3 yes - Look for strange test administration patterns at test sites, such as an exam being administered outside of normal business hours.8
www.caveon.com9DOMC practice item #1Polls 1, 2 & 3
John9
Competency 7: Exam AdministrationHandbook of Test Security Chapter 3, 4, 7TILSA Guidebookp15-16The ITC Guidelines on the Security of Tests, Examinations, and Other AssessmentsProctoring Best Practiceswww.caveon.com10
DOMC practice item #2Is this statement about proctoring a high-stakes computerized test accurate?www.caveon.com11
No - Test takers should be allowed to wear a watch and drink a beverage in the testing environment.Yes - The proctor should not perform unrelated and routine clerical tasks during the test administration.Yes - In a computerized test administration environment, the proctor should walk around the testing room in order to observe test taker behavior.11
www.caveon.com12DOMC practice item #2Polls 4, 5 & 6
John12
Competency 8:Data ForensicsHandbook of Test Security (Chapter 8)Unlocking the mystery of the validity triangle (Webinar)Considering how to detect cheating? Policies and procedures first (Blog)Keeping your Rock Garden Tidy; Measure and Manage your Test Security Risks (Blog)A Method for Measuring Performance Inconsistency by Using Score Difference (Whitepaper)A Method for Detecting Pre-knowledge of Exam Content Using Response Latencies (Whitepaper)NEW! Handbook of Quantitative Methods for Detecting Cheating on Tests (Educational Psychology Handbook)www.caveon.com13
13
DOMC practice item #3www.caveon.com14Would this data forensics analysis result cause you to suspect that an examinee was attempting to copy items from nearby test taker?
1. Yes - The examinee has similar response patterns to a nearby test taker.2. No - The examinee has better performance on items that are common across multiple forms.3. No - The examinee has better performance on the non-scored items than on the scored items.14
www.caveon.com15DOMC practice item #3Polls 7, 8 & 9
John15
Competency 9: Physical SecurityHandbook of Test Security (Chapter 7)TILSA Guidebook (Section 10)The ITC Guidelines on the Security of Tests, Examinations, and Other Assessmentswww.caveon.com16
DOMC Practice item #4A company is considering the installation of card key access for its test publication department.
What will this security measure likely provide to the testing organization?www.caveon.com17
Yes - a record of everyone entering and exiting the department No - a theft-proof item banking systemNo - restricted work hours for the test publication department
2 no
17
www.caveon.com18DOMC practice item #4Polls 10, 11 & 12
John18
Competency 10: Information Technology SecurityHandbook of Test Security (Chapter 7)TILSA Guidebook (Section 11)Risk Management - The Keys to Secure Data Management (Whitepaper)Risk Management: Catch Me If You Can, the Top ten Cheaters on High Stakes Exams (Blog)www.caveon.com19
DOMC practice item #5www.caveon.com20The test development department of an assessment program experienced a breach: A secure item bank file that was sent to a commercial print vendor was accidentally placed on a non-secure server and subsequently leaked to the Internet.
Will instituting this procedure reduce the likelihood of a similar breach in the future?
Yes - creating a test publication schedule that sends a only subset of the test's bank to the printer at any given time Yes - ensuring that test files are encrypted, with very few individuals having access to the encryption keyNo - requiring contractors to wait a specified number of days before being able to download files onto the system20
www.caveon.com21DOMC Practice item #5Polls 13, 14 & 15
John21
Cost of exam is $175 for each attemptMust have a background check prior to becoming certifiedYou may attempt the exam 2 times Three month wait after 2nd failed attemptNo more than 5 attempts without permission
Exam Cost and Retake Policywww.caveon.com
22
Obtaining Level 2 CertificationMust obtain a score of 170 on the examMay retake exam up to two times, after passing the level 1 exam3 month waiting period after 2nd failed attemptwww.caveon.com23
Additional SupportJoin the LinkedIn CESP group discuss test security topicsReceive our monthly CSI Newsletter Contact us: [email protected]
www.caveon.com24
24
Next StepsObtain resourcesNetwork with others interested in the exam Set a schedule for reading/studying on a regular basiswww.caveon.com25
Thank you!Next Exam prep session: TBA
Jamie Mulkey, Ed.D.Executive Director, CESP [email protected] www.caveon.com26
