CESP Study Session #2 January 2017

  • View
    110

  • Download
    0

Embed Size (px)

Text of CESP Study Session #2 January 2017

Slide 1

www.caveon.com1Certified Exam Security ProfessionalCESP Exam Prep Session #2

Competencies 6-10

TristianHow the webinar idea came aboutWe know people are struggling with DOMC and trying to find time to prepare for the examGives people an opportunity to help themselves project manage

1

www.caveon.com2

Todays PresenterJamie Mulkey, Ed.D.Executive Director, CESP Program

TristianIntroduce Jamie as the Executive Director2

AgendaExam OverviewThe second five competenciesImportant resources for youDissect DOMC questionsAllow you to ask questionsAdditional supportwww.caveon.com3

We will not focus on the registration mechanics or the candidate handbook.3

CESP Overviewwww.caveon.com4

Fifteen competenciesAdaptive TestAll DOMC itemswww.trydomc.com

Important to practice with item type. Test taking strategies will differ from MC test item taking4

Todays focus:Competency 6: Exam Publication and Storage of Test Content at Testing LocationsCompetency 7: Exam AdministrationCompetency 8: Data ForensicsCompetency 9: Physical SecurityCompetency 10: Information Technology Security

www.caveon.com5

Super DOMCwww.caveon.com6

Competency 6: Exam Publication and Storage of Test Content at Testing LocationsCCSSO - Operational Best Practices for Statewide Large-Scale Assessment Programs 2013Ch 10-12The ITC Guidelines on the Security of Tests, Examinations, and Other AssessmentsPp 15-17The Standards for Educational and Psychological Testingwww.caveon.com7

Suggested additional webinar: The Handbook of Test SecurityWebinar -Download slides(.pdf)

7

DOMC practice item #1 www.caveon.com8A testing organization that administers computer-based exams wants to decrease the likelihood of items being stolen at the time of test publication and distribution.

Will this help decrease items being stolen?

A testing organization that administers computer-based exams wants to decrease the likelihood of items being stolen at time of test publication and distribution.

Will this help decrease items being stolen?1 yes - Conduct secret shopping at several identified testing sites in order to determine if item harvesting is prevalent.2 no - Restrict access to the testing organization's item banking system to only key personnel.3 yes - Look for strange test administration patterns at test sites, such as an exam being administered outside of normal business hours.8

www.caveon.com9DOMC practice item #1Polls 1, 2 & 3

John9

Competency 7: Exam AdministrationHandbook of Test Security Chapter 3, 4, 7TILSA Guidebookp15-16The ITC Guidelines on the Security of Tests, Examinations, and Other AssessmentsProctoring Best Practiceswww.caveon.com10

DOMC practice item #2Is this statement about proctoring a high-stakes computerized test accurate?www.caveon.com11

No - Test takers should be allowed to wear a watch and drink a beverage in the testing environment.Yes - The proctor should not perform unrelated and routine clerical tasks during the test administration.Yes - In a computerized test administration environment, the proctor should walk around the testing room in order to observe test taker behavior.11

www.caveon.com12DOMC practice item #2Polls 4, 5 & 6

John12

Competency 8:Data ForensicsHandbook of Test Security (Chapter 8)Unlocking the mystery of the validity triangle (Webinar)Considering how to detect cheating? Policies and procedures first (Blog)Keeping your Rock Garden Tidy; Measure and Manage your Test Security Risks (Blog)A Method for Measuring Performance Inconsistency by Using Score Difference (Whitepaper)A Method for Detecting Pre-knowledge of Exam Content Using Response Latencies (Whitepaper)NEW! Handbook of Quantitative Methods for Detecting Cheating on Tests (Educational Psychology Handbook)www.caveon.com13

13

DOMC practice item #3www.caveon.com14Would this data forensics analysis result cause you to suspect that an examinee was attempting to copy items from nearby test taker?

1. Yes - The examinee has similar response patterns to a nearby test taker.2. No - The examinee has better performance on items that are common across multiple forms.3. No - The examinee has better performance on the non-scored items than on the scored items.14

www.caveon.com15DOMC practice item #3Polls 7, 8 & 9

John15

Competency 9: Physical SecurityHandbook of Test Security (Chapter 7)TILSA Guidebook (Section 10)The ITC Guidelines on the Security of Tests, Examinations, and Other Assessmentswww.caveon.com16

DOMC Practice item #4A company is considering the installation of card key access for its test publication department.

What will this security measure likely provide to the testing organization?www.caveon.com17

Yes - a record of everyone entering and exiting the department No - a theft-proof item banking systemNo - restricted work hours for the test publication department

2 no

17

www.caveon.com18DOMC practice item #4Polls 10, 11 & 12

John18

Competency 10: Information Technology SecurityHandbook of Test Security (Chapter 7)TILSA Guidebook (Section 11)Risk Management - The Keys to Secure Data Management (Whitepaper)Risk Management: Catch Me If You Can, the Top ten Cheaters on High Stakes Exams (Blog)www.caveon.com19

DOMC practice item #5www.caveon.com20The test development department of an assessment program experienced a breach: A secure item bank file that was sent to a commercial print vendor was accidentally placed on a non-secure server and subsequently leaked to the Internet.

Will instituting this procedure reduce the likelihood of a similar breach in the future?

Yes - creating a test publication schedule that sends a only subset of the test's bank to the printer at any given time Yes - ensuring that test files are encrypted, with very few individuals having access to the encryption keyNo - requiring contractors to wait a specified number of days before being able to download files onto the system20

www.caveon.com21DOMC Practice item #5Polls 13, 14 & 15

John21

Cost of exam is $175 for each attemptMust have a background check prior to becoming certifiedYou may attempt the exam 2 times Three month wait after 2nd failed attemptNo more than 5 attempts without permission

Exam Cost and Retake Policywww.caveon.com

22

Obtaining Level 2 CertificationMust obtain a score of 170 on the examMay retake exam up to two times, after passing the level 1 exam3 month waiting period after 2nd failed attemptwww.caveon.com23

Additional SupportJoin the LinkedIn CESP group discuss test security topicsReceive our monthly CSI Newsletter Contact us: [email protected]

www.caveon.com24

24

Next StepsObtain resourcesNetwork with others interested in the exam Set a schedule for reading/studying on a regular basiswww.caveon.com25

Thank you!Next Exam prep session: TBA

Jamie Mulkey, Ed.D.Executive Director, CESP [email protected] www.caveon.com26

Search related