Acasestudyoftheimplementationofcomputer-basedtestingwithExamSoftTeresaKuhlman,Manager,PacificDentalHelixCurriculum

Dr.Meixun SinkyZheng,AssistantProfessorandInstructionalDesigner

Dr.DanielBender,AssistantDeanofAcademicAffairsandAssistantProfessor,DepartmentofDentalPractice

UniversityofthePacificArthurA.DugoniSchoolofDentistryOfficeofAcademicAffairs

Objectivesq Discussthevalue,challenges,andpitfallsofcomputer-basedtestinginonedentalschool.

q Describelayeredapproach,process,policies,andbestpracticesofExamSoft implementationforfaculty,staffandstudenttraining.

q ShareinitialoutcomesofExamSoft implementation.

Benefitsq Avarietyofquestiontypes

qCategories

q Instantanddetailedfeedback(comprehensiveexamreview)q In-depthreports

q also:categoryreport

q Opportunitiesforcollaborativetestdevelopmentq Individualizedlearningopportunity(e.g.,WesternRegionalExaminingBoard preparation:increasedstudentpreparednessforClinicalTreatmentPlanning)

Whobenefitsmost?

Whatdidwelearn?q Training:faculty,staff,students

q Establishimplementationgroupq Beta-testperiod:4months(faculty,IT,administrativestaff)q Selectforwardthinking,positive-mindedearlyadoptersqWeighexternalvs.internaltrainingoptionsq Distributedmodelofknowledgeandresponsibility

q BuildslowlyqNo/lowstakesà highstakes

q LayeredapproachprovedbestqIncreasedconfidence;addressed‘studentpushback’

Tobe…(ortry toappeartobe)

q Flexibleq Nimbleq Open-mindedq Preparedtorespondtotheunplanned

Howdidwelearn?

q Debrief(reflect)aftereach earlyexperienceq Listentostudent/facultyconcerns:absenceofclearpolicyq Reduceinconsistent,confusingmessagingq Alwaysaimfor“Yes”;no“No’s”q Encouragecreativefacultyuseanddiscovery

Outcomes(AY2015-16)

1. 58examsandquizzessuccessfullyadministeredinD1andI1classes• StudentsDON’TWANTpaperexams.

2. NumberofESmidtermexamsorquizzesbyquarter(allclasses):• Summer:37• Autumn:35• Winter:28

Outcomes(AY2015-16)3.Numberoffinalexaminationsbyquarter(all

classes):• Summer:87%(13/15)• Autumn:92%(12/13)• Winter:91%(10/11)

4.MorethanhalfofcourseswhereusewasoptionalelectedtouseES.(22/41)

Outcomes(AY2015-16)## unsolicitedpositivefeedbackfromstudents

andfaculty(3favoriteexamples)

$ $ $ questions,uncertainty,fear

•distributedmodelofimplementationguidescurrentLMSimplementation• establishesfamiliarandnecessarycontinuityofprocess

Examplesofexam reports

q Summaryreportq StrengthsandImprovementopportunitiesq Categoryreport

Summaryreport

Summaryreport

Summaryreport

StrengthsandImprovementOpportunitiesreport

Categoryreport:Wholeclass

Categoryreport:Individualstudent

Q&A

Whenweteachwelearn;whenwelearnweteach.