Amy Sullivan, EdD HMS Academy Fellowship in Medical Education Research March 30, 2017

EVALUATION RESEARCH: Part 3 Evaluating Technology-Enhanced Learning

Today:1. Review upcoming presentations2. Theory du jour: cognitive load (Cindy)3. Presentation/discussion of TEL (Amy)4. Article: The importance of educational theories for facilitating learning when using technology in medical education (Dorothy)5. Group project discussion

TELWhat forms does it take?

• Online courses (synchronous/asynchronous)/MOOCs• Offline (DVD)• Apps• Games• Virtual patient• Flipped classroom• Online discussions• Quizzes• Standalone or blended

Potential benefits• Analytics• Access• Adaptivity• Assessment• Agility• Flexibility• Control

Cook&Triola2014

Technology

The“hypecycle”Thetechnology“hype”cycle

https://www.qmprogram.org/qmresources/research/

https://onlinelearningconsortium.org/

Web-basedmoduletoteachVTEmanagement

https://www.interaction-design.org/literature/article/usability-a-part-of-the-user-experience

https://www.nngroup.com/articles/usability-101-introduction-to-usability/

Usability

Testingwith5usersisusuallyenough

Cost

• Hard to measure!• Use quantitative & qualitative data• Consider launching “minimal viable product”• ROI—Cook recommends addressing the

following questions:

Our projects

• What TEL components are you using (or might you consider using)?

• How will you (or might you) evaluate these components?