Te4Q Educational Project Review

Measuring the Impact of the Te4Q Faculty development program at Marshall University JCESOM and its affiliates.

Darshana Shah, Ph.D., Paulette Wehner, MD. And Jim Becker, MD.

Marshall University Joan C. Edwards School Medicine.

Over Arching Purpose:

To build collaborative culture of quality improvement and patient safety

Goal/Aim To examine the relationship among structured

professional development program for quality improvement , organizational culture, and selected outcomes for a scholarly quality improvement project

Identify participant satisfaction, planned action, and knowledge increase

Determine the success with the implementation of skills acquired from the program

Identify any enablers and barriers to application of the acquired knowledge

Compare the benefits of the program to the costs

Learning Objectives• Identify Hard and Soft data indicators to measure

faculty development success

Educational Design and Strategies

4-Results – tangible

outcomes related to

level 2, 3 & 4

3- Behavior – doing something differently as a result of Te4Q program

2- Learning – improved knowledge, increased skill

Pre/Post survey

1- Engagement

Participants Reaction and

perception of Te4Q

4. Results o Patient Quality and Safety

Outcome Patient satisfaction

survey Intervention/ Training Related

to QI/PS

o Education Implementation of Te4Q

curriculum student & Residents

Te4Q -related professional presentations, publications

3. Commitment to change # of implemented project proposal Observation of actual performance

1. 2. Knowledge /Attitude surveys

Retro pre-post survey on Perceived mastery of TeQ4 learning Objectives

1. Engagement: Participants’ Reaction

Post workshop -Participant Survey-

IMPACT Measured in terms of ROI

Kirkpatrick Model: Five- Level Framework

Level of Evaluation 

Measurement Focus 

1- Reaction  Measures participant satisfaction with Te4Q faculty development

2- Learning 

Measures changes in knowledge, skills, and attitudes

3- Behavior change or application

Measures changes in terms of Te4Q projects implementation and any activities they do differently on-the-job

4. Results (overall institutional results)

How does the entire institution benefit from the improvement of the faculty development activities

5- Return on Investment (ROI) How do the benefit of the Te4Q faculty development activity compare to the cost?

Impact Measured in Terms of ROI

Develop

Objectives of improvement

program

Develop Evaluation Plan and desired

Baseline data

Collect data during Te4Q

program implementatio

n

Collect Data After Program Implementatio

n

Evaluation planning Data Collection

Level-1 &2

Level-3-5

Isolate theeffect of each project

Convert Data to

Monetary Value

Convert Data To Monetary Value

Identify Intangible measure

Additional Activities

Are there other educational activities aside from this project that you will implement?

- Resurrection of the Quality Assurance Committee (monthly meetings to raise environmental awareness)

- Annual Joint Sponsorship of QI Poster Day- Sponsorship of one- two residents to IHI

Conference- Obtained Dean support to require QI training of

faculty and specified staff

TeQ4Measure of Success

Hard Data Soft Data

QI Poster Presentation – All teaching programs represented

Patient Satisfaction

GME Purchase of AMA IPA Program Improved team work ( Increase # of Collaborative projects)

Increase efforts of mapping QI/PS efforts between MH and MUSOM

Increased numbers of identified gaps in education

Increased numbers of faculty certified in PS/QI

Increase numbers of staff certified in PSQI