Course and Teacher

Evaluation

David Taylor

School of Medicine

What should we attend to?

Evaluation is a key part of learning.

It is at the top of the taxonomy….

But without reflection it is valueless.

Taxonomy

Bloom/Atherton

Evaluation also helps us to develop

• As teachers

• And also to develop our programmes

How people learn

Reflect

and observe

Develop new

concepts

Experiment or

articulate

Existing knowledge

Reflect

organise

Fe

ed

ba

ck

Reflect

Consolidate

Elaboration

Refinement

Start here

Dissonance

Task

Resources

Motivation Stage of

Development

Learning style

Taylor and Hamdy 2013

Models

• There are several models for evaluation, but

the most useful, I find is

• Kirkpatrick’s

Kirkpatrick (1959) (and Phillips 2007)

This applies everywhere

The easiest thing to do is measure satisfaction.

But is this actually the most important thing?

Language

There are three words, that are used

interchangeably, but which mean different

things to different people.

• Feedback

• What we give to each other.

• Assessment

• A demonstration of what has be learned

• Evaluation

• The change in behaviour that results from what

we have done (Kirkpatrick)

In our context

And pretty well everywhere outside the US

• Evaluation is the process we go through as

we reflect upon our performance.

• I would say that it includes all three elements

• Feedback, assessment, reflection

• And all five levels of Kirkpatrick and Phillips

• Satisfaction, learning, impact, results,ROI

And is cyclical

Reflect

and observe

Develop new

concepts

Experiment or

articulate

Existing knowledge

Reflect

organise F

ee

db

ack

Reflect

Consolidate

Elaboration

Refinement

Start here

Dissonance

Taylor and Hamdy 2013

Evaluation is

• An important component of any educational

activity

• A purposeful, not “feel good” factor

• Dynamic, active rather than passive:

• potential to create change

• Cyclical and responsive:

• potential to drive change

• About giving a direction for the future

So how would you assess….

Possible methods

• Questionnaires

• Examination results

• Live scoring

• Focus groups interviews

• Success in future examinations

• Student conversations after the activity

• Changes in behaviour

More systematically….

Level

Satisfaction

Knowledge

Behaviours

Results

Objective

Measure it

Measure changes in k,s,a,

Measure the change in behaviour

Measure the impact

Mechanism

Component review

Academic achievements and

attendance

Pre- and post measurement of the

capabilities

Measure the impact

Return on investment?

What do you think?