TRAINING EVALUATIONTRAINING EVALUATION

WHAT?WHAT? WHY?WHY? HOW?HOW? SO WHAT?SO WHAT?

DefinitionDefinition

Any attempt to obtain information Any attempt to obtain information (feedback) on the effects of a training (feedback) on the effects of a training program, and to assess the value of the program, and to assess the value of the training in the light of that informationtraining in the light of that information

A continuum of methodologyA continuum of methodology An applied researchAn applied research Literature suggests the use of formal, Literature suggests the use of formal,

systematic, and comprehensive systematic, and comprehensive evaluation evaluation

Evaluation: Part of Planning Evaluation: Part of Planning

Training needs analysisTraining needs analysis Setting objectivesSetting objectives Determining subject contentDetermining subject content Selecting participantsSelecting participants Determining the best scheduleDetermining the best schedule Selecting appropriate facilitiesSelecting appropriate facilities

Selecting appropriate instructorsSelecting appropriate instructors Selecting and preparing audiovisual Selecting and preparing audiovisual

aidsaids Coordinating the programCoordinating the program Evaluating the programEvaluating the program

Purpose of EvaluationPurpose of Evaluation

To decide whether to continue or To decide whether to continue or discontinue training programsdiscontinue training programs

To gain information on how to To gain information on how to improve future training programsimprove future training programs

To provide feedback to training To provide feedback to training program stakeholdersprogram stakeholders

To assess changes in attitude, To assess changes in attitude, knowledge, skills, & impact of knowledge, skills, & impact of training programtraining program

To justify the existence of HRD To justify the existence of HRD sectionsection

Kirkpatrick: The Four Levels of Kirkpatrick: The Four Levels of Training EvaluationTraining Evaluation

Level 1: ReactionLevel 1: Reaction

Level 2: LearningLevel 2: Learning

Level 3: BehaviorLevel 3: Behavior

Level 4: ResultsLevel 4: Results

Evaluating ReactionEvaluating Reaction

A measure of participant reactions to A measure of participant reactions to show their satisfaction levelsshow their satisfaction levels

Satisfactions toward training Satisfactions toward training variables such as administration, variables such as administration, program, facilities, teaching, etc.program, facilities, teaching, etc.

Positive or favorable reactions are Positive or favorable reactions are desirabledesirable

Guidelines for Evaluating ReactionGuidelines for Evaluating Reaction

Determine what you want to find outDetermine what you want to find out Design a form that will quantify Design a form that will quantify

reactionsreactions Encourage written Encourage written

comments/suggestionscomments/suggestions Get 100% immediate responseGet 100% immediate response Develop acceptable standardsDevelop acceptable standards Communicate findings as appropriateCommunicate findings as appropriate

Evaluating LearningEvaluating Learning

Educational program involves change Educational program involves change in attitude, knowledge or skillsin attitude, knowledge or skills

The objective of training program The objective of training program must change at least one elementmust change at least one element

Guidelines for Evaluating LearningGuidelines for Evaluating Learning

Use a control group if practicalUse a control group if practical Evaluate pre and post Evaluate pre and post Use appropriate instrumentsUse appropriate instruments Get 100% responseGet 100% response Use the findings to take appropriate Use the findings to take appropriate

actionaction

Evaluating BehaviorEvaluating Behavior

Practice in workplacePractice in workplace Application of learned knowledge, Application of learned knowledge,

skills & attitudeskills & attitude Transfer of trainingTransfer of training Depends on many factors such as Depends on many factors such as

time, facilities, organizational time, facilities, organizational climate, etc.climate, etc.

Guidelines for Evaluating BehaviorGuidelines for Evaluating Behavior

Use a control group if practicalUse a control group if practical Allow time for behavior change to Allow time for behavior change to

take placetake place Evaluate pre and postEvaluate pre and post Get data from various resourcesGet data from various resources Get 100% response or a samplingGet 100% response or a sampling Repeat the evaluation at appropriate Repeat the evaluation at appropriate

timestimes Consider cost versus benefitsConsider cost versus benefits

Evaluating ResultsEvaluating Results

Impact of training programImpact of training program Personal, family, society, Personal, family, society,

organizational, & nationorganizational, & nation Increased production, improved Increased production, improved

quality, increased sales, higher quality, increased sales, higher profit, decreased costs, reduced profit, decreased costs, reduced complaints, reduced turnover, etc.complaints, reduced turnover, etc.

Indirect & long termIndirect & long term

Guidelines for Evaluating ResultsGuidelines for Evaluating Results

Use a control group if practicalUse a control group if practical Allow time for results to be achievedAllow time for results to be achieved Measure pre and postMeasure pre and post Repeat the measurement at Repeat the measurement at

appropriate timesappropriate times Consider cost versus benefitsConsider cost versus benefits Be satisfied with evidence if proof is Be satisfied with evidence if proof is

not possiblenot possible

Instruments, Analysis, Reporting, Instruments, Analysis, Reporting, Acting of Evaluation FindingsActing of Evaluation Findings

Observation with check lists, Observation with check lists, questionnaire, observation, questionnaire, observation, interview, documents, pencil and interview, documents, pencil and paper test, performance testpaper test, performance test

Measurement of Central Tendency – Measurement of Central Tendency – mean mode, median, range, %mean mode, median, range, %

Memo, detail report, oral and writtenMemo, detail report, oral and written Respond by stakeholdersRespond by stakeholders