InSync Training Blended Learning Certificate Program …...The Blended Learning Design Certificate program is a new offering for InSync Training in 2014. This program is a blended

InSync Training Blended Learning Certificate Program Evaluation Submitted by:

Jennifer Newton

Purdue University

EDCI 577

Dr. Paul Henry

10/12/2014

BLENDED LEARNING DESIGN PROGRAM EVALUATION 1

Executive Summary

Purpose of Evaluation

This evaluation plan has been created for InSync Training on the new Blended Learning Design Certificate program. The evaluation process has two main objectives. The main reason for the evaluations that have been created is to ensure that the participants are learning and applying the knowledge and skills once they have gotten back to their job. The second reason for the evaluation is to confirm the hours spent in the program and on outside activities to maintain IACET certification. This program is in the pilot stage so all of the hours need to be confirmed so that the proper IACET credit can be provided.

Summary of Evaluation Plan

This evaluation plan has been created using the Kirkpatrick 4-level evaluation model (Kirkpatrick & Kirkpatrick, 2006). This is the most effective way to determine the program’s success as it is provided as a public offering for training professionals. The overall evaluation plan will run for approximately 18 months in order capture enough data once the learners have returned to their organization. Samples of all of the evaluation documents are included in this document.

Evaluation Level & Objective Data Collected Timing Success Factors

1: Electronic Reaction Survey

Details on reactions of participants regarding the content, style, materials, facilitation, etc.

End of final session

Average Score of 4.0

1: Electronic Final Project Reaction Survey

Details on number of hours and reactions to the final project difficulty and relationship to the job

30 days after final class (after project is due)


2: Final Blended Design Project: Create a Blended Program Design Document

Project assesses skills of completing the design document for blended program. Rubric for grading is provided

30 days after final class

Score of 77 out of 96 for each participant

3: Organizational Work Product Evaluation

Learners are to provide a new or revised work product from their job or answer questions regarding the product if confidentiality issues arise.

Within 3-12 months after final project

90% of learners share work products that follow best practices shared in program

4: Business Impact Survey (Electronic)

Self-assessment (by learners) on how their skills have made a business impact. Specific details requested if possible

12-18 months after final project

Positive changes noted by 90% of the learners in program


Recommendations

This program was created by the InSync Instructional Design Team. The evaluations have shown positive details on the program to date. Action plans need to be created to make the necessary changes based on the level 1 and level 2 data. Continuous monitoring of hours spent on assignments, as provided by learners in the evaluations, needs to be completed so that InSync is in compliance with the details provided to IACET regarding the program.


Table of Contents

Executive Summary ...................................................................................................................................... 1

Purpose of Evaluation ............................................................................................................................... 1

Summary of Evaluation Plan .................................................................................................................... 1

Recommendations ..................................................................................................................................... 2

Table of Contents ...................................................................................................................................... 3

Project Goals and Scope ............................................................................................................................... 4

Learning Program Description .................................................................................................................. 4

Organization Description .......................................................................................................................... 4

Purpose of Evaluation ............................................................................................................................... 5

Audience Description ................................................................................................................................ 5

Processes and Timeline ................................................................................................................................. 5

Data Collection and Analysis ........................................................................................................................ 8

References ................................................................................................................................................... 10

Appendix ..................................................................................................................................................... 11

Level 1 Evaluation .................................................................................................................................. 11

Level 1 Final Project Evaluation ............................................................................................................. 15

Level 2 Final Project Description ........................................................................................................... 18

Blended Learning Design Project Evaluation Form ........................................................................... 19

Level 2 Grading Rubric....................................................................................................................... 22



Sample Evaluation Reports ..................................................................................................................... 28

Level 1 Evaluation Report .................................................................................................................. 28

Gantt Chart for Evaluation ...................................................................................................................... 29


Project Goals and Scope

Learning Program Description

The Blended Learning Design Certificate program is a new offering for InSync Training in 2014. This program is a blended approach to content delivery. The program runs for 4 weeks with self-paced modules and intersession discussion boards in between each live (virtual) session. The program focuses on covering the following objectives (Blended Learning):

• Conduct an analysis to determine what technologies are available at your organization and how your audience already uses them.

• Use a worksheet to design an impactful blended learning solution. • Map learning objectives to the appropriate learning technologies using a modern application of

Bloom's Taxonomy of Learning. • Utilize best practices to design exercises for popular learning technologies, including virtual

classrooms, mobile and social learning, simulations, eLearning and games. • Avoid the top ten challenges to implementing a blended learning program. • "Flip the classroom" to maximize collaborative impact.

The program is rated for continuing education units (CEUs). In order to receive this certification and CEUs the learner must follow the attendance policy and complete all required assignments. The program ends with a final project to demonstrate the skills being covered in the program. There is no knowledge-based test because the content is much more hands-on and practical.

This program does not get into the deep design processes of each type of training as the organization offers other programs to support those objectives.

Organization Description

InSync Training is a company that offers certification programs for virtual program facilitation, production, and design as well as other topics. InSync also contracts with companies to complete design work.

InSync Training, LLC is a leader in the synchronous training design and delivery field. They have been in the business of synchronous training delivery since 1999. “InSync provides customized, accredited, comprehensive live and interactive online training solutions, enabling learning and development professionals and organizations to realize the full potential of individual and organizational growth by leveraging the live online environment. InSync’s curriculum offerings provide its clients with the skills required to become knowledgeable, effective, and dynamic instructional experts in the synchronous virtual classroom (IACET Accredited).”


Purpose of Evaluation

Since this program is newly developed the evaluation process is critical to ensure we are meeting all of the stated program objectives as well as meeting our requirements for IACET (International Association for Continuing Education and Training).

The goal of these evaluations is to:

1. Collect customer feedback on the program and their learning experience. 2. Recommend changes to content to better meet the stated program objectives. 3. Recommend changes based on the experience of the learner once back on the job and applying

knowledge and skills. 4. Create an effective and efficient evaluation process that can be maintained by the organization as

the program grows in popularity.

Audience Description

The Blended Learning Design Certificate program is targeted towards Training Directors/Managers, Instructional Designers, Learning Consultants, Subject Matter Experts (SMEs), and Program Managers. The audience is expected to have a basic understanding of instructional design principles and processes. The audience age is varied from 20 to 60. The learners typically have experience in training design or delivery with a specialized focus. For example they might be instructional designers for e-learning modules or face to face instructors but are not experienced in other forms of training. These learners have basic skills but are not so advanced in the field that the content covered is already known and understood.

The learners are typically working in a corporate setting as opposed to someone in K-12 or higher education. The lessons covered in this program are easily used in any area of training but the examples are geared towards the corporate setting.

Processes and Timeline

The evaluation process for this program starts during the design and development of the content for the new content. It is important to tie the assessment component to the content being delivered. This paper covers the main evaluation tools used during the program based on Kirkpatrick’s model. There are many other small evaluations (or knowledge and skill checks) throughout the program to ensure that the learner is successful. This will help ensure that any issues can be found early and correct to improve the chance that the learner passes the certification project at the end of the program.

This timeline for this project began on February 3, 2014. The process starts with creating the evaluation plan. This plan was sent off to designer leader for review and approval. Updates were made to the plan and then final evaluation plan was created and approved. The evaluation details were created for all levels in word document format for review and revisions. Once the details were approved the electronic surveys could be created and scheduled for the proper time. The pilot program was delivered in March and April of 2014. A detailed Gantt chart of the timeline of the evaluation can be seen in the Appendix.


The Level 1 reaction evaluation will focus on relevancy to the job, the overall thoughts on the content and materials, the experience of the virtual programs, and effectiveness of the delivery team. The Level 1 project reaction evaluation will focus on the time spent on the project and how well the program prepared the learner for the project. The Level 3 electronic survey focuses on the application of the content to their jobs as well as possible changes to the program based on the work they have done. The Level 4 electronic survey focuses on the business impacts of the improved blended learning programs at the organization.

The table below provides details on the instrument being used, the timing, procedure, rationale, and success factors for each of the evaluation levels.

Evaluation Level &

Objective Instrument Timing Procedure Rationale Success

Factors

1: Reaction Survey (Document in Appendix)

Electronic survey through Metrics that Matter

Day of final session with time to complete at end of session

The survey will be created in Metrics that Matter and sent via email to each participant the day of the final program.

There will be time at the end of the program to complete the survey to increase the odds of getting 100% response rate.

The survey will remain open for 3 days to allow any missing participants to complete.

There is no face to face time so an electronic survey is the best option to get feedback on reactions to the program.

Using a program like Metrics that Matter makes data capturing easier for analysis.


1: Final Project Reaction Survey (Document in Appendix)


30 days after final class (after project is due)

The survey will be created in Metrics that Matter and sent via email to each participant on the due date of the final project.

The survey will remain open for 7 days to allow participants to complete.

There is no face to face time so an electronic survey is the best option to get feedback on reactions to the program.

Using a program like Metrics that Matter makes data capturing easier for analysis.


2: Final Blended Design

Assessment Project with

30 days after final class

The learners are provided with the project description

The program focuses on being able to create a well-

Score of 77 out of 96 for


Evaluation

Level & Objective

Instrument Timing Procedure Rationale Success Factors

Project: Create a Blended Program Design Document (Document in Appendix)

grading rubric

and requirements along with the grading rubric, a template, and an example. The deadline for the final project is 30 days after the final program and then the evaluator has 30 days to complete the evaluation of the project and to provide feedback. Any learner that does not pass can modify the submission based on the feedback and resubmit for review within 2 weeks of receiving the grade.

designed blended program that teaches the correct objectives in the correct methods.

The template is provided to standardize the project somewhat so that grading is more balanced. The learner doesn’t have to use the template but must include all of the necessary components.

each participant

3: Organizational Work Product Evaluation (Document in Appendix)

Assessment of a Work Product & Electronic survey through Metrics that Matter

Within 3-12 months after final project


The survey will be created in Metrics that Matter and sent via email to each participant on the due date of the final project.


There are two parts to the level 3 because some learners are not going to be able to provide a work product for review. If they can then they will receive valuable feedback from an instructional designer on their work.

The electronic survey captures easily measured data so that an analysis of the changes can be completed.

90% of learners share work products that follow best practices shared in program

4: Business Impact Survey (Document in Appendix)


12-18 months after final project

The survey will be created in Metrics that Matter and sent via email to each participant on the due date of the final

The level 4 evaluation is a self-assessment because each organization is going to measure success differently. Our goal is to see

Positive changes noted by 90% of the learners in


Evaluation

Level & Objective

Instrument Timing Procedure Rationale Success Factors

project.


that the learner is seeing the positive business impacts.

Overall, we are hoping that the increase in business impacts will bring them back for additional programs or that they will send additional employees to the program.

program

Data Collection and Analysis

The table below details the data collection procedures and analysis process for each evaluation level. Action Plans will be created in excel and any reports will be managed in word. All files will be stored on the public SharePoint drive for the designers. Reports from Metrics that Matter will be delivered via email in PDF format. All details shared from program owner to management and facilitation team will be done via email.

Evaluation Level &

Objective Data Collected Procedure Location Analysis

1: Electronic Reaction Survey

Details on reactions of participants regarding the content, style, materials, facilitation, etc.

The survey will be sent via email to the learner.

The survey will be open for 3 days and then a report will be sent to the facilitation team and course owner.

Metrics that Matter

Scores and comments will be reviewed.

An action plan will be created by the program owner and shared with design team and management group.

Any critical items found for the facilitation team will be sent directly to them to manage.

1: Electronic Final Project Reaction Survey

Details on number of hours and reactions to the final project difficulty and relationship to the job


The survey will be open for 7 days and

Metrics that Matter


An action plan will be created by the program owner and shared with


Evaluation

Level & Objective

Data Collected Procedure Location Analysis

then a report will be sent to the facilitation team and course owner.

design team and management group.

2: Final Blended Design Project: Create a Blended Program Design Document

Project assesses skills of completing the design document for blended program. Rubric for grading is provided

The learner has 30 days to submit the final project via the learning management system (LMS). The evaluator has 30 days from the due date to complete assessment and provide grade and feedback.

InSync Central (LMS)

Evaluator will assess final project based on rubric and share feedback with the learner within 30 days of the due date.

Evaluator will also provide program owner with necessary feedback on any work products received.

3: Organizational Work Product Evaluation



The learner has 30 days to submit their work product via email. The evaluator has 2 weeks from the submission date to complete review and provide grade and feedback.

The electronic survey will be open for 7 days and then a report will be sent to the course owner.

Email

Metrics that Matter

Evaluator will review any provided work documents and share feedback with the learner within 2 weeks.

Evaluator will also provide program owner with necessary feedback on any work products received.

Scores and comments will be reviewed. An action plan will be created by the program owner and shared with design team and management group.

4: Business Impact Survey (Electronic)

Self-assessment (by learners) on how their skills have made a business impact. Specific details requested if possible


The survey will be open for 7 days and then a report will be sent to the course owner.

Metrics that Matter


An action plan will be created by the program owner and shared with design team and management group.


References

Blended Learning. (n.d.). Retrieved October 11, 2014, from InSync Training: http://us.insynctraining.com/course-information/?course=38

Kirkpatrick, D. L., & Kirkpatrick, J. D. (2006). Evaluating Training Programs: The four levels (3rd ed.). San Francisco: Berrett-Koehler Publishers.


Appendix

Level 1 Reaction Evaluation

Below is the template for the Metrics that Matter Evaluation. The evaluation is completed electronically. The survey link is provided to learners via email the day of the final class. It is specific to each learner. This is a copy of the email that is sent to the learner.

Hello {Learner}. We are pleased to have had you as a participant in the above named course. As a part of our IACET Accreditation, we fully evaluate our courses to ensure learners are building competencies they can apply in their roles. Please complete this survey in class when prompted by your Producer. It is important that this survey is completed only after the final live session is complete. If you are unable to attend the final live session, please complete the survey by [Deadline] so your input can be included. This survey is designed to evaluate your experience in the classroom and on the discussion boards at InSync Central. You will receive a second survey after your final project to evaluate how the learning objectives of the course translated to your competency development. https://www.kamtm.com/url/u.aspx?21D7E788559227293 Please reach out to us with any questions or concerns. Thank you! Sincerely, The InSync Quality Improvement Team [email protected]

https://www.kamtm.com/url/u.aspx?21D7E788559227293

mailto:[email protected]


InSync Training - Blended Learning - Participant

Thank you for providing your thoughtful feedback about your experience as a participant in this InSync Training course.

Please rate the following topics on how useful each was relative to your job role:

Very Somewhat Neutral Not Very Not at all

1) Blended learning 5 4 3 2 1

2) Flipping the classroom 5 4 3 2 1

3) Organizational analysis and planning 5 4 3 2 1

4) Mapping learning objectives to Bloom's Taxonomy of Learning

5 4 3 2 1

5) Engagement vs. Interaction vs. Collaboration

5 4 3 2 1

6) Mapping learning objectives to appropriate learning technologies

5 4 3 2 1

7) Designing blended learning solutions 5 4 3 2 1

8) Best practices in applying learning technologies

5 4 3 2 1

Please respond to the following statements about the course:

Strongly Agree Agree

Neither Agree

nor Disagree

Disagree Strongly Disagree

9) The content was arranged in a logical manner.

5 4 3 2 1

10) The length of the overall program was just right.

5 4 3 2 1

11) The length of the live sessions was just right.

5 4 3 2 1

Live Session Experience

12)

If I could change one thing about the live sessions it would be:


Please rate each of the independent assignments based on how useful they were:


13) A-ha Discussion Board 5 4 3 2 1

14) Weekly Discussion Board questions 5 4 3 2 1

15) Bloom's Taxonomy Video 5 4 3 2 1

16) Bloom's Objectives Quiz 5 4 3 2 1

17) Engagement eLearning Module 5 4 3 2 1

18) Learning Journal Reading- Best Practices (Lesson 4)

5 4 3 2 1

Independent Work

19) On average, how many hours per week did you spend on independent work? (Round to the nearest whole hour)

20) If I could change one thing about the independent work it would be:

Learning Journal


Neither Agree

nor Disagree


21) The Learning Journal supported my learning progress throughout the program.

5 4 3 2 1

22) The most valuable part of the Learning Journal was:

23) The one thing I would change about the Learning Journal is:


Please respond to the following statements about your Facilitation Team:


Neither Agree

nor Disagree


24) My Facilitator’s expertise in the field was evident and added to the class experience

5 4 3 2 1

25) My Facilitator allowed me to share my knowledge and experiences

5 4 3 2 1

26) My Facilitator responded to questions effectively

5 4 3 2 1

27) My Facilitator and Producer worked effectively together

5 4 3 2 1

28) My Producer communicated clearly and was easy to understand in emails and/or forums

5 4 3 2 1

29) My Producer was knowledgeable about the program content

5 4 3 2 1

30) My Producer effectively managed and supported certificate completion

5 4 3 2 1

31) My Producer enhanced the learning experience

5 4 3 2 1

Overall Experience

Extremely satisfied Satisfied Neutral Dissatisfied Extremely

dissatisfied

32) Overall, how satisfied are you with the class you just completed?

5 4 3 2 1

33) Please provide any additional feedback regarding your experience as a participant here.


Level 1 Final Project Evaluation

Below is the template for the Metrics that Matter Final Project Evaluation. The evaluation is completed electronically. The survey link is provided to learners via email the day the final project is due. It is specific to each learner. This is a copy of the email that is sent to the learner.

Hello {Learner}. We are pleased to have had you as a participant in the above named course. As a part of our IACET Accreditation, we fully evaluate our courses to ensure learners are building competencies they can apply in their roles. By now you have likely completed a survey about your experience as a participant in your InSync Training course. The survey link below is a survey about your experience in completing the final project. Please complete the survey by [Deadline] so your input can be included. https://www.kamtm.com/url/u.aspx?A155203B459227325 Please reach out to us with any questions or concerns. Thank you! Sincerely, The InSync Quality Improvement Team [email protected]

https://www.kamtm.com/url/u.aspx?A155203B459227325



InSync Training - Blended Learning Final Project - Participant

Please take a moment to provide your feedback related to your experience in completing the final project for your InSync Training course. Thank you for your valuable input.

Please respond to the following statements regarding your final project:

Strongly Agree

Agree

Neither Agree nor Disagree


1)

The final project helped reinforce what I learned during the course. 5 4 3 2 1 N/A

2)

The final project brought all the program topics together as a whole. 5 4 3 2 1 N/A

3)

The final project was relevant to my job. 5 4 3 2 1 N/A

4)

Live sessions prepared me for the final project. 5 4 3 2 1 N/A

5)

Intersession work prepared me for the final project. 5 4 3 2 1 N/A

Project Workload

6)

Please estimate the total number of hours you spent completing your final project (Round to the nearest whole hour).

7)

If I could change one thing about the Final Project it would be:


Please respond to the following statements about your InSync Facilitation Team and Evaluator.

Strongly Agree

Agree



8)

My Project Evaluator’s expertise in the field was evident and added to the experience. 5 4 3 2 1 N/A

9)

My Project Evaluator responded to questions effectively. 5 4 3 2 1 N/A

10)

My Project Evaluator, Facilitator and Producer worked effectively together. 5 4 3 2 1 N/A

11)

Feedback from the Project Evaluator was clear and easy to understand. 5 4 3 2 1 N/A

12)

Feedback from the Project Evaluator was delivered in a timely manner. 5 4 3 2 1 N/A

Overall Experience

Extremely satisfied

Satisfied Neutral

Dissatisfied Extremely dissatisfied

13)

Overall, how satisfied are you with the final project you just completed? 5 4 3 2 1 N/A

14)

Please provide any additional feedback regarding your experience with the final project here.


Level 2 Final Project Description

To complete your final project for the Blended Learning Design Certificate, you will need to create a blended training design plan.

The design document should include the instructional goal, performance objectives, and method of delivery for each objective.

For each session breakdown you must include estimated timing and activities for the topics being covered.

At a minimum, your design document MUST include at least 4 distinct sessions with one being live and one being self-paced.

Evaluation of your Project:

Approximately 30 days after the final due date, you’ll receive a written evaluation with feedback. This feedback will be provided according to the Final Project Evaluation criteria listed on the next few pages and posted to InSync Central.

We will evaluate the overall program, accuracy of the blend, the learning objectives, and the collaboration exercises.

Overall Design Guidelines

Include: o Instructional Goal o Performance Objectives o Method of delivery for each objective o Target audience o Breakdown of each component of the blend

Chunk and group your learning objectives At least 4 distinct blended components

o 1 must be live o 1 must be self-paced

Breakdown each component into topics and activities o Basic activity descriptions to demonstrate collaboration

Avoid implying that the synchronous content is more important than asynchronous elements. Apply strategies to ensure that participants complete self-directed work. Don’t let the tools dictate the design! Don’t use a tool just because you can. Can the program manager or subject matter expert understand the overall design document?


Blended Learning Design Project Evaluation Form

This form is what is completed for the learner by the evaluator. The learner is given this form along with a sample document and a template.

Participant

InSync Final Project Evaluator

Date

Dear [name]:

The maximum number of points possible is 96. You needed 77 points (80%) to pass. You scored _______.

Please see my comments below; they will provide you with further insight in to the scoring outcome.

Overall the Design Document is well designed and easy to follow.

Disagree Adequate to understand with explanation Anyone can understand design

Comments:

Overall:

Element Points (0-3) Comments

Program Overview included

Program Objectives

Target Audience

Technical Requirements

Delivery Methods


Program Length

Prerequisites and Required Materials

Module 1:


Lesson Overview

Lesson Objectives

Instructional strategies to be used identified

Timing Identified

Assessment Method identified

Sequencing

Module 2:


Lesson Overview

Lesson Objectives


Timing Identified


Sequencing


Module 3:


Lesson Overview

Lesson Objectives


Timing Identified


Sequencing

Module 4:


Lesson Overview

Lesson Objectives


Timing Identified


Sequencing

Final Project:


Final Project is an assessment of skills learned

Recommendations:


Level 2 Grading Rubric

This grading rubric allows all evaluators to review the program with the same expectations and measurements. The rubric is broken down into 3 sections. There is an overall product evaluation, an individual lesson evaluation, and a final project evaluation.



Level 3 Application Evaluation

Within 12 months of your final live session we are asking that you share a new blended program design that you have created for your organization or a revised version of an old program.

Suggested content to share:

• Design document – detailed enough for expert or program manager to follow with breakdown of sessions

• Training Materials (electronic format) – Facilitator Guide, Scripts, Transcripts, Tests, Presentations, Participant Materials

All content will be reviewed by the original project evaluator and feedback will be provided. There is no set rubric or grade for this evaluation.

Items to consider in your design submission:

• Are you using your available technology wisely? • Have you used various types of methods of content delivery (synchronous, virtual,

reading, e-learning, etc.)? • Have you considered collaboration needs and assessment techniques in order to align

each objective with the proper method of teaching?

If you are not able to share design document or materials please answer the following questions regarding the application of the program content in the last 12 months on the job.

Please respond to the following statements regarding your work assignments:

Strongly Agree

Agree



1)

I was able to use the skills and knowledge once I returned to my job. 5 4 3 2 1 N/A

2) The modified programs were received well by management/training department. 5 4 3 2 1 N/A

3) The modified programs were received well by learners. 5 4 3 2 1 N/A


4)

The participant materials from the session were a valuable resource when creating/updating my instructional programs. 5 4 3 2 1 N/A

5)

Live sessions prepared me for applying the lessons to my job. 5 4 3 2 1 N/A

6)

Intersession work prepared me for applying the lessons to my job. 5 4 3 2 1 N/A

Project Workload

7)

Please estimate the total number of hours you spent updating a previously developed project. (Round to the nearest whole hour).

8) Please estimate the total number of hours you spent updating a previously developed project. (Round to the nearest whole hour).

9)

Now that I have used the materials on the job, I wish you would have covered this/these area(s) more:


Level 4 Business Impact Evaluation

Below is the template for the Metrics that Matter Business Impact Evaluation. The evaluation is completed electronically. The survey link is provided to learners via email after 12-18 months. It is specific to each learner. This is a copy of the email that is sent to the learner.

Hello {Learner}. We are pleased to have had you as a participant in the above named course. As a part of our IACET Accreditation, we fully evaluate our courses to ensure learners are building competencies they can apply in their roles. By now you have likely completed multiple surveys regarding this program. We would appreciate you taking a few moments to provide some details on the impacts this program has had on your organization since you participated. The survey link below is a survey about the business impacts. Please complete the survey by [Deadline] so your input can be included. SURVEY LINK TO BE PROVIDED Please reach out to us with any questions or concerns. Thank you! Sincerely, The InSync Quality Improvement Team [email protected]

https://www.kamtm.com/url/u.aspx?A155203B459227325



Please rate the following business changes:


1) Average reaction survey scores for updated blended programs have increased.

5 4 3 2 1

2) Time spent in the live sessions for blended programs has been reduced.

5 4 3 2 1

3) Job performance for employees that have taken the updated blended programs has shown improvement.

5 4 3 2 1

4) The organization is investing more resources to modify content to blended programs.

5 4 3 2 1

Additional Information

5)

Please provide any specific data you have to support the business impacts (i.e. safety statistics, production numbers, customer satisfaction ratings, reaction survey scores)

8) Please share any additional information regarding the business impact.


Sample Evaluation Reports

Level 1 Evaluation Report

Below is a sample of the report provided following the Level 1 Reaction Survey. A separate survey of comments is also provided but those are listed with names so I will not be able to share.


Gantt Chart for Evaluation

This timeline is weekly starting on February 3, 2014. The overall timeline is for 110 weeks due to the need to be able to capture longer term business impact data from the learners.


Documents

InSync Training Blended Learning Certificate Program …...The Blended Learning Design Certificate program is a new offering for InSync Training in 2014. This program is a blended