20
Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program Chad Green, Program Analyst Lynn McNally, Technology Resource Supervisor Loudoun County Public Schools, VA Virginia DOE Tech Leadership Conference, November 29, 2006

Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

  • Upload
    vega

  • View
    33

  • Download
    0

Embed Size (px)

DESCRIPTION

Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program. Chad Green, Program Analyst Lynn McNally, Technology Resource Supervisor Loudoun County Public Schools, VA Virginia DOE Tech Leadership Conference, November 29, 2006. Goals of Presentation. - PowerPoint PPT Presentation

Citation preview

Page 1: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Chad Green, Program AnalystLynn McNally, Technology Resource Supervisor

Loudoun County Public Schools, VAVirginia DOE Tech Leadership Conference, November 29, 2006

Page 2: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Goals of Presentation

1. Loudoun Tech Leadership Program: The Story 1. Loudoun Tech Leadership Program: The Story

2. Enhancing the Program: Logic Model Framework 2. Enhancing the Program: Logic Model Framework

3. Research Anchor: Why Use a Logic Model 3. Research Anchor: Why Use a Logic Model

4. Questions and Answers4. Questions and Answers

Page 3: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Loudoun Tech Leadership Program

1. The Story

• Spring 2002 - Bill and Melinda Gates (VITAL)• Market to Principals• Roll Out the TAGLIT Survey• The Workshop Plan• Packages

1. The Story

• Spring 2002 - Bill and Melinda Gates (VITAL)• Market to Principals• Roll Out the TAGLIT Survey• The Workshop Plan• Packages

Page 4: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Loudoun Tech Leadership Program

Page 5: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Loudoun Tech Leadership Program

Page 6: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Loudoun Tech Leadership Program

Page 7: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Loudoun Tech Leadership Program

Spring 2002 - Planning - LMYear 1: 17 workshops, 291 participants – SKYear 2: 10 workshops, 102 participants – SBYear 3: 32 workshops, 360 participants – PTYear 4: 39 workshops, 340 participants – PT

Spring 2002 - Planning - LMYear 1: 17 workshops, 291 participants – SKYear 2: 10 workshops, 102 participants – SBYear 3: 32 workshops, 360 participants – PTYear 4: 39 workshops, 340 participants – PT

Loudoun VITAL Participation

Page 8: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

End of Year 4 – Look at Benefits

Principal ITRT Supervisor Student

• Tech Skills• New Tools• Tech Integration• Data Manipulation• SIP Planning• Manage Change

• Understand Role• Build Partners• Consultant Role• More Visibility

• More Visibility• Awareness of Initiatives• Understanding of Initiatives• Build Partners

• Thoughtful Tech Integration• Learning• Motivation• Interest

Page 9: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

2. Logic Model Framework • What Is a Logic Model?• Components of a Logic Model• Benefits of Logic Models• Example: Loudoun VITAL Program• Using a Logic Model for Evaluation

2. Logic Model Framework • What Is a Logic Model?• Components of a Logic Model• Benefits of Logic Models• Example: Loudoun VITAL Program• Using a Logic Model for Evaluation

Page 10: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

What Is a Logic Model? • Provides a graphic description of a program.• Shows the relationship of program resources and activities to expected results.• Makes explicit the underlying theories and assumptions (logic) behind a program’s design.

What Is a Logic Model? • Provides a graphic description of a program.• Shows the relationship of program resources and activities to expected results.• Makes explicit the underlying theories and assumptions (logic) behind a program’s design.

Page 11: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Components of a Logic Model • Situation Statement: Mission of program and intended outcomes based on needs • Inputs: Required resources for activities to achieve outcomes• Outputs: Activities and participation rate/ satisfaction of target populations

Components of a Logic Model • Situation Statement: Mission of program and intended outcomes based on needs • Inputs: Required resources for activities to achieve outcomes• Outputs: Activities and participation rate/ satisfaction of target populations

Page 12: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Components of a Logic Model (cont.) •Outcomes: Short-, medium-, and long-term benefits for program participants (results)•Assumptions: Supporting evidence of the effectiveness of program design•External Factors: Other potential influences on program’s ability to achieve outcomes• Evaluation: Formative and summative

Components of a Logic Model (cont.) •Outcomes: Short-, medium-, and long-term benefits for program participants (results)•Assumptions: Supporting evidence of the effectiveness of program design•External Factors: Other potential influences on program’s ability to achieve outcomes• Evaluation: Formative and summative

Page 13: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Benefits of Logic Models • Goal Setting: Define the specific short-, medium-, and long-term outcomes (results) of a program.• Planning and Design: Clarify the underlying assumptions, relationships, and desired effects of program activities.

Benefits of Logic Models • Goal Setting: Define the specific short-, medium-, and long-term outcomes (results) of a program.• Planning and Design: Clarify the underlying assumptions, relationships, and desired effects of program activities.

Page 14: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Benefits of Logic Models (cont.) • Communications and Marketing: Clarify and illustrate the program to key stakeholders.• Collaboration: Build buy-in and promote consensus on program design and outcomes.• Evaluation: Focus resources on the most critical and appropriate data to track.

Benefits of Logic Models (cont.) • Communications and Marketing: Clarify and illustrate the program to key stakeholders.• Collaboration: Build buy-in and promote consensus on program design and outcomes.• Evaluation: Focus resources on the most critical and appropriate data to track.

Page 15: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Example: Loudoun VITAL Program • See handouts.

Example: Loudoun VITAL Program • See handouts.

Page 16: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Enhancing the Program

Using a Logic Model for Evaluation • Develop essential questions for each column.• Prioritize and select questions given resources.• Identify indicators for each question.• Develop data collection tools for indicators.• Collect and analyze data.• Report results to stakeholders.

Using a Logic Model for Evaluation • Develop essential questions for each column.• Prioritize and select questions given resources.• Identify indicators for each question.• Develop data collection tools for indicators.• Collect and analyze data.• Report results to stakeholders.

Page 17: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Research Anchor

3. Why Use a Logic Model • Why do you think the logic model has the components that it has and is a common tool for evaluation?

• Is it useful for planning and evaluating educational technology programs in general?

3. Why Use a Logic Model • Why do you think the logic model has the components that it has and is a common tool for evaluation?

• Is it useful for planning and evaluating educational technology programs in general?

Page 18: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Research Anchor

Feedback Spirals as Components of Continuous Learning*

Feedback Spirals as Components of Continuous Learning*

* Costa, A. L., & Kallick, B. (1995).

Page 19: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Research Anchor

Feedback Spirals at the Program Level 1. Clarify program goals and purpose (via logic model).2. Develop implementation and evaluation plan.3. Implement and monitor priority program activities.4. Collect, organize, and analyze evidence (data).5. Review results with various groups.6. Modify program activities based on new knowledge.7. Revisit/clarify program goals and purpose.8. Revisit logic model and action plan....

Feedback Spirals at the Program Level 1. Clarify program goals and purpose (via logic model).2. Develop implementation and evaluation plan.3. Implement and monitor priority program activities.4. Collect, organize, and analyze evidence (data).5. Review results with various groups.6. Modify program activities based on new knowledge.7. Revisit/clarify program goals and purpose.8. Revisit logic model and action plan....

Page 20: Using a Logic Model to Plan and Evaluate Your Technology Leadership Development Program

Questions and Answers

4. Questions and Answers • Loudoun VITAL Program• Logic Model• Our Roles in Loudoun• Chad’s Suit• Lynn’s Haircut• Good Restaurants in Roanoke

4. Questions and Answers • Loudoun VITAL Program• Logic Model• Our Roles in Loudoun• Chad’s Suit• Lynn’s Haircut• Good Restaurants in Roanoke