19
Copyright © 2008 Delmar. All rights reserved. Chapter 15 Program Development and Evaluation

Copyright © 2008 Delmar. All rights reserved. Chapter 15 Program Development and Evaluation

Embed Size (px)

Citation preview

Copyright © 2008 Delmar. All rights reserved.

Chapter 15

Program Development and Evaluation

Copyright © 2008 Delmar. All rights reserved.

2

Program Development

• Program development is the alignment of activities to meet an intended purpose

Copyright © 2008 Delmar. All rights reserved.

3

Program Development

• Program planning– Concept of program development– Requires

• Assessment and identification of a need• Diagnosis of the need

Copyright © 2008 Delmar. All rights reserved.

4

Program Development

• Planning a strategic action plan– Implement the plan– Evaluate the plan

Copyright © 2008 Delmar. All rights reserved.

5

Program Development

• Frameworks in program development– Pollack (1994) pre-start up plan

• Mission statement clarification• Stakeholder analysis• Problem identification, strengths, weaknesses,

opportunities, threats

Copyright © 2008 Delmar. All rights reserved.

6

Framework for Planning Process in Program Development

• Nutt (1984) identified planning steps – Formulating– Conceptualizing– Detailing– Evaluating– Implementing

Copyright © 2008 Delmar. All rights reserved.

7

Framework for Planning Process in Program Development

• Witkin and Altschuld (1995) developed a three phase plan for assessing– Pre-assessment– Main assessment– Post-assessment

Copyright © 2008 Delmar. All rights reserved.

8

Role of Economic Analysis

• Informs decision makers

• Does not tell decision maker if increased expenditure is worthwhile

• Not always available

Copyright © 2008 Delmar. All rights reserved.

9

Economic Analysis

• Five types of economic analysis:1. Cost minimization analysis (CMA)

2. Cost consequence analysis (CCA)

3. Cost effectiveness analyses (CEA)

4. Cost utility analysis (CUA)

5. Cost benefit analysis (CBA)

Copyright © 2008 Delmar. All rights reserved.

10

Economic Analysis

• Three methods of valuation: 1. Discounting

2. Externalities

3. Intangibles

Copyright © 2008 Delmar. All rights reserved.

11

Program Evaluation

• Measures the implementation and outcomes of a program– Can be periodic assessment or on-going

• Program components– Program objectives– Program outputs– Program effects

Copyright © 2008 Delmar. All rights reserved.

12

Phases and Steps in Evaluation

• Identifying program objectives

• Selecting or creating measures of impacts

• Collecting data

• Interpreting data

• Disseminating the evaluation information

Copyright © 2008 Delmar. All rights reserved.

13

Evaluation and Program Manager

• Manager steps– Determine purpose of evaluation– Consider pros and cons

• Evaluator steps– Identify the purpose, objectives– Design rigorous evaluation

Copyright © 2008 Delmar. All rights reserved.

14

Planning/Implementing Practical Program Evaluation

• Six steps taken in any evaluation:1. Engage stakeholders

2. Describe public health program

3. Focus evaluation design

4. Gather credible evidence

5. Justify program evaluation conclusions

6. Ensure use of evaluation and share lessons learned

Copyright © 2008 Delmar. All rights reserved.

15

Theoretical Foundations

• Program Theory– Model I Logic models

• Program processes– Formative evaluation– Summative evaluation

Copyright © 2008 Delmar. All rights reserved.

16

Model II

• Precede-Proceed Framework– P-predisposing– R-reinforcing– E-enabling – Constructs in– Education/environment– Diagnosis– Evaluation

Copyright © 2008 Delmar. All rights reserved.

17

Model II

• Proceed– P-policy– R-regulatory– O-organizational– Constructs in – Educational– Environmental – Development

Copyright © 2008 Delmar. All rights reserved.

18

Model II

• Precede-Proceed Model– Integrates evaluation, planning, and program

planning

Copyright © 2008 Delmar. All rights reserved.

19

Model III

• Diffusion of innovations theory– Characteristics

• Takes an extended period of time• People go through stages• Some adopt innovations quickly, others may wait