Program Design

Global Health Fellowship

St Luke’s/Roosevelt

New York

Development of Linkages with

the Public

Situation Analysis

Priority Setting

Program Design

Program Implementation

Evaluation and Accountability

When developing a new program, it is especially important that an organization address a few key points when applying for funds to finance the program.

The following guidelines cover these crucial steps, which include: Assessment of community needs ↔ Goal Program design Performance measurement Program evaluation

Program DevelopmentLogic Model/Causal Hypothesis

Community Needs AssessmentThe Situation

Before designing a program, an organization should conduct a community needs assessment to determine that the program is addressing a need that exists in the community.

In order to get an accurate picture, assessment should involve people representing various aspects of the community.

In gathering research, the following questions may serve as a guideline:

Who does the problem affect? How many people are affected? How is this problem addressed in other locations affected by it?

What has and has not worked? Is this problem already being addressed in this community?

How?

A new program should not be replicating services already provided in the community.

If the needs assessment determines that the problem is

already being addressed adequately by other organizations in the community, it may be best to narrow or broaden the program’s approach to address the problem in a unique manner.

Visit other organizations addressing the problem, in the community or not, to assess what approaches do and do not work, and how services can be improved upon.

Community Needs Assessment

Program Design

Some basic qualities of a good program are that it:

Describes & gives evidence of a community need that can be addressed.

Identifies a gap in services available in the community which address the need.

Explains why this program is an appropriate strategy to meet the need.

Outlines the activities of program members in addressing the need. Establishes community partnerships in the process of addressing the

community need. Anticipates the positive outcome of the program in the community. Defines the method of measuring results (see the following section

on Performance Measurement).

Program

A program is a sequence of intentional actions and events organized in a manner that they result in valued outcomes for a clearly defined audience.

How does a program work?

We do stuff.

Good things

happen.

A B CIf If

ThenThen

Logic Model(logic modeling, program planning,

program design, outcome engineering)

A recommended method of program design is to use a logic model to plan & evaluate the proposed program.

A logic model is a depiction of the processes & targeted outcomes of the program.

This should help the organization to specify goals, identify what resources are needed, identify indicators of progress and measurements of success, & communicate the program’s potential value.

The Logic Model

Logic Model

A graphic representation of a program,

supported by a program theory,

depicted as a logical chain of “if-then” relationships,

& guides program implementation & evaluation.

The components of a basic logic model include:

Needs: The community need as identified in the Community Needs Assessment.

Inputs: The resources needed to complete activities. Activities: What staff, volunteers, etc. actually do. Outputs: A measurement of the actual amount of service

completed. Intermediate Outcomes: Measurable change and

improvements in the program’s constituents and/or community. End Outcomes: The target changes that the organization

hopes to achieve in the program’s constituents and/or community.

The Logic Model – Components

Causal Pathway

Causal: based on premise that activities should logically cause desirable results to occur

Pathway: based on the idea that the causal links form a technically & programmatically sound logical progression

Causal Pathway: 5 Main Components Impact

Change in the health, socio-economic status of the population of interest thru sector specific contributions

Effects Change in the knowledge, attitudes, skills, intentions &/or

behaviors of the population of interest that contributes to desired IMPACT

Outputs Products & services that must be in place for the EFFECTS

to be achieved Activities

The technical & support tasks required to → OUTPUTS Inputs

Resources required to support your ACTIVITIES

Steps in Logic Modeling

Convene a planning group Large room and lots of paper Template or free form Create a model beginning with outcomes Get feedback from outside Revise Plan evaluation & select indicators

Three Major Components of Logic Models

Inputsresources

Outputsactions

Outcomesresults

Defining Outputs

Inputsresources

Outputsactions

Outcomesresults

AudienceActivities

Three Types of Outcomes

Inputsresources

Outputsactions

Outcomesresults

Initial Outcomes

Intermediate Outcomes

Long-Term Outcomes

A Simple Linear Model

InputsResources committed

to the program

ActivitiesLearning

experiences supported by the resources

invested

AudienceIndividuals who participate, their

characteristics, and reactions

Initial OutcomesLearning that results from participation

(KOSA)

Intermediate Outcomes

Actions that result from learning

(Practices and Behaviors)

Long-term Outcomes

Conditions which change as a result of

actions (SEEC)

InputsOutputs Outcomes

Activities Audience Initial Intermediate Long-Term

Resources deployed to address situation

StaffVolunteersTimeMoneyMaterialsEquipmentTechnologyPartners

Activities supported by resources invested

WorkshopsMeetingsField DaysDemonstrationCampsTrainings Web SitesHome Visits

Individuals or groups who participate in the activities

NumberCharacteristicsReactions

Learning that results from participation

AwarenessKnowledgeOpinionsSkillsAspirations

Actions that results from learning

PracticesBehaviorsPoliciesSocial ActionChoices

Conditions which change as a result of action

SocialEconomicEnvironmental

Contextual Factors

Generic Program Logic Model

InputsOutputs Outcomes

Activities Audience Initial Intermediate Long-Term

Resources deployed to address situation

Activities supported by resources invested

Individuals or groups who participate in the activities

Learning that results from participation

Actions that results from learning

Conditions which change as a result of action

Contextual Factors

Program Planning Worksheet

Let’s look at some logic models for specific programs.

04/19/23 Office of Faith-Based and Community Initiatives 26

Sample Logic Model

Need Inputs Activities Outputs Inter-mediate

Outcomes

End Outcomes

Low third-grade reading performance

Staff

Books

Space

Volunteers

20 volunteers will tutor children one-on-one in reading 3 times a week

(x) number of children tutored

Increased number of books read, increased reading on own

Increased reading performance, improved grades

Site Director and Staff, Principal,

Teachers, Volunteers, School Staff,

Extension Staff, and Evaluator

21st Century Community Learning

Center Advisory

Cooperative Extension, School, Community

Partnership

Department of Education Grant

Homework Help, Tutoring, Field Trips,

Academic Enrichment,Cultural and

Performing Arts Events

Reality Store, After-School Classes, Red Ribbon Week, STOP,

Junior Guard, Leadership Team, Nutritious Snacks

Family Events, Science Fair, Parenting

Classes, Adult Computer Classes, Community/School Collaboration, GED

Referrals

All Cumberland County Middle

School Students

21st Century Community

Learning Center Participants

Students Complete Homework,

Experiential Learning Approaches Increase

Student Comprehension

Participating Youth Become More Engaged with School, Gain

Resistance, Coping, and Leadership Skills

Parents Participatein Learning

Opportunities, Community

Members Volunteer at School

Academic Index Increases by 3.7%,Arts and Humanities

Scores Increase 2.5%

Targeted Assets Increase 5%,

AttendanceIncreases 2%,

Disciplinary Referrals and Dropout Rate Decrease 10%

Capable and Competent Information

Age Workforce (Academic Outcomes)

Healthy, Responsible, Caring Citizens

(Youth Development Outcomes)

Cumberland County 21st CCLC Logic Model

Inputs Activities Primary Audience

Initial Outcomes

Intermediate Outcomes

Long Term Outcomes

Parents and Community Members

Parents Increase Computer Literacy,

Gain Parenting Skills, Community Members

Have Renwed Commitment to Youth

Lifelong Learners and Engaged Community

Leaders(Family and Community Outcomes)

Project Leadership Team (Farmers, Processors, UK

Faculty, Collaborators)

Collaborators (KY Department of

Agriculture, Health Departments, UK and

KSU)

Stakeholders (Farmers, Microprocessors, Food Manufacturers, Farmers

Markets, Roadside Stands, Consumers,

Inspectors, Other Agency Staff)

SARE Professional Development Program

Grant

Develop Microprocessor

Certification Manual

Conduct Train-the-Trainer Sessions for individuals who will teach local HBM

Workshops

Trainers conduct local HBM certification

workshops for farmers and food processors.

UK Value-Added Small Processing Incubator

conducts Better Process Control

Schools.

Home-Based Microprocessors

participate in certification workshops.

Extension Agents,Health Inspectors,

and Food Manufacturing Inspectors are

trained.

Agency Professionals have knowledge and

skills needed to provide training and

technical asssistance.

Home-Based Microprossessors

have knowledge and skills necessary to produce safe home-processed products.

Production Supervisors have

knowedge and skills necessary to oversee

production of safe manufactured

products.

Agency Professionals provide accurate and

reliable technical assistance to processors.

Home-Based Microprocessors use

safe processing practices.

Food sold by Value-Added Entrepreurs is safe for consumption.

Consumer confidence in products produced by microprocessors

increases.

Logic Model for the Value-Added Microprocessor Project

Inputs Activities Targeted Audiences

Learning Outcomes

Behavioral Outcomes

Long Term Outcomes

Commercial Food Manufacturers

Commercial Food Manufacturers use safe commercial

processing practices.

Revenues from microprocessed foods

increases.

Purdue University is an Equal Opportunity/Equal Access

institution.

LOGIC MODEL

SituationImplementation

Inputs and OutputsOutcomes - Impact

Trends /Desired Situations SocialEconomicCivicEnvironment ContributingFactors

NeededAction   BehaviorPracticeDecisionsPoliciesSocial action

LearningNeeds(Objectives)  AwarenessKnowledgeAttitudesOpinionsAspirationsMotivationsSkills

 Inputs(Resources)  StaffVolunteersTimeMoneyMaterials EquipmentTechnologyPartners

Activities   WorkshopsMeetingsCounselingFacilitationAssessmentProduct devMedia workRecruitmentTraining 

 Participation(Audience)  ParticipantsCustomers /ConsumersCitizens

Short term Learning Outcomes  AwarenessKnowledgeAttitudesOpinionsAspirationsMotivationsSkills

Medium term Action Outcomes  BehaviorPracticeDecisionsPoliciesSocial action

Long Term Impact

   Economic Viability

  Strong Ind. Fam. & Com

Healthy Environment

 Indicators

 

Logic Model

Why Use Logic Models?

Planning Tool Blueprint for Implementation Guides Evaluation Strengthens Case for Investment Simple Image of a Complex

Phenomenon Reflect Shared Understanding Diagnose Program Flaws

Who Uses Logic Models?

W.K. Kellogg FoundationCenters for Disease ControlUnited Way of AmericaHarvard Family Research ProjectCooperative Extension Service

The purpose of performance measures is to capture the ongoing progress the program is making.

It should provide a snapshot of the impact of the work that the organization is doing.

This is an especially important step in establishing accountability to any funder.

Identify all of the services the organization provides & the likely impact these services will have on the community.

Performance Measurement

Determine tracking tools for use in measuring the results of services offered.

These measures should focus on goal outputs & outcomes, as identified by the community needs assessment & defined by the program’s logic model.

The measures should be in quantifiable terms & clearly defined.

A good guide for determining performance measures is the acronym SMART. They should be: Specific Measurable Attainable Realistic Timely

Performance Measurement – Tracking Tools

Analytical study which measures the progress & impact the program has made.

Evaluations should be scheduled & carried out throughout the course of the program.

Should consist of thorough & objective research conducted by an experienced evaluator, starting at the beginning of the program year.

Resources for finding a program evaluator include colleges & universities, research firms, & community organizations.

Evaluator should collect data relevant to the program’s activities & programs &

evaluate the organization’s impact.

The organization should be consistently involved in the evaluation process & should adjust the programs offered according to performance measures & program evaluations in order to best serve the community.

Program Evaluation

CNCS Program Toolkit: http://nationalserviceresources.org/filemanager/download/online/sustainability_toolkit.pdf

Logic Models: http://www.uwex.edu/ces/pdande/evaluation/powerpt/nutritionconf05.ppt

Logic Model Development Guide: http://www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf

Logic Model - University of Idaho: http://www.uidaho.edu/extension/LogicModel.pdf

Resources

Logic Modeling Resources

This Powerpoint Presentation http://www.ca.uky.edu/AgPSD/programdesign.ppt

Program Design Publication http://www.ca.uky.edu/AgPSD/programdesign.pdf

Logic Modeling Course on the Web www1.uwex.edu/ces/lmcourse/

W.K. Kellogg Foundation Logic Modeling Guide www.wkkf.org/Pubs/Tools/Evaluation/Pub3669.pdf