Embed Size (px)
DESCRIPTION
Program evaluation is a component of program design and implementation that is often considered after the program is in place and serving a population. Designing a program with measurable goals in mind creates stronger programming, gives grant proposals a competitive edge, and provides an agency with useful feedback to help achieve its mission. Most importantly, program evaluation allows for program tweaking to deliver the best service possible to the client.
Citation preview
If You Evaluate It, They Will Fund:
Program Evaluation Essentials
Cecilia Harry
Special Thanks To Our Sponsors
A Proud Sponsor of NonprofitWebinars.com
Helping ordinary people raise extraordinary amounts for nonprofits is all we do, and we love it.
Today’s Speaker
Hosting:
Sam Frank, Synthesis Partnership
Cecilia Harry Economic Development Coordinator,
Leavenworth County Development Corporation
Assisting with chat questions: April Hunt, Nonprofit Webinars
If You Evaluate It, They Will FundProgram Evaluation Essentials
Cecilia Zappa Harry, MSW
Key Points
• Program evaluation is a necessary step in program development to ensure quality programing and to maximize funding opportunities.
• There are hidden benefits to incorporating program evaluation into your program, and can help you evaluate much more than just the outcomes of your program.
What you will learn
• Why program evaluation is worth the effort
• What makes a strong program
• How to use a logic model
• Types of evaluations techniques
What you will NOT learn
• What makes your program strong or less strong
• What evaluation techniques are best for your programming
• How to conduct different evaluation techniques
Why Include Program Evaluation?• Stronger programming
• Better grant proposals
– More funding opportunities
• More feedback for even stronger programming
• Even more funding opportunities
Other Reasons for Program Evaluation• Required
• Efficacy of new interventions
• Accountability
What Makes a Strong Program?
What Makes a Strong Program?
• Evidence-based foundation
• Adequate staffing
• Appropriate budget
• Stable funding
• Clear service philosophy - identity
• Ongoing or finite presence
• Conceptual/theoretical foundation
• Empirical evaluation of services
The Logic Model
Resources
Inputs
ActivitiesOutputs
Client Outcomes
The Logic Model
Resources Activities OutputsShort-Term
Outcomes
Impact/Long-
Term Outcomes
(Goals Revisited)
What is needed to
accomplish the
activities?
What needs to be
done to accomplish
objective(s)?
What
events/products
can we record or
count to monitor
our activities?
What changes do
we expect to see in
the short-term?
What changes do
we expect to
eventually see in
the long-term?
• Staff• Materials• Client
population
• Classes• Counseling• Programming
• Attendance• Surveys• Level of
interaction• Occurrences of
improved activity
• Increasedknowledge
• Changed patterns of behavior
• Self-reports
• Longer-termdemonstrations of short-term outcomes
• Will look similar to goals/ objectives
DISCLAIMER• The logic model IS NOT a form of evaluation
• The logic model IS a framework to help shape programming and ensure evaluation is considered
– Spells out assumptions
– “If ______, then _____.”
Limitations• Representation, not reality
• Focus is on expectations
• Cause/effect relationship uncertain
• Won’t know if it’s successful until you try
The Logic Model
Resources Activities OutputsShort-Term
Outcomes
Impact/Long-
Term Outcomes
(Goals Revisited)
What is needed to
accomplish the
activities?
What needs to be
done to accomplish
objective(s)?
What
events/products
can we record or
count to monitor
our activities?
What changes to
we expect to see in
the short-term?
What changes do
we expect to
eventually see in
the long-term?
• Staff• Materials• Client
population
• Classes• Counseling• Programming
• Attendance• Surveys• Level of
interaction• Occurrences of
improved activity
• Increasedknowledge
• Changed patterns of behavior
• Self-reports
• Longer-termdemonstrations of short-term outcomes
• Will look similar to goals/ objectives
EVALUATION
EVALUATION
Evaluation Types• Needs assessment
• Qualitative
• Quantitative
• Mixed methods (Qualitative & Quantitative)
• Formative/process evaluation
• Client satisfaction
• Cost-effectiveness/analysis
Ethical Considerations• Participants must be volunteers
• Disclosure of risks/discomforts to participants
• Do no harm
• Protection of sensitive information
Vulnerable Populations• Children
• Mental Capacity Considerations
• Prisoners
Again, Why Program Evaluation?• Funding applications
• Ongoing evaluation
• Funding reports
• Membership fundraising
• New funding opportunities
• Board reports
• Mission drift prevention & strategic planning
• Multiple goals with multiple objectives
• Who is the client? You decide!
Resources
• Program Evaluation: An Introduction by Royse, Thyer & Padget, 5th Edition, 2010
• University of Wisconsin Extension– http://www.uwex.edu/ces/pdande/evaluation/evallogicmodel.html
• W.K. Kellogg Foundation Logic Model Development Guide – http://www.wkkf.org/knowledge-center/resources/2006/02/WK-
Kellogg-Foundation-Logic-Model-Development-Guide.aspx
Questions? Comments?
• Webinar feedback
• Cecilia Zappa Harry, MSW
– http://about.me/ceciliaharry
– Twitter: @cecilia_harry
Find the listings for our current season of webinarsand register at
NonprofitWebinars.com
Chris [email protected]
707-812-1234
Special Thanks To Our Sponsors
