Context EvaluationContext Evaluationknowing the settingknowing the setting

How Different Can Schools Be?How Different Can Schools Be?

What factors would you What factors would you want to consider?want to consider?

How Different Can Schools Be?How Different Can Schools Be?

Student / Family PopulationStudent / Family Population– Linguistic / Cultural DiversityLinguistic / Cultural Diversity– Special Needs ChildrenSpecial Needs Children– Poverty StatusPoverty Status

Community SupportCommunity Support Funding / Resources / FacilitiesFunding / Resources / Facilities Management / Climate / Management / Climate /

SupportSupport Teaching StaffTeaching Staff

Context Impacts EvaluationContext Impacts Evaluation

How can context impact program How can context impact program implementation?implementation?

How can context impact choice of How can context impact choice of evaluation activities?evaluation activities?

How can context impact program How can context impact program effectiveness? effectiveness?

CIPPI ModelCIPPI Model

ContextContext InputInputProcessProcessProductProduct ImpactImpact

The goal is to make The goal is to make INFORMEDINFORMED judgments about Program merit or judgments about Program merit or value.value.

The Nature of Evaluation The Nature of Evaluation TasksTasks

The goal is to make The goal is to make INFORMEDINFORMED judgments about judgments about Program merit or value.Program merit or value.

Making judgments requires Making judgments requires good interpretation skills.good interpretation skills.

As with all interpretive tasks, As with all interpretive tasks, Context is King.Context is King.

Context Evaluation Context Evaluation

The central task in a Context The central task in a Context evaluation is the development evaluation is the development of a thorough understanding of a thorough understanding of the setting within which the of the setting within which the Program operates and the Program operates and the conditions under which the conditions under which the treatment is delivered. treatment is delivered.

Evaluation Strategies Evaluation Strategies

Key Informant InterviewsKey Informant Interviews

Site VisitsSite Visits

Records ReviewRecords Review

Initial Questions Initial Questions

What is the mission of the What is the mission of the Program?Program?

What long-term and mid-term What long-term and mid-term goals has the Program set for goals has the Program set for itself?itself?

What specific objectives is the What specific objectives is the Program trying to meet?Program trying to meet?

Target PopulationTarget Population

Who are the intended Who are the intended beneficiaries, or target beneficiaries, or target population, of the Program?population, of the Program?

What are their needs?What are their needs?

Has the program done any Has the program done any formal needs assessment?formal needs assessment?

StakeholdersStakeholders

Who are the stakeholders of Who are the stakeholders of the Program?the Program?

What are the attitudes and What are the attitudes and expectations of stakeholders? expectations of stakeholders?

How do the stakeholders feel How do the stakeholders feel about the evaluation of the about the evaluation of the program?program?

StakeholdersStakeholders

Describe the relationship Describe the relationship between the Program and between the Program and the stakeholders.the stakeholders.

Describe any other relevant Describe any other relevant

facets of the Program’s facets of the Program’s external relations and external relations and reputation in the reputation in the community.community.

Program NeedsProgram Needs

What needs does the What needs does the Program have?Program have?

Does the Program have Does the Program have the resources it needs to the resources it needs to deliver the intended deliver the intended services?services?

Program NeedsProgram Needs

What barriers does the What barriers does the Program face in Program face in attempting to meet: attempting to meet:

– its objectives?its objectives?– the needs of the target the needs of the target

population?population?

Audience for the Audience for the EvaluationEvaluation

Who are the stakeholders Who are the stakeholders of the evaluation?of the evaluation?

What decisions will be What decisions will be based on the results of based on the results of the evaluation?the evaluation?

Program History and Program History and StructureStructure

Describe the funding, Describe the funding, governance, and governance, and management structure of the management structure of the Program.Program.

Are there Agency / Program / Are there Agency / Program / Organizational policies that Organizational policies that might impact the success of might impact the success of the Program?the Program?

Program History and Program History and StructureStructure

What is the history of the What is the history of the Program?Program?

What community / What community / political / social conditions political / social conditions have influenced the have influenced the Program in the past?Program in the past?

Document CooperationDocument Cooperation

Evaluate the cooperation Evaluate the cooperation of the Program of the Program throughout the context throughout the context evaluation process (i.e. evaluation process (i.e. access to documents, access to documents, stakeholders, data stakeholders, data sources, etc.).sources, etc.).

ConclusionConclusion

Given all of the contextual Given all of the contextual information you have information you have been able to obtain, does been able to obtain, does the Program have a the Program have a reasonable chance to reasonable chance to succeed?succeed?