Decentralized evaluation for evidence-based decision makingWFP Office of Evaluation

Decentralized Evaluation Quality Assurance System (DEQAS)

Evaluation Inception Report TEMPLATE

Version November 2015

Who is this Template for? This Template is for the development of an Inception Report for a WFP decentralized evaluation. It should be applied by staff who are commissioning or managing a decentralized evaluation and by evaluation teams who are preparing the Inception Report.

What is the purpose of this Template? This template provides a suggested structure and guidance on content for writing the Inception Report for a decentralized evaluation. In doing so it sets out WFP’s expectations for its Inception Reports of decentralized evaluations.

How should this Template be used? This template is used alongside the Quality Checklist for Inception Reports to help ensure that all the elements of the quality standards are adequately addressed.

How is this Template structured? Within this Template:

A box containing guidance is provided at the start of each section, where necessary.

Text presented in italics provides guidance for the template user Text in standard format is suggested content for the Inception Report Text in [highlighted square brackets] indicates that this part should be

completed by the user Reference to various elements of the guidance is underlined

Other key materials? Additional relevant guidance can be found in:

The Process Guide for Decentralized Evaluations, which sets out the Phases of an evaluation and how to implement each one;

Relevant Technical Notes, particularly those which relate directly to the type of evaluation for which the Inception Report is being prepared

Decentralized Evaluation

Decentralized evaluation for evidence-based

decision making

Prepared by[name, Team Leader][name, title of team member 1][name, title of team member etc]

[Month Year][Name of commissioning office]Evaluation Manager [Name of Evaluation Manager]

[Evaluation Title][Period covered] Inception Report

Table of Contents

List of Acronyms..............................................................................................1. Introduction..............................................................................................2. Context......................................................................................................3. [Subject of the Evaluation]........................................................................4. Stakeholder analysis.................................................................................5. Evaluation approach and methodology.....................................................5.1................................................................................Proposed approach and methodology

65.2....................................................................................................................................Site mapping

65.3....................................................................................Data Collection Methods and Tools

65.4..................................................................................................................Limitations and risks

75.5.............................................................................................................................Ensuring quality

76. Organization of the evaluation..................................................................6.1.........................................................................................Team composition and workplan

76.2..............................................................................................................................................Timeline

86.3...........................................................................................................Data collection schedule

96.4...............................................................................................Support/Information required

9Annexes.........................................................................................................Annex 1 Map..............................................................................................Annex 2 Evaluation Matrix......................................................................Annex 3 Data Collection Tools...................................................................Annex 4 Evaluation Mission Schedule.......................................................Annex 5 Documents gathered....................................................................

List of Acronyms

OEV Office of EvaluationSOP Standard Operating ProcedureTOR Terms of ReferenceWFP World Food Programme

Inception Report template Version November 2015 1 | P a g e

The Inception Report ensures that the evaluation team (leader and members) have an in-depth understanding of the TOR of the evaluation. It translates the TOR into an operational plan according to which the evaluation will be carried out. The Inception Report is a working document which forms the agreement between the Evaluation Manager and the Evaluation team on the operational plan for the evaluation.The maximum length for an Inception Report (excluding Annexes) is 20 pages.

1. Introduction

Provide a brief introduction including key characteristics of the decentralized evaluation:

Main purpose for the evaluation Expected users for the evaluation WFP’S strategic context for the evaluation

Length: 1-2 pages

1. This Inception Report is for the evaluation of [evaluation subject] in [geographic area]. This evaluation is commissioned by [name of Commissioning Office] and will cover the period from [month/year] to [month/year].

2. The main objectives of the evaluation are [list accountability and learning objectives as per the TOR].

3. The purpose of this Inception Report is to provide the main operational plan for the evaluation. It provides information on the context, the subject of the evaluation, its stakeholders, the approach and methodology that will be used for the evaluation, and how the evaluation will be organized. It also provides information on how the evaluation will be disseminated and used. The expected users for this Inception Report are [specify].

4. [Provide any additional information that is relevant to the evaluation].

2. Context

Provide a brief overview of the country context directly relevant to the evaluation. Provide sufficient information to understand the implications of context for the activity under evaluation. Include information about: Poverty, food security in relation to the subject of the evaluation Government policies and priorities in relation to food security/the subject

of the evaluation Humanitarian issues as they relate to food security and the subject of the

evaluation Gender dimensions of the context, in relation to food security, nutrition

Inception Report template Version November 2015 2 | P a g e

situation and the subject of the evaluation The gender situation in the country more broadly, including gender

architecture, government strategy and policies to address gender inequality, and relevant gender indicators e.g. Gender Inequality Index.

Key external events which led to significant changes in WFP’s work (such as migration patterns or host community/social tensions)

Features of international assistance in the area: Long-standing donors/agencies in the country, level of resources, humanitarian and development assistance etc.

Other WFP work in the area and related work of other humanitarian/development actors

Maximum length: 3-4 pages

[Evaluation team text to be added reflecting the above contextual information]

3. [Subject of the Evaluation]

Include key facts and description of the subject of the evaluation, namely: Type of intervention (operation, activity, thematic area, transfer

modality, pilot project) Geographic scope of the evaluation subject Relevant dates: Approval date; start date; end date Planned outputs at design

o Beneficiary numbers (planned and revised) disaggregated by gender/activity

o Amount of transfers (food, cash, vouchers)o Any other outputs, including those related to capacity development

and technical assistance Planned outcomes at design Key activities Main partners (Government; NGOs; Bilateral; Multilateral) Resources (% funded of total requirements) and key donors. If subject

funded from pooled funds or if the evaluation covers one component/activity of an operation, show resource allocated to the subject of evaluation

Other relevant preceding/ concurrent activities/ interventions/operations

Any amendments to initial design Gender equality and women’s empowerment dimensions relevant to

subject of the evaluation and context Quality of gender analyses undertaken and integrated in programme

design.

Length: maximum 2 pages

Inception Report template Version November 2015 3 | P a g e

Timing

Include: Approval date Duration of the intervention Budget revisions (if appropriate)

Objectives and Activities

Include: Strategic objectives if applicable Key activities (where e.g. an operation is being evaluated)

Outputs and planned beneficiaries

Include: Planned outputs of the intervention Tonnage/cash/vouchers distributed if applicable Planned beneficiaries of the intervention, disaggregated by sex, age

and other categories as appropriate

Outcomes

List the planned outcomes of the intervention, and achievements as determined from the data available at the inception phase

Logical Framework or Logic Model

Provide the Logical Framework or Logic Model (or similar tool e.g. a results framework) for the intervention if available. If not available, the evaluation team will have to reconstruct it in order to inform the evaluation matrix and get it approved by the evaluation commissioner during the inception phase. The implications of applying the reconstructed version will need to be explained. See TN on Logical Frameworks and Logic Models.

Partners

List key partners involved in the intervention e.g.: Government United Nations agencies NGOs Private sector

Resource requirements and funding situation

Include: Total resource requirements and budget allocated to date (Planned

budget at the start of the evaluation period and funding level at the end

Inception Report template Version November 2015 4 | P a g e

of the evaluation period; description of revisions)main donors

Any changes in the above features over time

Gender dimensions of the intervention

Explain the gender dimensions of the intervention: Which aspects of gender the intervention sought to address Through which strategies Any gender-related targets and intended results How gender dimensions were intended to be measured

4. Stakeholder analysis

Building on the preliminary stakeholder information from the TOR, provide stakeholder analysis, including

• Who the different groups involved in the evaluation subject are with reference to specific agencies or individuals;

• What their stake in the evaluation is and;• How they will be involved in the evaluation, with consideration of

the most appropriate method for each group.• Whenever relevant clarify expected use

See TN on Stakeholder Analysis

Length: 1-2 pages

[Insert relevant analysis and diagnostic tool applied]

Table 1: Sample Stakeholder analysis and mapping

Stakeholder

Interest in the [

Intervention/Project/Operation]

Involvement in Evaluation and

likely use

Who (specifically

for the Evaluation)

Internal (WFP) stakeholders

External stakeholders

5. Evaluation approach and methodology

Provide detailed information about the overall methodological approach that

Inception Report template Version November 2015 5 | P a g e

will be used to undertake the evaluation and the methods selected for data collection and analysis. Ensure a comprehensive and systematic description, which is sufficient to generate trust in the credibility of the evaluation as well as its independence and impartiality.

Include information about: Evaluation criteria and questions will be applied (See TN on Evaluation

Criteria and Questions). Building on the criteria and questions identified in the TOR refine/clarified the evaluation questions so that they can be meaningfully addressed in the evaluation report.

The conceptual and methodological approach that will be applied, and how it will minimize threats to validity and ensure reliability and credibility of the evaluation (See TN on Methods )

The Evaluation Matrix (provide in an Annex - see TN on Evaluation Matrix )

The specific tools that will be applied (see TN on Methods ) How the perspective of key stakeholders will be included How the evaluation methodology will be gender-responsive, including

any data collection method employed to seek information on gender issues and ensure the inclusion of women and marginalised groups (See TN on integrating gender in WFP evaluations, Checklist, and Quick Guide )

How independence and impartiality will be safeguarded in the evaluation’s design (see TN on Independence and Impartiality )

What limitations are likely to arise, and how these will be mitigated

Length: maximum 3-4 pages

5.1. Proposed approach and methodology

Describe evaluation criteria, questions and the overall methodological approach. Ensure that the selection of evaluation criteria is justified, and their application in the evaluation clear. Link evaluation questions explicitly to each of the chosen criteria.Detail the Evaluation Matrix, its role in the evaluation and how it has been developed, and how it will be applied. Specify the use of a mixed-methods approach. Describe availability and reliability of data/information and the data requirements to ensure rigour in the evaluation process. To accomplish this, use the data availability and reliability assessment framework annexed to the technical note on evaluation matrix.Specify the integration of gender into the methodological approach.

5.2. Site mapping

Provide information about how the team has selected the intervention sites to be visited during fieldwork. Include the geographic coverage of the intervention and explain the sampling for the selection of areas to be visited (selection criteria to be made explicit).

Inception Report template Version November 2015 6 | P a g e

Provide information about the number of beneficiaries and key partners or stakeholders in each site. Information on how men, women, boys and girls will be appropriately and proportionately represented by the sample of field sites to be visited should also be included.

5.3. Data Collection Methods and Tools

Include description of data collection and analysis methods to be applied in the evaluation. Specify both qualitative and quantitative methods, including participatory approaches where feasible. Explain their specific application within the evaluation matrix, particularly in relation to the data sources available.

Describe:

The nature of data/information collection methods. Highlight their comparative advantage, inherent constraints and solutions to address them.

The chosen methods should be explicitly linked to the Evaluation Matrix and be informed by the stakeholder analysis as well as by an analysis of the reliability and completeness of the data collected during the design and inception phases (secondary data, M&E information, previous evaluations, etc.) - see TN on Methods

In summary, the data collection tools (Actual tools should be presented in annexes).

How the methodology will be gender-responsive, including what data collection methods will be employed to seek information on gender issues and to ensure the inclusion of women and other marginalised groups.

How data collection activities will be undertaken in a gender-sensitive manner.

Any limitations with regards to the gender-responsiveness of the chosen approach.

How validity and reliability of data collection and analysis will be ensured, including methods for triangulation.

How data will be checked and cleaned, where relevant

5.4. Limitations and risks

Describe any limitations to address the evaluation questions in view of data availability and explain how methodology proposed will mitigate the limitations. Identify the risks to the evaluation and how the team proposes to overcome them.

Inception Report template Version November 2015 7 | P a g e

This may include limitations/risks anticipated in the evaluation due to availability of data, timing of field visits, etc. Provide an explanation of how the evaluation team will manage and mitigate within these limitations/risks and/or their implications for the evaluation process and reporting.

[Describe limitations of methods and approach here, proposed mitigation measures and implications]

5.5. Ensuring quality

Describe the quality assurance mechanisms that will be applied on the evaluation process and product to ensure the credibility, independence and utility of the evaluation.

[Description of quality assurance mechanisms]

6. Organization of the evaluation

Include the key components of the evaluation’s organization including the team composition, the workplan, the Phases of the evaluation, including timing and duration of data collection and analysis, and indicate what support, if any, will be needed from WFP.Length: up to 6 pages

6.1. Team composition and workplan

Describe the expertise of each team member in line with TOR requirements, and how their skills are complementary. Include gender expertise

Specify respective roles and responsibilities for each team member Describe how the team will work together during the implementation of

the evaluation, to ensure a co-ordinated approach

[Briefly describe team composition and complimentary of skills. Summarise the roles and responsibilities in table 2]

Table 2: Sample Team composition and workplanTeam

MembersPrimary

RoleSpecific tasks

within the Evaluation

Deliverables Dates

Inception Report template Version November 2015 8 | P a g e

6.2. Timeline

Present the specific timeline, revised if appropriate from the TOR, and the associated deliverables (with specific dates) linked to it. A sample timeline is provided (see below and also Evaluation Timeline Template).

Table 3: Sample Timeline

Responsible Stakeholder

Activities Key dates

Inception phase

Deliverable (e.g. Inception report)Data collection and Analysis

Deliverable (e.g. Draft Evaluation Report)

Dissemination and follow up

Deliverable (e.g. Power point presentation)

6.3. Data collection schedule

Present the schedule as discussed with the relevant WFP Office for feasibility.

The list of proposed stakeholders to be met and sites to be visited is informed by stakeholder analysis and site mapping and should be balanced to demonstrate impartiality

Include a detailed plan in an Annex. Table 4: Sample mission schedule

Days/dates Team member Locations/sites Stakeholders

Inception Report template Version November 2015 9 | P a g e

6.4. Support/Information required

[Indicate what support (logistical/operational) and information will be required from WFP staff and other stakeholders as appropriate, based on what is available as at the time of preparing the inception report]

Inception Report template Version November 2015 10 | P a g e

Annexes

Annex 1 Map

[Include a map of the area of intervention/project area here]

Inception Report template Version November 2015 11 | P a g e

Annex 2 Evaluation Matrix

Refer to the TN on Evaluation Matrix

[Include evaluation matrix]

Inception Report template Version November 2015 12 | P a g e

Annex 3 Data Collection Tools

Inception Report template Version November 2015 13 | P a g e

Annex 4 Evaluation Mission Schedule

Day Date Team leader Tools Team member 1 Tools Team member 2 ToolsWhat / Where What / Where What / Where

Inception Report template Version November 2015 14 | P a g e

Annex 5 Documents gathered

Document Type Comment / Titles & dates of documents receivedReceived

- Y/N (N/A)

Link to Evaluation matrix

Project related documents [if applicable]Appraisal mission reportProject document (including Logical Framework in Annex)Standard Project ReportsBudget RevisionsNote for the record (NFR) from Programme Review Committee meeting (for original operation and budget revisions if any)Approved Excel budget (for original intervention and budget revisions if any)Intervention/Project Plan (breakdown of beneficiary figures and food requirements by region/activity/month and partners)Other

Country Office Strategic Documents (if applicable)

Country Strategy Document (if any)Other

Assessment Reports [if applicable]Comprehensive Food Security and Vulnerability AssessmentsCrop and Food Security Assessments (FAO/WFP)Emergency Food Security AssessmentsFood Security Monitoring System BulletinsMarket Assessments and BulletinsJoint Assessment Missions (UNHCR/WFP)

Inception Report template Version November 2015 15 | P a g e

Inter-Agency AssessmentsRapid needs assessmentsCash and voucher feasibility studiesOther

Monitoring & Reporting (if applicable)M&E PlanCountry Situation Report (SITREP) Country Executive BriefFood Distribution and Post-distribution Monitoring ReportsMonthly Monitoring ReportsBeneficiary Verification ReportsDonor specific reportsOutput monitoring reports (if applicable)

Actual and Planned beneficiaries by activity and district/ location by yearMale vs. Female beneficiaries by activity and district/ location by yearBeneficiaries by age groupActual and Planned tonnage distributed by activity by yearCommodity type by activityActual and Planned cash/voucher requirements (US$) by activity by year

Operational documents (if applicable)Organigram for main office and sub-officesActivity GuidelinesMission ReportsPipeline overview for the period covered by the evaluationLogistics capacity assessment

Inception Report template Version November 2015 16 | P a g e

Partners (if applicable)Annual reports from cooperating partnersList of partners (Government, NGOs, UN agencies) by location/ activity/ role/ tonnage handledField level agreements (FLAs), Memorandum of Understanding (MOUs)

Cluster/ Coordination meetings (if applicable)

Logistics/Food Security/nutrition cluster documents NFRs of coordination meetingsOther

Evaluations/ ReviewsEvaluations/ reviews of past or on-going operation

Resource mobilisation (if applicable)Resource SituationContribution statistics by monthResource mobilization strategyNFRs Donor meetings

Maps (if applicable)Operational MapLogistics MapFood/Cash/voucher Distribution Location MapFood Security Map

Other documents collected by the team (including external ones) (if applicable)

SpecifySpecifySpecifySpecify

[Amend as appropriate]

Inception Report template Version November 2015 17 | P a g e

[Name of commissioning Office][Link to the website]

[Place, Month and Year, Report num

ber]