Impact assessment and RBM in the FISH

CRP: a quick overview

Andrew Thorne-Lyman, MHS, ScDImpact Assessment Focal point, Senior Nutrition Specialist, WorldFish Center

Adjunct Lecturer, Harvard School of Public Health

Presentation overview

• Describe the CRP targets

and research activities

• Components of the

RBM/MEL/IA system

• Approach to IA

• Challenges, constraints

and needs

Outcomes by 2022:

Productivity and Livelihoods

4.9m households adopt improved

breeds, aquafeeds, fish health,

aquaculture and fisheries

management practices

3.5mpeople assisted to exit poverty

through gender-inclusive

livelihood improvements

Outcomes by 2022:

Food and Nutrition Security

4.7mmore women of reproductive age

consume an adequate

number of food groups

2.4mfewer people suffering from

deficiencies in essential

micronutrients, with at least

50%women

Outcomes by 2022:

Environment and Ecosystem Services

3.3m haof ecosystems restored through

more productive and equitable

management

Greenhouse gas emissions reduced by

20%,

and water and nutrient use efficiency

increased by

10%,

in 4.8m metric tons of annual farmed fish

production

Flagship 1: Aquaculture

Challenges

• Rapid growth

• Low production efficiency

• Diseases

• Pollution

• Dependence on wild

stocks

• Dependence on fish-

based feed

• Gender inequities

Research needs

• Breed improvements

• GIFT Tilapia

• Rohu

• Fish health

• Sustainable feeds

• Environmental

management

• Gender equitable

distribution of

economic and

nutritional benefits

Flagship 2: Small-scale fisheries

Challenges

• Severe pressure from

overfishing, particularly in

resource-poor regions

• Highly complex ecological,

social and institutional

environments

• Productivity and

sustainability often

undermined by poor

governance

• Gender and social

inequities

Research needs

• Resilience based

analyses and

interventions to

support improved

governance in coastal

and inland systems

• Analysis of trends in

context of global food

systems

• Policy research to

enhance governance,

improve safety nets

and build resilience

Flagship 3: Nutrition

Challenges

• Lack of diversity in the

cereal-based diets of the

poor, particularly of

women and children

• Post harvest losses

• Fish often not integrated in

nutrition strategies

• Low fish consumption by

people most in need

Research needs

• Sustainably increase

the production of small

indigenous fish to

grow this source of

nutrition for poor

consumers

• Analyze value chains

to reduce waste and

loss in markets

supplying poor

consumers

• Identify ways to

increase consumption

of fish by poor,

reproductive-age

women and young

children

Geographic Scope

6 focal countries integrating research and development outcomes

across all 3 flagships

Aquaculture research hub

and training center

2 focal countries for

specific flagships

Hub for learning networks

on small-scale fisheries

governance

Impact assessment budget and plans

• Current status in WorldFish

• 1 focal point in HQ (part time)

• Expertise Bangladesh and Pacific (dedicated to bilateral projects)

• FISH CRP Budget Elements (IA $7M over 6 years, 3.9% of CRP

Budget)

• Human resources

• 1 M&E Lead

• Full time international scientist M&E design and

implementation

• Full time Program Coordinator- output planning and

monitoring

• Database developer

• Dedicated staff time in focal countries

Budget elements (continued)

• Database for real-time data entry

• Tablet-based system for sample surveys

• Evaluations and impact assessments

• Annual evaluations and reviews

• Flagship specific

• Impact assessments (internal resources)

• Estimating economic social and environmental benefits of

FISH research outputs

• Contribution and value added

• Contingent, contextual factors supporting claims for CRP

effectiveness

Measuring dissemination of GIFT

• Tilapia hatcheries can produce >15

million fingerlings per year

• Rapid scale-out

• Flush through system- farmers do no

breeding.

• Records from breeding nuclei allow

tracking of distribution to

multiplication hatcheries

• Tracking of what hatcheries have and

sales by hatcheries can be used to

estimate what farmers are growing

• Do hatcheries know what they have?

Validation study in Philippines and

Bangladesh

• Study adoption and on the ground

productivity after 2-3 years

Progress to date: Hatchery sampling

PHILIPPINES BANGLADESH

2015 Production Hatcheries

Fingerling

s

sampled (millions)Uncertain 45 258.4

Non-GIFT Derived 23 85.6GIFT Derived 41 210.1

Total 109 554.1

2015 Production Hatcheries Fry

sampled (millions)Uncertain 44 308.3

Non-GIFT Derived 8 84.5GIFT Derived 61 354.7

Total 113 747.5

Objective 4: Genetic origins of hatchery-level tilapia stocks

Examples of indicators/measurement

approaches: sub-IDO level

Sub IDO Indicator(s) How collected Frequency

Closed yield gaps

through improved

agronomic and

animal husbandry

practices

Average production

(kg/hectare/year)

Logbooks, sample

surveys, partner

reports

Annually

Improved diets Fish consumption,

WDDS, WFP FCS,

disagg. by gender

Surveys, secondary

data. Farmers and

non-farmers

Every 3 years

Food safety Reduced biolog./chem

hazards in food system

Sample surveys Every 3 years

Increased income/

employment

#men and women

assisted to exit poverty

Household surveys,

well being indicators,

HEIS, national data

Every 3 years

Understanding narratives of change

Achieving and measuring influence

• Importance of establishing RBM

culture for achieving influence

• Managing for project outputs

vs. project outcomes vs.

managing for larger change

• Online tracking system for real-

time data collection

• Technology mentions?

• Policy changes

• Annual ‘results harvesting’

workshops/after action reviews

• Partner surveys?

Challenges: measuring impact on dietary

diversity and micronutrient status

Challenges

• No baseline

• Capturing effects on

diets of farmers and

non farmers (and

pathways)

• Responsiveness of

indicators

• Appropriateness of

secondary data?

Approaches

• Assumptions for now

• Build in studies to

establish relationships

between our primary

outcome indicators and

SLO indicators

Challenges and constraints

• Expertise and capacity

• Quantitative and qualitative

• Resources

• Does bilateral funding align

with bigger picture IA?

• Estimating impacts

• Lack of baseline data

• Suitability of secondary

data

• Precision to detect

• Attribution

• Capturing scaling and

partner adoption

Thank You