Upload
duongduong
View
230
Download
11
Embed Size (px)
Citation preview
1
Adaptive Management Strategy:
Monitoring and Evaluation
Defining Concepts
Monitoring & Evaluation
- a surveillance & evaluation system- recording of changes after the project has been implemented to see that:
- everything goes according to plan- resources are not wasted
- a continuous process throughout project lifetime?check the progress of the project against
plan and modify if necessary
2
•• Observing a specified area/resource and Observing a specified area/resource and noting changes that occurs over time.noting changes that occurs over time.
•• Taking pictures at regular Taking pictures at regular periods and comparingperiods and comparing
23 June 2004
28 Dec 200428 Dec 200428 Dec 2004
Banda Ache, IndonesiaBanda Ache, Indonesia
3
Coral breakageCoral breakage
beforebefore
afterafter
due to stormsdue to storms
Evaluation
?assessment of design, implementation and results of the project to determine:?Relevance?Efficiency?Effectiveness?Impact?Sustainability
?provide recommendations on future course of the project or management programs?draw lessons for other projects or programs
4
PM&E Indicators
? Key factors which tell about the progress or changes
? Analyze the “costs” and benefits of project
? Types:- process indicators- outcome indicators
Concepts• Monitoring and the importance of benchmarking activities
to obtain information against which succeeding monitoring results shall be compared with
• Monitoring and evaluation (M&E) completes the adaptive management cycle, allowing management to be responsive to the changes that may occur while implementing the intervention (e.g. MPA)
• M&E fosters good governance principles of transparency (e.g. timely feedback), accountability (e.g. clear roles/functions, functional mgt. body) and participatory decision-making (high involvement by community).
5
ADAPTIVE MANAGEMENT CYCLE
Issue Identification/ Planning
Project Design
Implementation & Management
Monitoring & Evaluation
ImpactPerformance
Incentives/Disincentives
accountability
participatory
partic
ipator
yaccountability
functionalitytransparency
How can we make things more effective and sustainable?
Is information feedback accurate and timely?Is the budget allocated appropriately?How much involvement by stakeholders in implementation?
Sustainable management
Sustainable Use Sustainable Benefits
? Management bodiesManagement bodies?? Management plans Management plans and ordinancesand ordinances?? Budgets allocated Budgets allocated for CRMfor CRM?? Implementation Implementation programs functional & programs functional & effectiveeffective
? Increase fish Increase fish size and biomasssize and biomass? Adult and larval Adult and larval spilloverspillover?? Improved Improved habitats and habitats and ecosystemsecosystems? Regulated useRegulated use
? Increased income Increased income for beneficiariesfor beneficiaries?? Increase in Increase in equitable allocationequitable allocation?? Enhance Enhance stewardship stewardship arrangementsarrangements?? Improved quality Improved quality of lifeof life
~ 3 – 5 years
~ 5 – 10 yrs
~ > 10 yrs
Towards Sustainable Development in CRMTowards Sustainable Development in CRMBy Improving Adaptive ManagementBy Improving Adaptive Management
6
Why Monitor?
• To measure the impact of the MPA on the environment and communities (impact assessment)?Biophysical?Socio-Economic
• To evaluate the performance of the management body/group who is implementing the MPA (performance tracking)
7
Guide to Indicator Selection? Choose indicators which are
- valid - reliable- relevant - sensitive- specific - cost-effective- timely - simple- easily measured
? Select indicators by brainstorming? Select a few and measure well? Complementary and not overlapping? Choice by group consensus
Communicating and Acting on Information
? Learning from the experience- achievements analysis- progress review meetings
? Formal reporting requirements- timeliness for action- avoid duplication- consider cost- periodic assessment of usefulness ofreports to users
8
How does PM&E Work?
? Encourage participation of all stakeholders (allow first-hand knowledge on project status)
? Collect baseline information on coastal situation before the start of the project
? Build on participatory experience? Enhance local capability via training? Use various tools for collecting information? Immediate validationcan be simple or complicated
- as long as it works for your project
Preferred conditions for Success
? Mandates are clear and consistent? Incorporate sound theory identifying causal
linkages to policy objectives? Existing legislation to maximize the chance that
implementing officials and target groups will perform best
? Leaders of implementing agency have management and political skills
? Program is supported by constituency groups and key legislators
? Priority of objectives is not influenced by conflicting policies
9
Why monitor MPAs?
? Determine changes in habitat quality & amount of resources? Live vs dead coral? Abundance, diversity and biomass of
fish & other resources (invertebrates, seagrass, seaweeds and mangroves)
Main Sources of Info & Data
? Surveys/rapid assessment (e.g. PCRA)? Visual checking and accurate measurements? Discussion and meeting? Questionnaires? Interviews? Other methods
*Always record informationAlways record information*Prepare reports for implementers and others uses*Prepare reports for implementers and others uses
10
M&E METHODS/TOOLS:
A. Impact Assessment
1. Biophysical (including resilience and effect size)
2. Socio-Economic (including effectiveness and sustainability)
1. Biophysical Variables
-Manta Tow-Snorkel survey-Line/Point intercept (LIT/PIT)-Video transect
Percent CoverLive Coral Cover
inside and outside the MPA Design
Fish Visual Census-Type of fish-Length/Size-Number of fish
Fish BiomassCoral Reefs(% of total area under protection)
MethodMinimum Data Requirements
IndicatorHabitat
11
Manual for participatory reef monitoring
Observing Corals & Algae: Manta Tow
12
119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9
east longitude
4.98
5
5.02
5.04
5.06
5.08
nor
th la
titud
e
119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9
east longitude
4.98
5
5.02
5.04
5.06
5.08
nor
th la
titud
e
Dive sitesManta tow areas
Corals and reef fishes study sitesCorals and reef fishes study sites
Bongao Is.
Sanga-Sanga Is.
13
119.7 119.72 119.74 119.76 119.78 119.8 119.82 119.84 119.86 119.88 119.9
east longitude
4.98
5
5.02
5.04
5.06
5.08
north
latit
ude
Ungos-ungos
0
0.5
1
1.5
2
2.5
3
3.5
1 2 3 4 5 6 7 8 9 10 11 12 13
tow numbersc
ore
Ungos-ungos
0
0.5
1
1.5
2
2.5
3
3.5
1 2 3 4 5 6 7 8 9 10 11 12 13
tow numbersc
ore
Manta tow dataManta tow data
113
Pababag
0
0.5
1
1.5
2
2.5
3
3.5
1 2 3 4 5 6 7 8 9 10 11
tow number
scor
e
Pababag
0
0.5
1
1.5
2
2.5
3
3.5
1 2 3 4 5 6 7 8 9 10 11
tow number
scor
e
1
11
HCSCDC/AR
A combination of relatively good hard and soft coral cover is seen in Pababag and Ungos-Ungos.
A combination of relatively good A combination of relatively good hard and soft coral cover is seen in hard and soft coral cover is seen in Pababag Pababag and and UngosUngos--UngosUngos..
Observing Corals & Algae: Snorkel Survey
14
lifeform transition lengthCF 57 57AA 60 3ACD 80 20AA 89 9CM 100 11AA 102 2CM 104 2A 122 18ACB 136 14AA 141 5CM 166 25AA 173 7SC 214 41AA 217 3CM 224 7AA 231 7CF 251 20CS 272 21
Line intercept
SC200
SC175HC150
AL125
HC100
HC75HC50
HC25
HC0
lifeformpoint
0
25
50
75
100
125
150
175
200
point intercept
• Note substrate below points along x-sect
• Note segment on x-sect where substrate change occurs
15
•• Concrete blocks are laid along the line to Concrete blocks are laid along the line to permanently mark the sitepermanently mark the site
•• Can be used to monitor recruitment in areaCan be used to monitor recruitment in area
Verde Island – Marker Blocks
Only sponges have settled after two years being laid
Siltation is of concern to recruitment
Twin Rocks –Marker Blocks
Good diversity of recruitment after 15 years
Good diversity of recruitment after 15 years
Tubbataha recruitment blocks are nearly 10 years
Good recruitment, survivorship and growthGood recruitment, survivorship and growth
Recruitment, survivorship and growthRecruitment, survivorship and growth
Observing Reef Fishes
Fish Visual Census
16
Expected Output:
FISH GRAPHING FORMSite Name: Tuka Reef Municipality & Province: Kiamba, Sarangani
Zone/Sector: Outside Outside Outside Inside Inside Inside
Month & Year: Oct 1998 Mar 1999 Apr 2000 Oct 1998 Mar 1999 Apr 2000
Types/groups
Groupers
Snappers
Sweetlips
Jacks
Fusiliers
Parrotfishes
Surgeonfishes
Rabbitfishes
2. Socio-Economic Variables
-Logbook/ record keeping
-Types of threats/ disturbance-Frequency of disturbance
-Human -Natural
Threats/ Disturbance
Barangay with the MPA and adjacent barangays
Design
-Fish catch monitoring of individual fishers-Focus group discussions (FGD)-Gear mapping
-Total number of fishers-Major gear types-No. of fishers by gear type-Area of fishing-Average catch per trip (kg)-Frequency of fishing (days, months)-Types of gears used per month
-Gear Map-Catch Per Unit Effort (CPUE)
Fisheries
MethodMinimum Data Requirements
IndicatorVariable
17
18
Fish Catch Monitoring: How to do it on field?
a) Team member collecting catch information (Form 6B)
b) Many individual fishers voluntarily recording their own catches 5 times per month and submitting their forms (Form 6C)
c) Collect and sort data according to gear type
d) Compute for total catch per gear
e) Compute total effort per gear per month
f) Compute for catch per unit effort for each gear per month
g) Plotting of CPUE by gear type
19
20
M&E METHODS/TOOLS:B. Performance Monitoring
1. MPA Rating System (Adopted from CCEF 2005)
• A system intended to assist local governments and communities to improve MPA management
• Minimum set of criteria/activities for every level needs to be satisfied first to be assigned that particular level
• Each criterion/activity will be ranked with high, medium or low according to the governance principles of transparency, accountability and participatory decision-making (TAP).
• High – Activity/criterion satisfies all TAP features
• Medium – 2 out of 3 TAP features are evident• Low – only 1 of the TAP features is evident
Level 1 – MPA is initiated
Management body membership tentatively determined(Management core group starting to conduct regular meetings with proper documentation)
Preliminary management plan drafted (Management plan should include policies, structures & responsibilities, strategies & programs, financial plan and M&E)
Resolution and/or ordinance drafted
?MPA concept accepted(Orientation on MPAs for affected stakeholders from various sectors conducted.Social acceptance sought through community consultations/public hearings composed of representatives from various sectors)
*P*A*TScoreCriteria/Activity Satisfied
Education program raising awareness about MPA functions and benefits started(Conducted a series of public education activities)
Site surveyed using standard methods with baseline assessment complete, preferably conducted in a participatory process(Reports completed on fish abundance, coral cover and profile on community and coastal management)
? Site selected with community acceptance(Based on PCRA and good governance process with public consultat ions)
Minimum criteria/activities to be satisfied are indicated by a star (?)
21
Level 2 – MPA is established
? Budget for Year 1 implementation allocated(LGU has committed a budget for the establishment and implementation activities of the MPA)
IEC activities conducted (e.g. dissemination of MPA rules & regulations; initial stakeholder knowledge assessment conducted)
Boundaries delineated(Anchor buoys, marker buoys and/or boundary marks installed)
Signboards/billboards posted(Should show either map/zones, rules & regulations and/or other relevant details)
MPA outpost or other structures constructed(Guardhouse and/or other MPA-related structures constructed)
Biophysical monitoring includes local participation(Locals were trained to do biophysical surveys using standard methods)
? Management activities started(Conducted initial MPA activities such as guarding, patrolling and surveillance, etc.)
?Management plan adopted and legitimized by the LGU or PAMB(Adoption of management plan supported by resolution/ordinance; plan went through community consultations with multi-sectoral stakeholders prior to approval/legitimization)
?Management body formed(Composition of management group and committees identified; roles & responsibilities clarified and accepted; initial meetings conducted )
? Ordinance passed and approved by the Municipal Council
Community acceptance gained and documented (Documented through public consultation documents, e.g. barangay resolution)
*P*A*TScoreCriteria/Activity Satisfied
Level 3 – MPA is enforced
? Regular participatory biophysical monitoring being conducted(Documented surveys conducted at least once annually using standard methods)
? Collaborative patrolling and surveillance conducted by mandatedenforcement group and local community volunteers(Enforcement group supported by legal instrument; enforcement plan prepared and implemented, e.g. day/night shifts, by mandated enforcement groupwith assistance from local community volunteers)
MPA billboards, boundary markers/anchor buoys maintained(Funds allocated for maintenance of enforcement support structures. May be part of municipal CRM budget)
Management body functional and supported by legal instrument(Implements the management plan including enforcement and monitoring activities based on annual operation plan; conducts regular meetings; provides venue to resolve conflict / issues)
*P*A*TScoreCriteria/Activity Satisfied
? Illegal and destructive fishing reduced outside of MPA(Violations/apprehensions reportedat least or at minimum within 5 km from the MPA boundaries have been reduced by 80% for the past year. This implies that baseline violation repots have been estimated or at least based on the pervious year.)
? Fishing effectively stopped inside the sanctuary zone(No fishing-related violations/apprehensions reported inside sanctuary for the past year or if violations occurred these have been prevented or duly dealt with such that no overall adverse effect on the ecosystem has resulted)
Budget from LGU or from other sources allocated and is accessible for MPA management(There is a legal document by the LGU or an agreement with the private sector allocating budget for MPA management; Financial reports being prepared)
? Education program sustained public awareness and compliance(A long term IEC program is currently being implemented in support of enforcement and the general MPA objectives)
22
Level 4 – MPA is sustained
?Management body regularly monitored and evaluated(Performance monitoring program in place and conducted regularly for 2 consecutive years or more; reporting system for ordinary citizens to complain w/o fear of consequences available and widely known)
?Enforcement system fully operational(Mandated enforcement group implementing regularly prepared enforcement plan; enforcement support structures maintained & patrolling activities sustained over the years; effective reporting system in place)
MPA billboards, boundary markers/anchor buoys maintained(Site development structures and equipment maintained for 3 consecutive years or more)
Management body capable to run the MPA independently(Management body supervises/facilitates management activities [enforcement, budgeting & financial management, M&E, IEC, etc.] and coordinates activities with partners)
*P*A*TScoreCriteria/Activity Satisfied
Socio-economic monitoring regularly conducted(Fisheries and/or socio -economic variables being regularly monitored by local monitoring team; data summaries/reports are available and easily accessible)
Annual participatory biophysical monitoring and timely feedback of results being implemented for at least 2 consecutive years or more after establishment(Documented surveys using standard methods; reports available ; results posted in billboards)
MPA management plan and/or ordinance reviewed in a participatory process(Management plan and/or ordinance amended with the participationof various stakeholders)
Budget from LGU or from other sources is being allocated and accessed for 2 or more consecutive years(Financial reports being regularly prepared , audited and reported; proper procurement & contracting procedures are strictly being followed and transparent)
Environment friendly enterprise and/or fees collected as a sustainable financing strategy(Environment-friendly products/goods to sold tourists, impose collection of user-fees, etc.)
? Illegal and destructive activities stopped inside and within the vicinity of MPA(No violations/apprehensions reported inside and within 5 km of the MPA boundary or violations prevented or duly prosecuted and sanctioned for 2 consecutive years or more)
*P*A*TScoreCriteria/Activity Satisfied
Level 4 – MPA is sustained (continued)
23
Level 5 – MPA is institutionalized
Effective coordination with appropriate national & local agencies on CRM/MPA policies and with other LGUs achieved(Coordination on implementation and resolution particularly of issues that transcend local boundaries)
Evaluation of impacts on ecology and socio-economy conducted completed and feedback mechanisms are in place(Assessment of resource status and long -term trends conducted; Analysis of change in local economy and long -term trends of user groups conducted; Reports of these studies have been completed and reported back to stakeholdersand/or conference or symposia)
Formal commitment from the Provincial Council giving MPA stronger political support(Gives MPA institutional support to strengthen enforcement and collaboration)
Management body capacitated for fund sourcing(Can prepare and submit proposals to seek financial assistance from external sources)
? MPA management plan incorporated in the LGU development plan(MPA incorporated within the long-term LGU area-wide development plan)
Support facilities constructed/added(e.g. tourism facilities, guardhouse expanded into an education/training center, etc.)
Expansion strategies or enhancement programs initiated(MPA coverage is expanded, e.g. from a sanctuary to a park; or scope of conservation activities is heightened, e.g. coral reef restoration, culturing of clams, etc .)
Management plan refined for adaptive management(Incorporates further refinements after gaining much experience and lessons to improve strategies)
*P*A*TScoreCriteria/Activity Satisfied
?Performance M&E linked to an incentive system regularly conducted(Recognition/awards are regularly being given to outstanding member, law enforcer, etc.; incentives can also include priority for granting of available loans or alternative livelihood opportunities; feedback mechanisms for the communities such as suggestion box, complaint desk in the LGU, pulong-pulong, are available)
? IEC program on MPAs maintained over the years(Information dissemination activities sustained according to long -term IEC program ; citizens can conveniently access MPA-related info and LGU-disseminated materials such as minutes of meetings, leaflets, etc.)
Advance IEC materials developed and disseminated with assistancefrom partners and/or private sector grants (e.g. video production)
? MPA emphasizes on public education and is being used as a studytour site, residents advocate for MPAs(After much experience, members are ready to share learningsand impart knowledge; presence of identified group that conducts tours and capable of giving talkson MPAs; paper/s written on their success stories published)
*P*A*TScoreCriteria/Activity Satisfied
Revenues from enterprise and/or fees sustained and accounted for(Existing sustainable financing mechanisms are well-managed and well-documented; financial reports easily accessible)
Level 5 – MPA is institutionalized (continued)
24
M&E METHODS/TOOLS:B. Performance Monitoring
2. Perception Survey
? An independent performance evaluation for the marine sanctuary in complementation with the MPA Rating System
? Objectives:? To validate the impacts of MPA management? To gauge the level of management
effectiveness? To evaluate the performance of the
management body
Design:
? At least 20 respondents from different sectors/ stakeholders within the barangay where the MPA is located
? At least 10 respondents coming from different sectors/stakeholders in each of the adjacent barangay where the MPA is located
? At least 50% of the respondents should be direct stakeholders (e.g. fishers, resort owners, etc.)
25
? Questions:
• Do you know about the marine sanctuary in (state the name of the sanctuary and place)?
? Yes or No? If yes, how did you know?? If no, why do you think did you not know about it?
? Do you think there is an improvement in the area because of the marine sanctuary?
? Yes or No? If yes, what are the improvements?? If no, why do you say that there is no improvement?
? Do you think the marine sanctuary efforts can be sustained?? Yes or No? Why do you say that?
? Do you think the MS management group is functional?? Yes or No
? If yes, in what way is it functional?? If no, why do you think it is not functional?
? Do you support the continued management of the marine sanctuary?
? Yes or No ? If yes, how will you support it?? If no, why will you not support it?
Embedding M&E in CRM programsEmbedding M&E in CRM programs
Among zones and programsAmong zones and programs?? M&E for IEC, social marketing and capacity M&E for IEC, social marketing and capacity buildingbuilding?? M&E for Enforcement and ComplianceM&E for Enforcement and Compliance?? M&E for financing and business plan M&E for financing and business plan implementation for each zonesimplementation for each zones?? M&E for ecological interaction with social and M&E for ecological interaction with social and economic dimensionseconomic dimensions?? M&E for policy and legislative actionsM&E for policy and legislative actions
26
Drawing Up a M&E Program
• Objective of the M&E • What to monitor (parameters)• How to monitor (methods to be used)• Where to monitor (stations inside and outside the marine sanctuary or barangay (village),• Within and among municipalities within nested hierarchical designs and marine biogeographic regions• When to monitor (importance of benchmarking)• Who will monitor (monitoring team; self-assessment)• Logistical needs & support mechanisms• Feedbacking of results
Review of data summarization and analysis-Trainees, local dev’t. workers and external trainers collect data (on the benthos, reef fishes and invertebrates) together. --Supervise data summarization by trainees. - Interpreting Observations- Evaluation & Action
Season 2
A contest-conference amongst various trainee teams may help teams share insights with each other.
POST-EVENT
Trainees collect data (on the benthos, reef fishes and invertebrates) together with technical team.
Data summarization-Trainees/ local monitoring team will collect data (on benthos and reef fishes). - Trainees will use the data collected during the previous monitoring exercises to practice data summarization under the supervision of the trainors.
Trainees/ local monitoring team will collect data (on benthos and reef fishes) together with technical team. Continue practice on data transcription by the trainees.
Review data collection and recording steps-Trainees/ local monitoring team will collect data - If data collection and transcription skills are good by this time, trainorscan begin teaching the data summarization steps. Otherwise, these may be taught on the following season.
Review of basic reef ecology and management-Trainees will practice collecting data while technical team may collect baseline data (on the benthos and reef fishes; survey of invertebrates is optional).
-Orientation on participatory monitoring & evaluation to key community leaders. -Check the site for appropriate bio -physical and socio -economic conditions, logistics and counterpart arrangements
Season 2 Season 1
YEAR 2
Season 2 Season 1
YEAR 3
Season 1
YEAR 1PRE-EVENT
M&E Training Program
27
Area
of co
ral re
ef un
der g
ood p
rotec
tion
STANDARDS
At least Ecogov Level 2 to form into a network.
MPA 1 MPA 2 MPA 3
PERFORMANCE Mgm’t. Body IMPACT
-Biophysical-Socio-EconMPA
NetworkManag
emen
t Effe
ctive
ness
Incentives
Awards
Trust FundsConditionalGrantsTechnicalAssistance
*EG Level 1 – TA in improving MPA*EG Level 2 – TA for MPA networks*EG Level 3 –expected output*EG Level 4 – by Project LOP
Sustaining development through adaptive management
28
Drawing an M&E Plan
Management Performance1.
2.
Socio-Economic1.2.
Biophysical Monitoring1.2.3.
Responsible group
BudgetaryRequirement
Time Frame/Frequency
M&E Activities