12
Assessing the impact of sheries co-management interventions in developing countries: A meta-analysis Louisa Evans a, b , Nia Cherrett a , Diemuth Pemsl a, * a The WorldFish Center, P.O. Box 500 GPO,10670 Penang, Malaysia b The ARC Centre of Excellence for Coral Reef Studies, James Cook University, Townsville, Queensland 4811, Australia article info Article history: Received 13 July 2010 Received in revised form 24 January 2011 Accepted 8 March 2011 Available online xxx Keywords: Small-scale sheries Co-management Governance Environment Livelihoods Impact assessment abstract Co-management is now established as a mainstream approach to small-scale sheries management across the developing world. A comprehensive review of 204 potential cases reveals a lack of impact assessments of sheries co-management. This study reports on a meta-analysis of the impact of sheries co-management in developing countries in 90 sites across 29 case-studies. The top ve most frequently measured process indicators are participation, inuence, rule compliance, control over resources, and conict. The top ve most frequently measured outcome indicators are access to resources, resource well-being, shery yield, household well-being, and household income. To deal with the diversity of the 52 indicators measured and the different ways these data are collected and analysed, we apply a coding system to capture change over time. The results of the meta-analysis suggest that, overall sheries co- management delivers benets to end-users through improvements in key process and outcome indi- cators. However, the dataset as a whole is constituted primarily of data from the Philippines. When we exclude this body of work, few generalisations can be made about the impact of sheries co-manage- ment. The lack of comparative data suitable for impact assessment and the difculties in comparing data and generalising across countries and regions reiterates calls in other elds for more systematic approaches to understanding and evaluating governance frameworks. Ó 2011 Elsevier Ltd. All rights reserved. 1. Introduction Small-scale sheries (SSF) provide essential ecosystem services to large numbers of people in the developing world. The impor- tance of this sector for the local and national economies of many developing countries and the well-being of their people is gaining recognition (see Béné et al., 2007; FAO and The WorldFish Center, 2008; World Bank, 2004; World Resource Institute, 2005). However, sustainable development of SSF remains a considerable challenge, particularly in contexts of poverty, high dependence of increasing populations on ecosystem services, economic global- ization and climate change (Andrew et al., 2007). This trend is often considered a crisis of governance (Acheson, 2006; Mahon et al., 2010; Young et al., 2007). Co-management is an alternative approach to conventional management of natural resources, which has found considerable traction within the sheries sector. Co-management is dened as the sharing of responsibility and authority between the state and resource-users but often involves collaboration between a variety of stakeholders, including different government agencies, non- governmental organizations, research organizations, private enterprises and civil society more generally (Carlsson and Berkes, 2005). It aims to strengthen the potential of customary manage- ment to protect both the local environment and the stakes and rights of resource-users while improving the legitimacy of state involvement in sheries management through more inclusive and transparent decision-making processes. Inclusion of relevant and entitled shery stakeholders can lead to more effective collective action (at appropriate scales), conict resolution, and higher compliance to management institutions (and therefore reduced costs of enforcement) as well as to integration of more diverse knowledge and value systems on which to base decisions, leading to better problem denition, social learning, and innovation (Berkes, 2009; Kuperan et al., 2008; Pomeroy et al., 2007). The co-management and participatory management paradigms have been institutionalised through national environmental and development policy and legislation in many countries. Often these efforts are closely associated with other decentralisation processes, for example in the Philippines, Indonesia and Cambodia. In other cases, the co-management approach is simply promoted within * Corresponding author. Tel.: þ1 (206) 388 3643. E-mail addresses: [email protected], [email protected] (D. Pemsl). Contents lists available at ScienceDirect Journal of Environmental Management journal homepage: www.elsevier.com/locate/jenvman 0301-4797/$ e see front matter Ó 2011 Elsevier Ltd. All rights reserved. doi:10.1016/j.jenvman.2011.03.010 Journal of Environmental Management xxx (2011) 1e12 Please cite this article in press as: Evans, L., et al., Assessing the impact of sheries co-management interventions in developing countries: A meta-analysis, Journal of Environmental Management (2011), doi:10.1016/j.jenvman.2011.03.010

Assessing the impact of fisheries co-management interventions in

Embed Size (px)

Citation preview

Page 1: Assessing the impact of fisheries co-management interventions in

lable at ScienceDirect

Journal of Environmental Management xxx (2011) 1e12

Contents lists avai

Journal of Environmental Management

journal homepage: www.elsevier .com/locate/ jenvman

Assessing the impact of fisheries co-management interventions in developingcountries: A meta-analysis

Louisa Evans a,b, Nia Cherrett a, Diemuth Pemsl a,*a The WorldFish Center, P.O. Box 500 GPO, 10670 Penang, Malaysiab The ARC Centre of Excellence for Coral Reef Studies, James Cook University, Townsville, Queensland 4811, Australia

a r t i c l e i n f o

Article history:Received 13 July 2010Received in revised form24 January 2011Accepted 8 March 2011Available online xxx

Keywords:Small-scale fisheriesCo-managementGovernanceEnvironmentLivelihoodsImpact assessment

* Corresponding author. Tel.: þ1 (206) 388 3643.E-mail addresses: [email protected], dpemsl@gmx

0301-4797/$ e see front matter � 2011 Elsevier Ltd.doi:10.1016/j.jenvman.2011.03.010

Please cite this article in press as: Evans, L.,meta-analysis, Journal of Environmental Ma

a b s t r a c t

Co-management is now established as a mainstream approach to small-scale fisheries managementacross the developing world. A comprehensive review of 204 potential cases reveals a lack of impactassessments of fisheries co-management. This study reports on a meta-analysis of the impact of fisheriesco-management in developing countries in 90 sites across 29 case-studies. The top five most frequentlymeasured process indicators are participation, influence, rule compliance, control over resources, andconflict. The top five most frequently measured outcome indicators are access to resources, resourcewell-being, fishery yield, household well-being, and household income. To deal with the diversity of the52 indicators measured and the different ways these data are collected and analysed, we apply a codingsystem to capture change over time. The results of the meta-analysis suggest that, overall fisheries co-management delivers benefits to end-users through improvements in key process and outcome indi-cators. However, the dataset as a whole is constituted primarily of data from the Philippines. When weexclude this body of work, few generalisations can be made about the impact of fisheries co-manage-ment. The lack of comparative data suitable for impact assessment and the difficulties in comparing dataand generalising across countries and regions reiterates calls in other fields for more systematicapproaches to understanding and evaluating governance frameworks.

� 2011 Elsevier Ltd. All rights reserved.

1. Introduction

Small-scale fisheries (SSF) provide essential ecosystem servicesto large numbers of people in the developing world. The impor-tance of this sector for the local and national economies of manydeveloping countries and the well-being of their people is gainingrecognition (see Béné et al., 2007; FAO and The WorldFish Center,2008; World Bank, 2004; World Resource Institute, 2005).However, sustainable development of SSF remains a considerablechallenge, particularly in contexts of poverty, high dependence ofincreasing populations on ecosystem services, economic global-ization and climate change (Andrew et al., 2007). This trend is oftenconsidered a crisis of governance (Acheson, 2006; Mahon et al.,2010; Young et al., 2007).

Co-management is an alternative approach to conventionalmanagement of natural resources, which has found considerabletraction within the fisheries sector. Co-management is defined asthe sharing of responsibility and authority between the state and

.net (D. Pemsl).

All rights reserved.

et al., Assessing the impact onagement (2011), doi:10.1016

resource-users but often involves collaboration between a varietyof stakeholders, including different government agencies, non-governmental organizations, research organizations, privateenterprises and civil society more generally (Carlsson and Berkes,2005). It aims to strengthen the potential of customary manage-ment to protect both the local environment and the stakes andrights of resource-users while improving the legitimacy of stateinvolvement in fisheries management through more inclusive andtransparent decision-making processes. Inclusion of relevant andentitled fishery stakeholders can lead to more effective collectiveaction (at appropriate scales), conflict resolution, and highercompliance to management institutions (and therefore reducedcosts of enforcement) as well as to integration of more diverseknowledge and value systems on which to base decisions, leadingto better problem definition, social learning, and innovation(Berkes, 2009; Kuperan et al., 2008; Pomeroy et al., 2007).

The co-management and participatory management paradigmshave been institutionalised through national environmental anddevelopment policy and legislation in many countries. Often theseefforts are closely associated with other decentralisation processes,for example in the Philippines, Indonesia and Cambodia. In othercases, the co-management approach is simply promoted within

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 2: Assessing the impact of fisheries co-management interventions in

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e122

particular natural resource management sectors, including wildlifemanagement, fisheries, forestry and water. In the SSF sector,co-management arrangements are now the dominant approach tomanagement.

Our review identified 221 examples of co-management imple-mentation in over 50 countries in the developing world. Withapproximately 40, 46, and 32 programmes in Africa, Latin Americaand the Caribbean, and the Pacific, respectively, and over 100programmes in Asia (Appendix A, Supplementary online material).Many programmes have been funded through relatively long-term(ten years plus) or on-going investments by donor agenciesincluding DANIDA (Denmark), SIDA (Sweden), IDRC (Canada),NZAID (New Zealand), DFID (United Kingdom), and USAID (UnitedStates of America) in coastal and/or inshore fisheries in developingcountries. Recent examples of the level of financial commitmentare the pledges by the EU and Swiss government to invest USD 25.5million in sustainable coastal fisheries and by The World Bank toprovide USD 9.5 million in loans and grants to fisheries co-management in Senegal (http://go.worldbank.org/EERDE2GR80).

Co-management is also the foundation of other alternativemanagement approaches, including integrated area management,ecosystem-based management, protected area management, andadaptive management. After 20 years of investment in co-management of SSF what is the impact on resource sustainability,poverty and food security in the developing world? Implementa-tion of co-management is difficult and measuring impacts ischallenging, particularly in terms of poverty reduction and envi-ronmental sustainability (Béné and Neiland, 2006). These types ofimpacts, if achieved, are only realized in the medium to long term.This delay between intervention and outcome and the potential forindirect causal linkages between inputs and outputs complicatesevaluation. There is also evidence that the transition to co-management can result in negative impacts by allowing space fornew leaders, interest groups, and processes of power to emerge(Béné et al., 2010; Blaikie, 2006).

Whether co-management in practice delivers on its promises asa normative concept is yet to be systematically evaluated. To date,global assessments include efforts to evaluate general fisheriesmanagement effectiveness (Béné and Neiland, 2003; Mora et al.,2009), compliance to the Code of Conduct for Responsible Fish-eries (Pitcher et al., 2009), the potential of catch shares or privateproperty regimes to prevent fisheries collapse (Costello et al.,2008), and the performance of marine protected areas (MPAs) asa fisheries management tool (Pollnac et al., 2001; Pomeroy et al.,2005a) and their impact on human well-being (Mascia et al.,2010). Assessments relevant to fisheries co-management includethose that focus on the conditions for successful implementation offisheries co-management, including Napier et al. (2005), Gelcichet al. (2006), Chuenpagdee and Jentoft (2007), and Gutiérrez et al.(2011) and more qualitative reviews of impact, including,Sverdrup-Jensen and Raakjær Nielsen (1997) and Wilson et al.(2003, 2006). Only two previous studies quantitatively evaluatethe outcomes of fisheries co-management arrangements directly.Maliao et al. (2009) build on previous reviews (n ¼ 10) ofcommunity-based coastal resource management (CBCRM) projects(Pomeroy and Carlos, 1996), in order to assess the performance ofa total sample of 16 CBCRM projects in the Philippines througha meta-analysis. Allison and Badjeck (2004) review fisheriesco-management experiences in tropical inland fisheries. Theiranalysis is based on a sample of 19 case-studies, but primarilydiscusses conceptual and analytical aspects of co-management.

Our review takes these efforts further through the compilationof a more extensive sample of case-studies covering a range ofaquatic ecosystems across developing countries and focuses onlyon the assessment of impact. A number of challenges with respect

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

to data availability, data quality and variability, and potentialpublication biases were encountered. Systematic methods are usedto overcome these challenges and to present a meta-analysis of SSFco-management assessments across the developing world in orderto consolidate the empirical evidence of the impact of SSFco-management.

2. Meta-analysis methodology

2.1. Impact assessment methods and challenges

Demonstrating impact has long been recognised as necessary innatural resource management and development research andpractice (Baker, 2000; CGIAR, n.d). Typically, monitoring and eval-uation describes the process of assessing a project or intervention’sperformance against pre-stated objectives and goals, usually duringits implementation. Impact assessments (IA) measure the deliveryof benefits, such as improved resource management, better liveli-hoods and poverty reduction (as well as possible costs and negativeimpacts of the intervention). An ex ante IA may be undertakenbefore the project begins and attempts to quantify the expectedconsequences of the intervention. An ex post IA evaluates impactsbeyond the life cycle of the project (typically 1e5 years after theproject has ended), assuming that it takes more time than theproject duration for some benefits (and costs) to materialize. Inmany cases co-management is introduced as a ‘project’ of definedlength in which case impact assessment is relatively straightfor-ward. However, in other instances co-management is introduced asa ‘process’ and institutionalised through policy and legislation, forexample, the co-managed Management and Exploitation Areas forBenthic Resources (MEABR) of Chile, which are initiatives that havebeen ongoing for more than a decade (Gelcich et al., 2010). In thesecircumstances the timing of an ex post IA can be problematic.Nevertheless, it is important to try and gauge the impact andsustainability of co-management interventions in the long term.Different methodologies are available to do this depending on thetype of intervention being assessed (see Walker et al., 2008 for IAguidelines). Yet, assessments of natural resource managementinitiatives are especially difficult because of issues of attribution,indirect impact pathways, and the time-lag between interventionand realization of benefits (Waibel and Zilberman, 2007).

Our review of available case-studies in SSF co-management didnot identify any examples of rigorous ex post IA. We thereforeanalyze co-management assessments, reviews or evaluations thatconsider different impacts (captured by a range of process andoutcome indicators) over time. Most of these studies measurea number of indicators at the beginning and towards the end ofa project or reconstruct time series encompassing pre, during andpost-project status, using perception analysis.

2.2. Defining co-management

A definition of co-management is needed to delineate whichcase-studies to include in the meta-analysis. For this study,we adapt a definition of the term, which adequately distinguishesthis type of management from customary or traditionalcommunity-based management and from state-led management.Co-management is a relationship between a resource-user groupand another organization or entity (usually a government agency) forthe purposes of fisheries management in which some degree ofresponsibility and/or authority is conferred to both parties. Thisconceptualization amends the classic definition proposed byPomeroy and Berkes (1997) in two ways. First, the traditionaldefinition specifies that responsibility and authority are shared,and that both conditions are necessary. However, in reviewing the

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 3: Assessing the impact of fisheries co-management interventions in

Table 1Reasons for excluding co-management case-studies from the meta-analysis.

Reason forexclusion

Definition Cases from totalsample (percent)

No data No data assessing impacts available 70No information Existence of data assessing impacts

unknown18

Not relevant Data not related to co-management impacts 8No access Data assessing impacts exist but

access was denied2

Quality issues Methods used to collect or analyse data didnot meet pre-determined quality standards

2

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e12 3

literature, it is often not possible to determine with certitude thatthis double condition is met. It is only possible to assess whethera potential case describes a situation in which tasks or responsi-bilities are shared to some extent. The condition that responsi-bility and authority, not just one or the other, are shared cannot,therefore, be used as a means to exclude case-studies. We havetherefore amended the definition to acknowledge that responsi-bilities and/or authority are shared. Second, while co-managementis traditionally defined as a relationship between resource-usersand the state (with or without the inclusion of other third parties),some co-management projects involve support by independentorganizations or non-governmental organizations, in place of thestate, particularly in regions such as the Pacific. Indeed, the casesfrom the Pacific included in this meta-analysis describe commu-nity-based management in which responsibilities are shared withnon-governmental organizations. Therefore, the second amend-ment to the classic definition describes co-management as a rela-tionship between resource-users and another organization toinclude experiences of co-management with both state and otheragencies.

2.3. Data collection

A multi-step procedure was used to compile a global list ofpast and present fisheries co-management initiatives imple-mented in developing countries, along with any correspondinginformation on evaluations or assessments of the initiatives. Theprocedure involved two main phases: i) a literature searchincluding a) an electronic search for published and grey literatureand b) expert elicitation to identify other potential case-studiesand available data and; ii) the systematic selection of case-studieswith available and appropriate data for analysis. This systematicmethod minimises publication bias by including unpublishedassessments.

2.3.1. Literature searchThe first step in the literature search involved a comprehensive

search of various electronic library databases (including AquaticSciences and Fisheries Abstracts, CAB Direct, CSA SociologicalAbstracts, EconLit and SA, Web of Science, WorldFish LibraryCatalogue and Scopus) using key words (different combinations of:fisher*, communit*, collaborat*, cooperative*, participatory, smallscale, coastal, artisan*, stakeholder*, manag*, impact, outcome*,result*, livelihood*, benefit*, socio*, econom*, poverty, food secu-rity and income*) and following up references therein. Second,a wider search of grey literature (using search engines on theworldwide web), was conducted to locate other potential case-studies not documented in academic literature. This final listcombining both published and grey literature was then presentedto a group of scientists with expertise in fisheries management andgovernance. The consultation provided us with additions to the listof cases and details of key informants at the regional level whocould provide further information. This, along with our ownresearch on the co-management community enabled us to contactover 112 key informants including researchers, project managersand fisheries experts worldwide. Through the electronic literaturesearch and expert elicitation process (which had a 75 percentresponse rate) a total of 637 fisheries co-management articles wereretrieved. From this sample, 433 cases were excluded because theymade no reference to qualitative or quantitative impacts ofco-management related to fisheries or aquatic systems in developingcountries. This left 204 articles from which to identify potentialcase-studies with IA or evaluation data for use in the meta-analysis(Appendix A, Supplementary online material for a globaldistribution of potential cases).

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

2.3.2. Case-study selectionCase-studies for meta-analysis were selected from the sample of

204 potential case-studies referring to fisheries co-management IAor evaluation in developing countries. Decisions of whether a case-study was relevant to this investigation were based on a review ofthe abstract, methods and results sections of the associated docu-ments.Weperformed a careful quality control of the 39 case-studiesidentified. Case-studies were excluded if they demonstrated one ormore of the following characteristics: i) reporting of only secondaryresults; ii) no reference tomethodology or basis for findings and; iii)indications of a flawed methodology for collection or analysis ofdata. The reviewprocess resulted in the exclusion of 10 case-studies.

The 29 case-studies included in the meta-analysis representonly 14 percent of the original 204 potential cases. The six groundsfor exclusion of the other 175 case-studies are presented in Table 1.The majority of cases, n ¼ 165, were excluded for lack of data orunavailability of data. For some other cases, the existence of rele-vant data was unknown and could not be resolved during ourexpert consultation. Finally, there were a few cases in which thedata presented were not directly related to the co-managementintervention. For example, there were cases reporting on indicatorsrelated to interventions other than co-management, such as theclosure of protected areas. A very small percentage of cases wereexcluded because they did not meet the quality standard.

2.4. Meta-analysis

Once we had identified all available cases for our review itbecame evident that, due to the variation in available data (widerange of different indicators and units of measurement) across the29 case-studies, a number of organizational and standardizingsteps were necessary.

2.4.1. Extracting and categorising indicatorsA total of 52 different indicators were used in the 29 case-

studies. A systematic process of grouping overlapping indicators(i.e. pulling together indicators with different names, butmeasuring the same outcome) reduced the number of indicators to40. None of the studies included in the review actually measured allthese indicators. Case-studies in our sample covered between 1 and18 indicators. To clarify the themes addressed by these indicatorsthey were grouped into three categories: ‘Natural Systems’ forecological factors; ‘People and Livelihoods’ for social aspects; and‘Institutions and Governance’ for indicators reflecting the gover-nance process, policies and institutions involved in co-manage-ment arrangements (Evans and Andrews, 2009). These categoriesreflect the major types of co-management impacts within criticaldimensions of a fishery system.

2.4.2. Data codingData were both qualitative and quantitative (Table 2, Section

3.1.1), and were collected through a number of different methods.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 4: Assessing the impact of fisheries co-management interventions in

Table 2Co-management case-studies selected for meta-analysis.

Case-study Country Project and water body or fishery and project orimplementation period

Sites (n) Ecosystem type Data type Year ofevaluation

References

B1 Bangladesh Community Based Fisheries -2 (CBFM-2): 2001e2006 1 Inland Quan. 2005 Halls and Mustafa, 2006B2 Bangladesh Community Based Fisheries Management eSouth and

South East Asia (CBFM-SSEA): 2002e20076 Inland Quan. 2006 The WorldFish Center, 2007

B3 Bangladesh Oxbow Lakes Small Scale Fishermen Project: 1991e1997 1a Inland Quan. 1997 IFAD, 1998B4 Bangladesh Management of Aquatic Ecosystems through Community

Husbandry (MACH): 1998-20063 Inland Quan.d 2006 Halder and Thompson, 2006

B5 Bangladesh Mymensingh Aquaculture Extension Project 1 Inland Quan. 2004 Winrock International, 2004C1 Cambodia Tblong Kla Community Fishery: 1998 - ongoing 1 Inland Qual. 2004 Viner et al., 2006C2 Cambodia Tonle Sap Environmental Management Project

(TSEMP): 2005e20081 Inland Qual. 2008 Wildblood, 2008

C3 Cambodia Policy Reform Impact Assessment: 2000 - ongoing 1 Inland Qual. 2005 Cambodian Dept. ofFisheries & IMM Ltd., 2006

CL1 Chile Benthic Resource Management Areas eRegion III (AMERB e III): 1992 - ongoing

18 Marine Quan. 2007 Stotz, 2008

CL2 Chile Benthic Resource Management Areas eRegion IV (AMERB e IV): 1992 - ongoing

27 Marine Quan. 2007 Stotz, 2008

CL3 Chile Benthic Resource Management Areas eRegion IV (AMERB e VI): 2002 - ongoing

1 Marine Qual.d 2004 Gelcich et al., 2006

I1 Indonesia Sasi Fishery in Central Malukab 1 Marine Qual.d 1997 Novaczek et al., 2001K1 Kenya DianieChale Management Area: 1995-ongoing 1 Marine Quan. 1995e2007 McClanahan, 2010;

McClanahan et al., 2008M1 Malaysia Integrated Coastal Resource Management - Pulau Langkawi

(ICRM ePL): 2003e20071 Marine Quan. 2007 bin Saleh, 2008

PI1 PacificIslands

A Comparative Study of Coastal Resource managementin the Pacific Islands

1c Marine Qual.d 1998e1999 World Bank, 2000

P1 Philippines Community Based Coastal Resource Management -Central VisayasRegional Project-1 (CVRP-1): 1984e1996

6 Marine Qual.d 1996 Pomeroy et al., 1996

P2 Philippines Coastal Environment Programme (CEP): 1994e1996 2 Marine Qual.d 1996 Pomeroy et al., 1996P3 Philippines Marine Conservation Project for San Salvador Island: 1989e1996 1 Marine Both.d 1996 Katon et al., 1999P4 Philippines Sagay Marine Reserve, Negros Occidental: 1995e2002 1 Marine Qual.d 2002 Webb et al., 2004P5 Philippines Honda Bay Resource Management Project (HBRMP): 1989e1996 1 Marine Qual.d 1996 Pomeroy et al., 1996P6 Philippines Cogtong Bay Mangrove Project: 1989e2004 1 Marine Qual.d 2004 Maliao and Polohan, 2008P7 Philippines Fisheries Sector Programme (FSP): 1990e2002 1 Marine Qual.d 2002 Israel et al., 2004P8 Philippines Sustainable Rural District Development Programme

(SRDDP): 1994e19981 Marine Qual.d 1998 van Mulekom and Tria, 1999

P9 Philippines Community Fisheries Resource Management Project(CFRMP): 1991e1996

1 Marine Qual.d 1996 Baticados andAgbayani, 2000

P10 Philippines Local Government Support Programme: 1996e2002 1 Marine Qual.d 2002 Baylon, 2002P11 Philippines Bais Bay Coastal Resource Management Projects: 1984-2005 1 Marine Qual.d 2005 Pomeroy et al., 2005bP12 Philippines Anilao Area Coastal Resource Management Projects: 1990-2005 1 Marine Qual.d 2005 Pomeroy et al., 2005bTZ1 Tanzania Tanga Coastal Zone Conservation and Development

Programme (TCZCDP) : 1994 - ongoing6 Marine Quan. 1998-2004 Wells et al., 2007

T1 Thailand Integrated Coastal Resource Management - PathewDistrict (ICRM-PD): 2001e2006

1 Marine Both 2006 Boromthanarat, 2007

a A T-test was performed on the raw data (household income figures pre and post-project) provided in project reports to generate a p-value.b The Sasi Fishery is the only case where a co-management customary fisheries management arrangement exists.c One data point was generated from an analysis of 31 co-management case-studies from the Pacific Islands of Fiji (6), Tonga (6), Samoa (6), Solomon Islands (7) and

Pulau (6). No project implementation dates available.d Data with significance values (p-value).

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e124

Although most of the data reflect change over time, they weremeasured, analysed and presented in different forms (e.g. rankedscore, percentage, monetary value, number of species). The diver-sity in how data were collected, analyzed, recorded, and docu-mented, alongside the relatively small sample of case-studies,rendered a statistical meta-analysis of co-management impactacross countries and regions impossible (see Maliao et al., 2009). Acoding system was, therefore, devised and used to combine thedifferent types of data.

We first examined the trend of change. A positive trend overtime was assigned a positive code (1), where there was no change,data were coded as 0, and for negative trends a negative code (�1)is assigned. In addition, significance values were noted. If the case-study results were significant (p< 0.05), the codewas modified to 2if the trend was positive and �2 is the trend was negative. Wherethe significance of the trend is less than 95 percent significant(p > 0.05) or where there is no significance value attributed to the

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

data, the coding remained as 1 or �1. Indicators are defined in sucha way that an increase (code 1 or 2) always equals a (positive)benefit i.e. an improvement of the situationwhile a decrease in anyindicator (�1 or �2) highlights a deterioration of the situation (forexample a decrease in conflict is a positive impact and coded as 1 or2 depending on the level of significance).

3. Results

3.1. Composition of data

3.1.1. Case-study characteristicsFig. 1 shows the regional distribution of the full set of potential

co-management case-studies identified from the literature searchand expert consultation (n ¼ 204). The largest percentage of case-studies are from Asia (47 percent), followed by Latin America andthe Caribbean (21 percent), Africa (18 percent) and the Pacific

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 5: Assessing the impact of fisheries co-management interventions in

22% Philippines 7% Bangladesh 4% Sri Lanka 4% Cambodia 3% Viet Nam 2% Malaysia 2% Lao 3% Others

Latin America &

Caribbean 21%

Africa 18%

Pacific 14%

Asia 47%

Fig. 1. Total number of case-studies by region, with country breakdown for Asia.

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e12 5

region (14 percent). The country breakdown for Asia shows that themajority of case-studies within this region are from the Philippineswith the remaining coming from Bangladesh, Sri Lanka, Cambodia,Vietnam, Malaysia and Lao PDR. The ‘other’ category groups threecases from Indonesia and Thailand and one case-study each fromChina, India, and Myanmar (Appendix A, Supplementary onlinematerial).

An overview of the 29 case-studies selected for analysis ispresented in Table 2. The majority of these case-studies are locatedin Asia (79 percent), with the largest proportion situated in thePhilippines (41 percent of all cases). These alone represent 52percent of the Asian case-studies, with the remaining 48 percentlocated in Bangladesh (16 percent of total cases), Cambodia(10 percent), Indonesia, Malaysia and Thailand (4 percent each).The Latin America and the Caribbean region is represented by threecase-studies (10 percent), Africa by two case-studies (7 percent)and the Pacific by only one case-study (4 percent).

Within our sample seven case-studies (B2, B4, CL1, CL2, P1, P2and TZ1) present data from more than one site (Table 3). Wheredata are available for separate sites they were counted individually,resulting in the inclusion of 90 sites from 29 case-studies. The sitesinclude marine and inland aquatic habitats (83 and 17 percent ofcases, respectively) ranging from coral reefs and mangrove foreststo seasonal wetlands and lakes. 19 case-studies have IA data inqualitative formwhile ten report quantitative results. All qualitativedata were generated through stakeholder perception analysesresulting in time series and treatment-control comparison data(13 case-studies followed the fisheries co-management researchframework methodology developed by the World Wide Collabo-rative Research Project on Fisheries Co-Management outlined inPomeroy et al., 1996). The quantitative results were mostly timeseries and report on indicators such as household income, fishcatch and biodiversity. The projects were implemented, evaluatedand funded by a range of different government agencies, non-governmental organisations, and (international) donors.

There are also differences in how case-studies define andpresent treatment and control data. Technically, for a meaningfulcounterfactual, data from a ‘treatment’ and a ‘control’ group arecompared (Walker et al., 2008). The terminology used in most

Table 3Summary of data used in the meta-analysis.

Number of includedcase-studies

Member only data(per case-study)

Meda

ALL 29 17 7Asia 23 6 6Africa 2 7 1Pacific 1 1 /Latin America 3 3 /

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

co-management evaluations is ‘member’ (treatment) and ‘non-member’ (control). Members are individuals or households whowere engaged in the fishery co-management initiative, while thenon-member population did not participate in these initiatives.However, in four case-studies (P7, P9, P11 and P12) ‘member’ and‘non-member’ data were combined and only one set of results wasreported. We did not use these data when comparing indicators,leaving a total set of 25 viable case-studies and 86 sites. In six case-studies (P1, P2, P3, P5, P8 and P10) the ‘non-member’ data did notreflect an actual control group as the non-member population waslocated in the same area accessing the resource that the project wastargeting. Therefore, non-members may have (indirectly) benefitedfrom the co-management intervention, thus a comparison ofmembers and non-members would not reveal the impact of theintervention. We were left with too small a sample (n ¼ 7) of caseswith separate member and non-member data to conduct anystatistically meaningful comparison of the two groups. Thus, for the25 case-studies used for meta-analysis only trends over time formember data are analyzed.

3.1.2. Impact assessment indicatorsTable 4 shows the 40 different indicators extracted from the 29

case-studies and the split of indicators across the categories chosenas a framework for this study: ‘Natural Systems’ (8 indicators),‘Governance and Institutions’, and ‘People and Livelihoods’ (17 and15, respectively). We further differentiate between process andoutcome indicators. Process indicators reflect progress in one ofa series of actions (e.g. collaboration, learning, communication) thatare considered important for the legitimate and successful imple-mentation of co-management. Outcome indicators correspond togoals, such as improved resource abundance, ecosystem health,livelihoods and other facets of humanwell-being, which reflect theoverall objective of SSF co-management to achieve sustainabledevelopment. The five most frequently utilised outcome indicatorsare household income (used 32 times), fishery yield (30), resourcewell-being (19), household well-being (13) and resource access(12). These outcome indicators are distributed between the ‘NaturalSystem’ and the ‘People and Livelihoods’ domains of the fishery.The indicators shown below are not defined by the authors butrepresent the terminology used in the studies fromwhich they areextracted (for definitions of these indicators see Appendix B in theSupplementary online material). In some cases the terminologyused is technically incorrect, for example resource well-being(referring to resource health or status), but is neverthelesscontinued here to maintain clear links to the data source fromwhich it is derived.

The five most frequently measured process indicators areparticipation (used 19 times), rule compliance (16), influence (15),resource control (14) and conflict (13). All these fall within the‘Governance and Institutions’ domain of the fishery system. Indeed,almost all indicators in this category are process indicators (15 outof 17). The relatively more frequent use of process indicators tomeasure SSF co-management impact points to the emphasis intheory and practice on co-management as a process of governance

mber and non-memberta (per case-study)

Combined data only(per case-study)

Total number ofcase-study sites

5 905 36/ 7/ 1/ 46

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 6: Assessing the impact of fisheries co-management interventions in

Fig. 2. Trends in the five most frequen

Table 4Type and frequency of indicators used in the case-studies to assess co-managementprojects (n ¼ 40).

Process indicators(frequency)

Outcome indicators(frequency)

Natural systems Fishery yield orresource harvest (30)Resourcewell-being (19)Coral cover (8)Fish density (7)Biodiversity trend orspecies richness (6)Fish diversity (3)Threat to resource (3)Bird diversity (1)

People andlivelihoods

Satisfaction with reserve &sanctuary management (6)Resource knowledge (5)Communication (5)Community harmony (3)Marine reserve benefits (2)Satisfaction with mangrovemanagement (2)Community development (1)Economic equality (1)Self-esteem (1)Fair distribution of fishing gears (1)Role in fisheries management (1)

Household income (32)Householdwell-being (13)Fish consumption (3)Food security (2)

Institutions andgovernance

Participation (19)Rule compliance (16)Influence (15)Resource control (14)Conflict (13)Destructive fishing practices (9)Conflict management (6)Fair allocation of access rights (5)Collective decision-making (4)Fisherefisher cooperation (3)Quality of resource management (2)Government-fisher cooperation (2)Law enforcement (1)Distribution of governmentresources (1)Tradition of collective action (1)

Access to resource (12)Fisher violations (1)

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e126

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

(Carlsson and Berkes, 2005). However, empowerment andimproved mechanisms of collective action, while arguably impor-tant in their own right, do not guarantee other SSF managementobjectives of importance in developing countries, includingimproved resource status, better livelihoods and poverty reduction.In order to build a body of work that provides a comprehensiveevaluation of the impact of co-management, it is necessary toinclude metrics of both process and outcome indicators.

3.2. Meta-analysis of data

The results for the five most frequently measured outcome andprocess indicators are presented in Figs. 2 and 3. While the trend inthe process indicators is positive overall (Fig. 3), this is not the casefor the outcome indicators (Fig. 2), which show more variability inthe direction of change over time. Within the outcome indicators,only resource access has an overall negative trend (58 percent),with 33 percent significant negative change over time (Fig. 2).

Common property regimes, including co-management, areoften associatedwith changes in property rights and institutions, orrules (Ostrom, 1990). Access rights are typically designated tomembers of co-management institutions, such as fisher associa-tions, who then manage the institutions, or rules, that governresource access. Interestingly, the results show an overall decline inresource access for members. As elaborated above (Section 3.1.1),we do not compare data of trends for ‘members’ and ‘non-members’ but analyze member only data over time. Decliningaccess for members suggests that stricter access rules have beenimposed. Declining access can be a positive or negative outcome forthe fishery overall, depending on the associated impacts on peopleand the fishery resource. Resource access must, therefore, be ana-lysed in the context of trends in fishery sustainability and humanwell-being, both of which we address below.

Fishery yield shows an increasing trend over time (77 percent ofthe total), although the significant trends are split fairly evenlybetween increases (10 percent) and decreases (7 percent). Theresource well-being indicator shows more of a significant positivetrend than a negative trend across cases (47 percent and 16 percent,respectively). The yield indicator is constructed from quantitativeand qualitative data while the resource well-being indicatorconsists of perception analysis (qualitative) data. We discuss the

tly measured outcome indicators.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 7: Assessing the impact of fisheries co-management interventions in

Fig. 3. Trends in the five most frequently measured process indicators.

Table 5Impact of co-management (frequency) by ecosystem and region.

Positive No Change Negative

Ecosystem Significant Notsignificant

Notsignificant

Significant

MarineAfrica (n ¼ 2) 0 11 0 12 0Asia (n ¼ 15) 106 48 3 15 14Latin America (n ¼ 3) 0 0 1 3 3Pacific (n ¼ 1) 0 2 0 2 0InlandAsia (n ¼ 8) 7 39 7 6 0

Total (Frequency) 113 100 11 38 17Total (Percentage) 40 36 4 14 6

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e12 7

implications of this below. Nevertheless, in combination, theseindicators suggest tentative improvements to resource status asa result of co-management interventions. However, it is importantto note, that the determinants of yield are often varied and caninclude environmental factors and other interventions, such asstock enhancement, associated with co-management, but notindicative of improved management. For instance, in case-studiesB1, B2, B3 and B5, co-management arrangements were associatedwith enhanced fisheries programmes involving the release offingerlings into the water bodies. Such interventions can increasefish yields substantially without necessarily reflecting sustainableresource use.

The indicators household well-being and income have a higherfrequency of significant positive trends than negative change with62 and 25 percent of the indicator trends being significantly posi-tive, respectively. The household well-being indicator is a subjec-tive indicator constructed from perception data. It is likely thatpositive trends in process indicators (Fig. 3) contribute as much toan improved perception of household well-being as for example,income. In general, this reflects well on co-management andsuggests a level of buy-in to the approach (that does not appear tobe undermined overall by declines in resource access). Testimonyfrom those involved in co-management projects has often sug-gested that, to them, increased participation, inclusion, voice andempowerment are the most important contributions of theco-management idea (Jentoft, 2005). Household income also showsa positive trend, which is rather surprising considering the rela-tively mixed data on fishery yield. However, it is likely that some ofthis income is derived from non-fisheries sources either encour-aged and facilitated within co-management projects (e.g., micro-credit ventures implemented in case-study B1) or increasingly,from other global, regional or local trends unrelated to theco-management interventions, for instance remittances sent fromhousehold members who have migrated to urban areas to findwork (e.g. highlighted in case-studies C3, P1, P2 and P5). Relativelymore positive trends in both resource and human well-beingindicators suggests that the negative trend in resource access canbe viewed overall as a neutral or positive outcome for co-management members.

The significantpositive trends for theprocess indicators - rangingfrom 46 percent for conflict to 73 percent for influence - imply that,generally, the governance and community empowerment goals ofco-management are realised (Fig. 3). None of the case-studies

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

reported a negative trend for participation, with only 5 percent ofthe total indicator frequency indicating no change. Rule complianceis the only process indicator for which some case-studies foundsignificant negative trends (6 percent).

It is difficult to draw out any trend in the data from an ecosystemor regional perspective. In Africa, Latin America and the Pacific thefindings are mixed with no real trend in either direction (Table 5).Few studies note significant increase or decrease in indicators, withthe exception of the Gelcich et al. (2006) Chilean case-study whichobserves significant declines in three indicators following theimplementation of the MEABR co-management system in a contextof effective customary management. With so few case-studies inthese regions it is not possible to generalize findings. However,there is a positive trend across the Asian studies (55 and 16 percentof all data for marine and inland, respectively) with high signifi-cance levels predominantly in the marine cases (38 percentcompared to 3 percent of data in inland cases). Rather thanreflecting any regional or ecosystem dependent relationship theseoutcomes are likely to be associated with trends in natural resourcemanagement assessment (see sources of bias in Section 4) or withthe dominance of perception data on process indicators in thedataset, particularly in the Philippines cases.

To investigate how robust our findings are, we have conductedtwo further analyses. We analyzed the top ten indicators separatelyfor data derived from perception analysis (qualitative data, n ¼ 19)and from other methods (non-perception data, n ¼ 12). Since somecase-studies use both data types, the combined sample size is larger

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 8: Assessing the impact of fisheries co-management interventions in

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e128

than the number of case-studies (Fig. 4). In the perception analysismethod, introduced by Pomeroy et al. (1996), interview respon-dents are asked to assign a score to each indicator for the past(10 or 15 years prior to evaluation), present (evaluation date) andfuture (10 or 15 years after evaluation). The significance valuescreated from the difference between the past and present scoreswere used in the analysis. Second, in order to evaluate whether thedominance of cases from the Philippines (n ¼ 12) influences find-ings, we also analyze data for the top ten indicators excluding thePhilippine case-studies (Fig. 5).

Fig. 4 shows that household income increases over time, butsignificant changes are mainly found in data derived fromperception analysis. The majority of non-perception data thatreport increased household income but do not find significantchange come from Bangladesh (n ¼ 4). Similar findings for house-hold income from perception and non-perception data suggest thatfindings for this indicator are robust. This is further strengthenedby the analysis excluding Philippines cases (Fig. 5): the householdincome indicator is used across a range of cases and shows overallpositive change with a small portion being significant. However, asmentioned earlier, several case-studies, particularly those inBangladesh, note that increases in incomes cannot always beattributed to co-management. Higher income can emerge fromcomplementary project activities, such as introducing micro-credits or providing skills training related to alternative incomeearning opportunities (unrelated to fishing) or from completelyindependent trends such as migration and remittances. Stake-holders’ perceptions of income change are unlikely to distinguish

Fig. 4. Comparison of indicator trends generated from percepti

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

the determining drivers of change, and therefore, in the absence ofcomparative member and non-member data, even significantincome trends, cannot be solely attributed to the successfulimplementation of co-management. The dominating positive trendin household well-being is found only in perception data withtrends that mirror perception data on household income. It is notpossible to validate this data by excluding the Philippines cases asthe remaining sample, despite a positive trend, is too small to drawdefinite conclusions.

Fish yield data are split fairly evenly between perception andnon-perception data. Non-perception fish yield trends show anoverall increase over time (50 percent of the total), though these arenot significant. Perception fish yield data also show an overallincrease over time (27 percent) but reveal both significant positive(ten percent) and negative trends (seven percent). The majority ofdata points showing non-significant increases in yield over timecome from Bangladesh. Again, changes in resource yield are notalways directly related to improved resource management, butcould be caused by other (external) factors. The resourcewell-beingindicator is derived primarily from perception data and reportspositive and negative significant change over time. Resource accessis generated solely from perception data, but as for resource well-being, the fact that respondents willingly report on negative trendssuggests that data reflect members’ actual views and don’t seemskewed towards the positive because respondents feel they need togive positive feedback.

We find significant positive trends for process indicators, mainlyderived from perception analysis. However, if we exclude the

on (P) analysis and non-perception (NP) analysis methods.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 9: Assessing the impact of fisheries co-management interventions in

Fig. 5. Data for the top outcome and process indicators excluding the Philippines cases.

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e12 9

Philippines cases, we are left with very few data points, fromwhichto draw inferences. Indeed, what these analyses have shown is thatin the absence of Philippine data the sample is too small to drawany robust conclusions or generalisations. Only the results forfisheries yield and household income are spatially robust as theyare supported by a diverse set of case-studies. However, withouta control group, it is not possible to attribute trends in these indi-cators directly or solely to co-management arrangements.

Finally, we examine all indicator trends (Table 4) categorisedinto ‘Natural System’, ‘People and Livelihoods’ and ‘Institutions andGovernance’ (Fig. 6) with the Philippines dataset removed. Overall,there is very little global data showing significant trends in eithera positive or negative direction. Within the aggregated ‘NaturalSystem’ category, we find mixed outcomes. Under ‘People andLivelihoods’ there is an overall positive trend, with a comparatively

Fig. 6. Results for grouped categories of co-managemen

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

larger proportion of significant positive than negative trends. For‘Institutions and Governance’ indicators we find an overall positivetrend of the impact of fisheries co-management. However, onlya fraction of these positive results is statistically significant whilecase-studies report a larger number of significant negative trends.

4. Discussion

A recent paper on the evolution of co-management, reviews themany dimensions of this paradigm (Berkes, 2009). These include co-management as a mechanism for power sharing, institutionbuilding, enhanced trust and social capital, problem solving and,more recently, knowledge-sharing and social learning. Co-manage-ment is seen by many as a normative process to improve the legiti-macy and effectiveness of resourcemanagement. Our analysis draws

t success indicators (excluding Philippines cases).

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 10: Assessing the impact of fisheries co-management interventions in

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e1210

out the process indicators that are emphasised andmost commonlyevaluated in practice. The most frequently used are participation,influence, rule compliance, resource control and conflict. These donot directly address issues of power-sharing or trust-building, forexample, but as awhole suggest improved inclusion of stakeholdersin governance processes, improved capacity to control or influencedecision-making, and improved compliance to management rulesover time. All of these process indicators exhibited a positive trend,a result supported byMascia et al., 2010 in their investigation ofMPAimpacts on fishing communities, Maliao et al. (2009) in their meta-analysis of Philippine cases, and Pomeroy et al. (2007) in their studyof conflict and collaboration in SSF arrangements in Southeast Asia.

Positive trends in process indicators are expected to lead toimproved management outcomes, although literature shows thatthis is not guaranteed (Béné and Neiland, 2004, 2006). The keyoutcome indicators assessed in this meta-analysis include house-hold income, household well-being, resource well-being, fisheryyield, and resource access. Overall, trends were proportionallymore positive than negative over time, however, results are morevaried than for process indicators and we found negative trends ina number of case-studies. This reiterates the importance ofconsidering both process and outcome indicators to meaningfullyevaluate and improve the impact of co-management as anapproach to SSF management in developing countries.

Separately analyzing perception and non-perception data to testthe rigor of these findings showed that results are relatively robust.Where both types of data are present within one indicator, thetrends are generally similar, although non-perception data is lesslikely to find or report significant change. Further, the perceptiondata reports both negative and positive trends, which suggests thatthe data relatively accurately reflect opinion. However, whenexcluding the data from the Philippines we are left with virtually nodata on process indicators, so we cannot generalize findings. Theonly two indicators that are well represented across our globaldataset are household income and fishery yield, although very littleof these data show significant change. Further, both indicators arelikely influenced by external factors such as micro-credit schemes,fisheries enhancement, remittances or other income sourcesunrelated to fisheries or general changes in the economic orecological environment. Without a control group (non-member)comparison, the observed changes cannot be attributed toco-management with any level of certainty. Improved yield andhousehold income are key desirable outcomes for SSF co-manage-ment in developing country contexts andwe, therefore advocate forthe continued emphasis on these two outcome indicators. Never-theless, more widespread assessment of the performance ofco-management, as reflected in process indicators is clearlynecessary to examine whether the empowerment and governanceaims of co-management are effective in a broader context.

In conducting this meta-analysis we faced a number of chal-lenges related to the availability of data. The systematic method-ology applied aimed to ensure that data were representative andfromreliable sources. Anumberofbiases, common inassessmentsofnatural resource management interventions (see Meinzen-Dick,2007 for a discussion of bias in the agricultural water-use sector),however, remain. First, interventions are generally implemented in‘suitable or favourable places’; this may explain the dominance ofcase-studies from the Philippines in our global sample of fisheriesco-management assessments in the developing world. ThePhilippines are renowned for community-based MPA managementand a national commitment to co-management of natural resourcesmore, including relevant institutional reform. Second, moresuccessful projects are more likely to be evaluated. In particular,projects that fail and are discontinued are rarely documented inpublished or grey literature. Third, assessments reporting positive

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

results aremore likely tobepublished (we tried tominimise this biasby includinggrey literature andunpublished cases). These sources ofbias may be exacerbated as interventions are frequently evaluatedby the veryorganisations (and sometimes the same individuals) thatinitiate and co-ordinate the intervention. Further, many of the case-studies included in our meta-analysis document trends withina project life cycle. The results are likely to look different if theseprojects are evaluated in a real ex post sense i.e. a few years after theproject activities have ended. Indeed, Pomeroy and Carlos (1997)report that 81 percent of CBCRM programs in the Philippines areunsustainable in that they fail once external support is withdrawn.

5. Conclusion

Assessments of natural resource management interventions arenotoriously difficult as reflected by the scarcity of impact assess-ment data on fisheries co-management in developing countries.These challenges are not unique to fisheries management but arecommon in other sectors. Poteete and Ostrom (2008) discuss thedifficulties in collecting conclusive evidence on natural resourcemanagement interventions and in trading-off between context richcase-studies and large-N studies that evaluate a smaller set ofvariables. Most existing assessments present a diverse array ofindicators and data types that are difficult to compare across cases,countries and regions. To counter this, there is need for:i) comprehensive analytical frameworks, ii) meta-databases todocument qualitative data and data derived from small samples ofcase-study sites and, iii) large-N field-based studies (Meinzen-Dick,2007; Ostrom, 2007; Poteete and Ostrom, 2008).

An exploratory network for impact assessment of governanceinterventions in the forestry sector e the International ForestryResource and Institutions (IFRI) network e does, however,demonstrate that substantial financial, human and institutionalinvestment is needed to conduct rigorous assessments of naturalresource management interventions (Wollenberg et al., 2007). Yet,investments in management processes including monitoring andevaluation and/or ex post impact assessment should be commen-surate with the value of the system being managed (Garcia et al.,2008). For SSF in developing country contexts this is problematicin that the economic value of these fisheries is often unknown andother benefits are intangible (ibid). Nevertheless, the financialinvestment in fisheries co-management as the primary manage-ment approach in SSF continues to be substantial, thereby justi-fying a greater investment in comprehensive and independentimpact assessment. Conducting rigorous IA studies will help tobetter channel scarce (research) resources and promote approacheswhich have been shown to be successful.

Acknowledgements

A special thanks to William Koh for his tireless assistance intracking down key references for this review and to themembers ofthe fisheries co-management community who responded to ourrequests for information. For helpful comments and suggestions onthe methodology and earlier drafts of the manuscript we thankEdward Allison, Christophe Béné, Robert Pomeroy, Blake Ratnerand Nireka Weeratunge. We are grateful for the constructivecomments and suggestions of four anonymous reviewers. Thiswork was carried out with funding provided by the WorldFishCenter.

Appendix. Supplementary material

Supplementary data associated with the article can be found inonline version, at doi:10.1016/j.jenvman.2011.03.010.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 11: Assessing the impact of fisheries co-management interventions in

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e12 11

References

Acheson, J.M., 2006. Institutional failure in resource management. Annual Review ofAnthropology 35, 117e134.

Allison, E., Badjeck, M., 2004. Fisheries Co-management in Inland Waters: a Reviewof International Experience. Sustainable Fisheries Livelihood Programme. FAO &DFID.

Andrew, N.L., Béné, C., Hall, S.J., Allison, E.H., Heck, S., Ratner, B.D., 2007. Diagnosisand management of small-scale fisheries in developing countries. Fish andFisheries 8, 227e240.

Baker, J., 2000. Evaluating the Impact of Development Projects on Poverty:a Handbook for Practitioners. The World Bank, Washington D.C., USA.

Baticados, D., Agbayani, R., 2000. Co-management in marine fisheries in MalalisonIsland, Central Philippines. International Journal of Sustainable Developmentand World Ecology 7, 343e355.

Baylon, C., 2002. Evaluation of the integrated municipal council as an institution forco-management in the coastal zone. WorldFish Center, Penang, Malaysia.

Béné, C., Neiland, A., 2003. A Review of Fisheries Management Performance inDeveloping Countries with Particular Reference to Issues of Policy and Gover-nance. Support Unit for International Fisheries & Aquatic Research (SIFAR)Department of Fisheries Food and Agriculture Organization.

Béné, C., Neiland, A., 2004. Empowerment reform, yes. but empowerment ofwhom? Fisheries decentralization reforms in developing countries: a criticalassessment with specific reference to poverty reduction. Aquatic Resources,Culture and Development 1 (1), 35e49.

Béné, C., Neiland, A., 2006. From Participation to Governance: a Critical Review ofGovernance, Co-Management and Participation in Natural Resources Manage-ment, with Particular Reference to Inland Fisheries in Developing Countries,Penang, Malaysia and Colombo, Sri Lanka. World Fish Center and CGIAR Chal-lenge Program on Water and Food.

Béné, C., Macfadyen, G., Allison, E., 2007. Increasing the Contribution of Small-ScaleFisheries to Poverty Alleviation and Food Security. FAO, Rome, Italy.

Béné, C., Belal, E., Ousman Baba, M., Ovie, S., Raji, A., Malasha, I., Njaya, F., Na Andi, M.,Russel, A., Neiland, A., 2010. Struggle, dispute and alliance over the new power:analyzing ‘democratic’ decentralization of natural resources through the lensesof Africa inland fisheries. World Development 37 (12), 1935e1950.

Berkes, F., 2009. Evolution of co-management: role of knowledge generation,bridging organizations and social learning. Journal of Environmental Manage-ment 90 (5), 1692e1702.

Blaikie, P., 2006. Is small really beautiful? Community-based natural resourcemanagement in Malawi and Botswana. World Development 34 (11), 1942e1957.

Boromthanarat, S., 2007. Final project evaluation: Integrated coastal resourcemanagement in Pathew District (ICRM-PD), Songkhla, Thailand: CoastalResources Institute (CORIN). Prince of Songkla University, Thailand.

bin Saleh, I., 2008. Final Project Evaluation: Integrated Coastal Resource Manage-ment - Pulau Langkawi (ICRM-PL). Malaysia, Kuala Lumpur.

Cambodian Dept. of Fisheries and IMM Ltd., 2006. Policy reform impact assessment:Impacts of the fisheries policy reforms in Kampong Thom & Prey Veng Prov-inces. Cambodia Community Fisheries Development Office of the Departmentof Fisheries of the Royal Government of Cambodia, Cambodia.

Carlsson, L., Berkes, F., 2005. Co-management: concepts and methodologicalimplications. Journal of Environmental Management 75 (1), 65e76.

CGIAR, n.d. The Gateway to Evidence that International Agricultural Research isMaking a Difference. CGIAR Impact. Available at: http://impact.cgiar.org/(Accessed 02.02.10.).

Chuenpagdee, R., Jentoft, Svein, 2007. Step zero for fisheries co-management: whatprecedes implementation. Marine Policy 31, 657e668.

Costello, C., Gaines, S., Lynham, J., 2008. Can catch shares prevent fisheries collapse?Science 321 (5896), 1678e1681.

Evans, L., Andrews, N., 2009. Diagnosis and the Management of Constituency ofSmall-scale Fisheries. The World Fish Center, Penang, Malaysia.

FAO and The WorldFish Center, 2008. Small-scale Capture Fisheries e a GlobalOverview with Emphasis on Developing Countries. A Preliminary Report of theBig Numbers Project (Sponsored by PROFISH World Bank).

Garcia, S., Allison, E.H., Andrew, N.L., Bene, C., Bianchi, G., de Graaf, G., Kalikoski, G.J.,Mahon, R., Orensanz, J.M., 2008. Towards Integrated Assessment and Advice inSmall-Scale Fisheries: Principles and Processes. FAO, Rome, Italy.

Gelcich, S., Edwards-Jones, G., Kaiser, M.J., Castilla, J.C., 2006. Co-managementpolicy can reduce resilience in traditionally managed marine ecosystems.Ecosystems 9 (6), 951e966.

Gelcich, S., Hughes, T.P., Olsson, P., Folke, C., Defeo, O., Fernandeza, M., Foale, S.,Gunderson, L.H., Rodrigues-Sickerty, C., Scheffer, M., Steneck, R.S., Castilla, J.C.,2010. Navigating Transformations in Governance of Chilean Marine CoastalResources.

Gutiérrez, N.L., Hilborn, R., Defeo, O., 2011. Leadership, social capital and incentivespromote successful fisheries. Nature 470 (7334), 386e389 [Epub 2011 Jan 5].

Halder, S., Thompson, P., 2006. Restoring Wetlands Through Improved Governance:Community Based Co-management in Bangladesh. The Management of AquaticEcosystems through Community Husbandry (MACH) Experience. WinrockInternational, Bangladesh Center for Advance Studies, Center for NaturalResource Studies, CARITAS Bangladesh, Dhaka, Bangladesh.

Halls, A., Mustafa, M., 2006. Final assessment of the impact of the CBFM project oncommunity-managed fisheries in Bangladesh, Report to the WorldFish Center,Bangladesh.

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

IFAD, 1998. Oxbow lakes small scale fishermen project (Loan: 237-BD). Projectcompletion & impact assessment, IFAD.

Israel, D., Adan, E., Lopez, N., de Castro, J., 2004. Household perceptions of the long-term impact of coastal resources management in Panguil Bay. PhilippinesInstitute for Development Studies, Philippines.

Jentoft, S., 2005. Fisheries co-management as empowerment. Marine Policy 29 (1),1e7.

Katon, B., Pomeroy, R., Garces, L., Salamanca, A., 1999. Fisheries management of SanSalvador Island, Philippines: A shared responsibility. Society and NaturalResources 12, 777e795.

Kuperan, K., Abdullah, N.M.R., Pomeroy, R.S., Genio, E.L., Salamanca, A.M., 2008.Measuring transaction costs of fisheries co-management. Coastal Management36 (3), 225e240.

Mahon, R., Fanning, L., McConney, P., Pollnac, R., 2010. Governance characteristics oflarge marine ecosystems. Marine Policy 34, 919e927.

Maliao, R., Polohan, B., 2008. Evaluating the impacts of mangrove rehabilitation inCogtong Bay, Philippines. Environmental management 41 (3), 414e424.

Maliao, R., Pomeroy, R., Turingan, R., 2009. Performance of community-basedcoastal resource management (CBCRM) programs in the Philippines: a meta-analysis. Marine Policy 33 (5), 818e825.

Mascia, M., Claus, C., Naidoo, R., 2010. Impacts of marine protected areas on fishingcommunities. Conservation Biology 24 (5), 1424e1429.

McClanahan, T., 2010. Effects of fisheries closures and gear restrictions on fishingincome in a kenyan coral reef. Conservation Biology 24 (6), 1519e1528.

McClanahan, T., Hicks, C., Darling, E., 2008. Malthusian overfishing and efforts toovercome it on Kenyan coral reefs. Ecological Applications 18 (6), 1516e1529.

Meinzen-Dick, R., 2007. Beyond panaceas in water institutions. Proceedings of theNational Academy of Sciences of the United States of America 104 (39),15200e15205.

Mora, C., Myers, R.A., Coll, M., Libraloto, S., Pitcher, T.J., Sumaila, R.U., Zellers, D.,Watson, R., Gaston, K.J., Worm, B., 2009. Management effectiveness of theworld’s marine fisheries. PLoS Biology 7 (6), e1000131.

Napier, V.R., Branch, G.M., Harris, J.M., 2005. Evaluating conditions for successful co-management of subsistence fisheries in KwaZulu-Natal, South Africa. Environ-mental Conservation 32 (2), 165e177.

Novaczek, I., Harkes, I., Sopacua, J., Tatuhey, M., 2001. An Institutional Analysis of SasiLaut in Maluku. ICLARM/The WorldFish Center, Indonesia. Penang, Malaysia.

Ostrom, E., 1990. Governing the Commons: The Evolution of Institutions forCollective Action. CUP.

Ostrom, E., 2007. A diagnostic approach for going beyond panaceas. Proceedings ofthe National Academy of Sciences 104 (39), 15181e15187.

Pitcher, T., Kalikoski, D., Pramod, G., Short, K., 2009. Not honouring the code. Nature457, 658e659.

Pollnac, R.B., Crawford, B.R., Gorospe, M.L.G., 2001. Discovering factors that influ-ence the success of community-based marine protected areas in the Visayas,Philippines. Ocean & Coastal Management 44, 683e710.

Pomeroy, R., Berkes, F., 1997. Two to tango: the role of government in fisheries co-management. Marine Policy 21 (5), 465e480.

Pomeroy, R., Carlos, M., 1996. A Review and Evaluation of Community-Based CoastalResources Management Projects in the Philippines, 1984e1994. ICLARM/TheWorldFish Center, Makati City, Philippines.

Pomeroy, R., Carlos, M., 1997. Community-based coastal resource management inthe Philippines: a review and evaluation of programs and projects, 1984e1994.Marine Policy 21 (5), 445e464.

Pomeroy, R., Pollnac, R., Predo, C., Katon, B., 1996. Impact Evaluation of Community-Based Coastal Resource Management Projects in the Philippines. ICLARM/TheWorldFish Center & North Sea Center, Makati City, Philippines.

Pomeroy, R., Watson, L., Parks, J., Cid, G., 2005a. How is your MPA doing? Amethodology for evaluating the management effectiveness of marine protectedareas. Ocean & Coastal Management 48 (7e8), 485e502.

Pomeroy, R., Oracion, E., Pollnac, R., Caballes, D., 2005b. Perceived economic factorsinfluencing the sustainability of integrated coastal management projects in thePhilippines. Ocean and Coastal Management 48 (3e6), 360e377.

Pomeroy, R., Parks, J., Pollnac, R., Campson, T., Genio, E., Marlessy, C., Holle, E.,Pido, M., Nissapa, A., Boromthanarat, S., Hue, N.T., 2007. Fish wars: conflict andcollaboration in fisheries management in Southeast Asia. Marine Policy 31 (6),645e656.

Poteete, A., Ostrom, E., 2008. Fifteen years of empirical research on collective actionin natural resource management: struggling to build large-N databases basedon qualitative research. World Development 36 (1), 176e195.

Stotz, W., 2008. Evaluacion del proceso de implementacion de la medida deadministracion areas de manejo y explotacion de recursos bentonicos (AMERB)en las regiones III y IV y elaboracion de una propuesta de mejoramiento de lamedida. Universidad Catolica del Norte.

Sverdrup-Jensen, S., Raakjær Nielsen, J., 1997. Co-Management in Small-ScaleFisheries: a Synthesis of Southern and West African Experiences. Institute forFisheries Management and Coastal Community Development (IFM). Availableonline at URL. http://academic.research.microsoft.com/Paper/5010491.aspx.

The WorldFish Center, 2007. Project Completion Report: Community Based Fish-eries Management in South and South East Asia (CBFM-SSEA) Project. TheWorldFish Center.

van Mulekom, L., Tria, E., 1999. Community-based Coastal Resource Management inOrion, Bataan, Philippines: a Case Study on the Development of a MunicipalWide Community-Based Fisheries Co-Management System. SNV-Philippines &PRRM-Bataan, Manila, Philippines.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010

Page 12: Assessing the impact of fisheries co-management interventions in

L. Evans et al. / Journal of Environmental Management xxx (2011) 1e1212

Viner, K., Ahmed, M., Bjorndal, T., Lorenzen, K., 2006. Development of FisheriesCo-Management in Cambodia: a Case Study and Its Implications. WorldFishCenter.

Waibel, H., Zilberman, D., 2007. International Research on Natural ResourcesManagement: Advances in Impact Assessment. CAB International.

Walker, T., Maredia, M., Kelley, T., La Rovere, R., Templeton, D., Thiele, G.,Douthwaite, B., 2008. Strategic Guidance for Ex Post Impact Assessment ofAgricultural Research. Science Council Secretariat, Rome, Italy.

Webb, E., Maliao, R., Siar, S., 2004. Using local user perceptions to evaluateoutcomes of protected area management in the Sagay Marine Reserve,Philippines. Environmental Conservation 31 (2), 138e148.

Wells, S., Makoloweka, S., Samoilys, M., 2007. Putting Adaptive Management intoPractice: Collaborative Coastal Management in Tanga, Northern Tanzania. IUCNand Irish Aid, Nairobi, Kenya.

Wildblood, R., 2008. Tonle Sap Environmental Management Project (TSEMP)Component 2: Evaluating the Impact of TSEMP on Livelihoods. Conservation &Community Fisheries Development.

Wilson, D.C., Raakjær Nielsen, J., Degnbol, P. (Eds.), 2003. The Fisheries Co-management Experience: Accomplishments, Challenges and Prospects. KluwerAcademic Publishers, Dordrecht, The Netherlands.

Please cite this article in press as: Evans, L., et al., Assessing the impact ometa-analysis, Journal of Environmental Management (2011), doi:10.1016

Wilson, D.C., Ahmed, M., Siarb, S.V., Kanagaratnam, U., 2006. Cross-scale linkagesand adaptive management: fisheries co-management in Asia. Marine Policy 30,523e533.

Winrock International, 2004. Mymensingh Aquaculture Extension Project:1989e2003. Winrock International & DANIDA, Bangladesh.

Wollenberg, E., Merino, L., Agrawal, A., Ostrom, E., 2007. Fourteen years of moni-toring community-managed forests: learning from IFRI’s experience. Interna-tional Forestry Review 9 (2), 670e684.

World Resource Institute, 2005. World Resources 2005: The Wealth of the Poor -Managing Ecosystems to Fight Poverty. WRI, Washington D.C.

World Bank, 2000. Voices from the Village - A Comparative Study of Coastal ResourceManagement in the Pacific Islands (Vol. 2 of 2), East Asia and Pacific Region.Papua New Guinea and Pacific Islands Country Management Unit: World Bank.

World Bank, 2004. Saving Fish and Fishers: Toward Sustainable and EquitableGovernance of the Global Fishing Sector. World Bank, Agriculture and RuralDevelopment Department, Washington D.C.

Young, O.R., Osherenko, G., Ogden, J., Crowder, L.B., Ogden, J., Wilson, J.A., Day, J.C.,Douvere, F., Ehler, C.N., McLeod, K.L., Halperin, B.S., Peach, R., 2007. Solving thecrisis in ocean governance: place-based management of marine ecosystems.Environment 49 (4), 20e32.

f fisheries co-management interventions in developing countries: A/j.jenvman.2011.03.010