Transparency International – DFID Programme Partnership ... Transparency International – DFID Programme

  • View
    3

  • Download
    0

Embed Size (px)

Text of Transparency International – DFID Programme Partnership ... Transparency International...

  • Transparency International – DFID Programme Partnership Agreement (PPA)

    Independent Progress Review

    Final Report

    28th September 2012

    Church & Court Barn, Church Lane Tickenham, Bristol, BS21 6SD United Kingdom Tel: +44 1275 811 345 info@theIDLgroup.com www.theIDLgroup.com

  • Transparency International – DFID Programme Partnership Agreement (PPA) Independent Progress Review Final Report

    28th September 2012

    The IDL Group Ltd Church and Court Barn Church Lane Tickenham Bristol BS21 6SD United Kingdom Tel: +44 1275 811345 Fax: +44 1275 811333 Email: info@theIDLgroup.com Web: www.theIDLgroup.com

    Alt-Moabit 96 10559 Berlin Germany Tel: +49-30 3438 200 Fax: +49 30 3470 3912 Email: ti@transparency.org Web: www.transparency.org

    Prepared by: Nick Chapman, Rachel Alvarez-Reyes and Craig Mathieson Quality Assured by: Sam Gibson © theIDLgroup 2012

  • Independent Progress Review: Transparency International

    Contents

    EXECUTIVE SUMMARY……………………………………………………………………………………….. (i)

    1 INTRODUCTION ................................................................................................... 1

    1.1 PURPOSE OF THE EVALUATION ........................................................................................ 1 1.2 SCOPE OF THE EVALUATION ........................................................................................... 1 1.3 FOCUS OF THE EVALUATION ........................................................................................... 1 1.4 ORGANISATIONAL CONTEXT ........................................................................................... 2 1.5 OVERVIEW OF PPA FUNDED ACTIVITIES ........................................................................... 4 1.6 RELATIONSHIP OF DFID FUNDED ACTIVITIES TO OTHER PROGRAMME ACTIVITIES ...................... 5

    2 EVALUATION METHODOLOGY ............................................................................ 6

    2.1 EVALUATION PLAN....................................................................................................... 6 2.1.1 Evaluation Questions ....................................................................................... 6 2.1.2 Evaluation Design ............................................................................................ 6 2.1.3 Research Methodology .................................................................................... 6 2.1.4 Analytical Framework ...................................................................................... 7 2.1.5 Approach to Quality Assurance of Research ..................................................... 7

    2.2 RESEARCH PROBLEMS ENCOUNTERED .............................................................................. 8 2.3 STRENGTHS AND WEAKNESSES OF SELECTED EVALUATION DESIGN AND RESEARCH METHODS IN RETROSPECT.......................................................................................................................... 8

    3 FINDINGS ............................................................................................................ 9

    3.1 RESULTS .................................................................................................................... 9 3.1.1 ...... Logic and Assumptions Supporting DFID PPA funded Project and/or Programme Activities......................................................................................................................... 9 3.1.2 Performance Assessment against Logframe ................................................... 10 3.1.3 Intended and Unintended Effects on Poor and Marginalised Groups............... 15

    3.2 RELEVANCE .............................................................................................................. 16 3.2.1 Representativeness ........................................................................................ 17 3.2.2 Targeting ....................................................................................................... 18

    3.3 EFFECTIVENESS ......................................................................................................... 20 3.3.1 Learning ........................................................................................................ 20 3.3.2 Innovation ..................................................................................................... 21 3.3.3 Partnership Working ...................................................................................... 22 3.3.4 Sustainability ................................................................................................. 23

    3.4 VALUE FOR MONEY ASSESSMENT.................................................................................. 24 3.4.1 Economy ........................................................................................................ 24 3.4.2 Efficiency ....................................................................................................... 26 3.4.3 Cost effectiveness .......................................................................................... 28

    3.5 IMPACT OF PPA FUNDING ........................................................................................... 32 3.5.1 Development of the ME&L System ................................................................. 32 3.5.2 Attributable Impacts of PPA Funding on Results ............................................. 33

    4 CONCLUSIONS ................................................................................................... 34

    4.1 SUMMARY OF ACHIEVEMENTS AGAINST EVALUATION CRITERIA ........................................... 34 4.2 SUMMARY OF ACHIEVEMENTS AGAINST RATIONALE FOR PPA FUNDING................................ 34 4.3 SUMMARY OF PROBLEMS AND ISSUES ENCOUNTERED ....................................................... 35 4.4 IMPACT AND VALUE FOR MONEY OF PPA FUNDED ACTIVITIES ............................................ 35 4.5 UTILITY ................................................................................................................... 35

  • Independent Progress Review: Transparency International

    5 LESSONS LEARNT .............................................................................................. 36

    5.1 POLICY LEVEL ............................................................................................................36 5.2 PPA FUND LEVEL .......................................................................................................36 5.3 ORGANISATIONAL LEVEL ..............................................................................................36

    6 RECOMMENDATIONS ....................................................................................... 37

    Figures, Tables, and Annexes

    List of Figures Figure 1-1: Sources of TI-S Income, 2011 ............................................................................... 2

    List of Tables Table 3-1: Summary of Logframe indicators that met/exceeded the 2011 targets ...............10 Table 3-2: Blog Performance and Visits by Country ..............................................................12 Table 3-3: Financial Statistics - DFID PPA Evaluation /1 ........................................................26 Table 3-4: VfM proposals for PPA Outcomes .......................................................................31 Table 4-1: Summary Ratings for Evaluation Criteria .............................................................34

    List of Annexes Annex A: Terms of Reference ..............................................................................................41 Annex B: Evaluation Research Schedule and Timescales ......................................................45 Annex C: Data Collection Tools ............................................................................................46 Annex D: List of People Consulted .......................................................................................55 Annex E: Bibliography..........................................................................................................57 Annex F: Details of Evaluation Team ....................................................................................60 Annex G: PPA logframe .......................................................................................................62

  • Independent Progress Review: Transparency International

    Acronyms and Abbreviations AC:DC Anti-Corruption: Delivering Change ACRN Anti-Corruption Research Network ALAC Advocacy and Legal Advice Centre Alianza Alianza Regional Para la Libertad de Expresión e Informacion ASK Anti-Corruption Solutions and Knowledge AusAID Australian Agency for International Development BIP Business Integrity Programme BPI Bribe Payers’ Index BRICS Brazil, Russia, India, China, South Africa CPI Corruption Perceptions Index CSO Civil Society Organisation DAC Development Assistance Committee DFID Department for International Development EC European Commission EU European Union GCB Global Corruption Barometer GII Global Impact Indicators IACC International Anti-Corruption Conference IATI International Aid Transparency Initiative INSP Institutional Network Strengthening Programme IPR Independent Progress Review KP Key Programme KPI Key Performance Indicator KSS Key