A “Bulletin Board” System for Monitoring Statistical Capacity

Development Data GroupWorld Bank

November 2008

Neil Fantom (nfantom@worldbank.org) Naoko Watanabe (nwatanabe@worldbank.org)

What we currently do

• Since 2004, we have published an online database that:− Provides information on national statistical systems− Helps assess statistical capacity in countries, using

composite statistical capacity score− Helps monitor progress in statistical development− Uses existing data sources− Covers 140 countries− We update annually at

www.worldbank.org/data/countrydata/csid.html

Uses

• Countries− Self assessment, performance monitoring and evaluation− Strengthening of own reporting of statistical activities

• Development partners− Help include statistical capacity issues in policy dialogue− Project identification, monitoring, and evaluation− Monitoring of regional and global trends in statistical capacity

Some trends in SCB Indicator

1999 2004 2008

All countries 53 63 65

IDA 48 57 59

IDA – Africa 49 52 52

IDA – Other 48 64 69

Biggest increases and decreases in SCB Indicator 2004-2008

Increases

• Afghanistan (+22, to 32)• Cameroon (+18, to 67)• Sierra Leone (+17, to 42)• Nigeria (+16, to 54)

Decreases

• Zimbabwe (-20, to 46)• Cote D’Ivoire (-17, to 63)• Chad (-16, to 43)• Gabon (-14, to 32)

We’re making improvements

• To allow updates by countries• To improve coverage• To improve the assessment tools

… in response to:

• Comments from users, and• A request from donors to the 15th replenishment of the

International Development Association (IDA) (initially we are covering IDA - low-income - countries only)

What’s changing?

OLD NEW

Sources Uses existing sources only + Data from countries

Coverage Surveys, methods, international data

+ Institutional capacity, other improvements

Interpretation Capacity score + Assessment tools

Presentation Tables, chart + Maps

Design based on existing frameworks

• PARIS21:− Statistical Capacity Building Indicators

• IMF:− Data Quality Assessment Framework

• African Centre for Statistics:− Africa Statistical Development Index

• Eurostat:− Questionnaire on Statistical Capacity (which is based

on the UN Handbook on Official Statistics)

Other topics also possible e.g. − Population census frequency− Houshold survey frequency− Statistical Capacity Indicator− Etc.

Quick information on countries appears on mouse hover

Click on a country to access “country page”

Tabs on main country page

• “Information”− Overview

• “Assessment”− Institutional Framework− Statistical Methodology− Data Sources− Periodicity and Timeliness

Landing page - overview

• Statistical legislation• Status of existing and next NSDS• NSDS budget• Human resources (of statistical office)• Recent censuses and household surveys• Contact information• Development partner support to statistics

1. Institutional framework

• Statistical legislation• Strategy/work plan• Coordination• User consultation• Budget• Human resources• Infrastructure/equipment, including IT • Dissemination practices• Data analysis

2. Statistical Methodology

• Macroeconomic statistics − Concepts/definitions (DQAF 2.1) − Classifications (DQAF 2.3)

• Socio-demographic statistics− Scope of statistics (DQAF 2.2)

3. Data sources

• Macroeconomic statistics − Source data (DQAF 3.1)

• Socio-demographic statistics− Source data (DQAF 3.1)− Statistical techniques (DQAF 3.3)

• Quality of sampling frames (business registers, hh survey frames)

4. Periodicity and timeliness

• Macroeconomic statistics− Most of the SDDS/GDDS indicators

• Socio-demographic statistics− Selected MDG indicators− Other indicators recommended by international

agencies

Statistical Capacity Indicator

• Overall composite score for each country on a scale of 0 to 100

• Scores for each “dimension” as well − Institutional Framework − Statistical methodology − Data sources− Periodicity an timeliness

• Each criteria is weighted according relative importance

Selected data will be used to derive the statistical capacity indicator

Indicator definitions appear on mouse hover

Ratings are provided according to the assessment results

On the same page, users can see the score for each criterion

…and detailed indicator definitions

Toggle

Expand

Users can send updates and general comments, including using Excel

Current and updated values can be seen side by side

Feedback form

Progress so far…

• Improvements in coverage of indicators• Proposals for new SCB indicator reviewed• Process of peer-review completed

− Involved selection of countries, plus PARIS21, UIS, WHO, IMF, UNSD, Eurostat, UNECA, DFID, SCBF, AfDB

• “Feedback” and other new features developed• Redesign of website underway

Work underway and to do

• Incorporate comments from peer reviewers (ongoing)• Pilot testing with selected countries (starting soon) • Populating database with existing data sources

(December 2008), e.g.− Africa Statistical Development Index− SDDS/GDDS− UN Country Profiles, etc

• Request to IDA countries to review and update content (start January/February 2009)

• Launch (mid-2009)

Some discussion issues

• Which countries should we include in the pilot?• How to encourage feedback from as many

countries as possible – and minimize reporting burden?

• What is the need to maintaining the existing Statistical Capacity Building Indicator series for analysis of trends?

• How to ensure a new SCB Indicator is robust to non-response?

• Expansion to all developing countries?

Thank you