SQUARING THE QUALITY CIRCLE - United Nations SQUARING THE QUALITY CIRCLE Towards a Quality Framework

  • View
    1

  • Download
    0

Embed Size (px)

Text of SQUARING THE QUALITY CIRCLE - United Nations SQUARING THE QUALITY CIRCLE Towards a Quality Framework

  • SQUARING THE QUALITY SQUARING THE QUALITY CIRCLECIRCLE

    Towards a Quality Framework for Towards a Quality Framework for International Official StatisticsInternational Official Statistics

    Conference on Data Quality for International Organizations, WiesConference on Data Quality for International Organizations, Wiesbaden, baden, Germany, 27Germany, 27--28 May 200428 May 2004

  • Scope of paper:Scope of paper: 1.1. To investigate the relationships between To investigate the relationships between

    the UN Fundamental Principles of the UN Fundamental Principles of Official Statistics, the IMF Data Quality Official Statistics, the IMF Data Quality

    Assessment Framework and the draft Assessment Framework and the draft Declaration of Principles for Declaration of Principles for

    International Official StatisticsInternational Official Statistics 2.2. To explore how progress towards a To explore how progress towards a

    Quality Framework for International Quality Framework for International Official Statistics could be madeOfficial Statistics could be made

  • DESA/UNSD 3

    Do the Fundamental Principles apply to Do the Fundamental Principles apply to International Official Statistics?International Official Statistics?

    •• ECE paper ‘Towards a statistical system’ raises the ECE paper ‘Towards a statistical system’ raises the question: how to achieve formal recognition of the question: how to achieve formal recognition of the

    applicability of the FPOS to International statistics?applicability of the FPOS to International statistics?

    •• Quality definitions and quality assessment frameworks for Quality definitions and quality assessment frameworks for nationalnational statistics have been establishedstatistics have been established

    •• Similar definitions and frameworks for Similar definitions and frameworks for internationalinternational statistics do not yet existstatistics do not yet exist

  • DESA/UNSD 4

    National and international statistics are different National and international statistics are different in many respectsin many respects

    •• Different legislative environmentDifferent legislative environment •• No collection from primary data providers, but from No collection from primary data providers, but from

    countriescountries •• Standard setting by international statisticians, working Standard setting by international statisticians, working

    with countrieswith countries •• Coordination among the agencies Coordination among the agencies •• Agencies estimate values for nonAgencies estimate values for non--responding countriesresponding countries •• Agencies harmonize dataAgencies harmonize data •• Agencies make regional and global estimatesAgencies make regional and global estimates •• Etc.Etc.

  • DESA/UNSD 5

    Structure of the paperStructure of the paper

    •• Part 1: Relationships between existing Part 1: Relationships between existing instrumentsinstruments

    •• Part 2: Detailed comparison between DQAF Part 2: Detailed comparison between DQAF and DPIS (Annex 1)and DPIS (Annex 1)

    •• Part 3: DPIS process and comparison Part 3: DPIS process and comparison between DPIS en FPOSbetween DPIS en FPOS

    •• Part 4: From DPIS to QFIS and IDDSPart 4: From DPIS to QFIS and IDDS

  • DESA/UNSD 6

    Principles, Frameworks, Principles, Frameworks, StandardsStandards

    •• Principles: the philosophical underpinningPrinciples: the philosophical underpinning

    •• Frameworks: instruments to assess practicesFrameworks: instruments to assess practices

    •• Standards: agreed quality measuresStandards: agreed quality measures

  • DESA/UNSD 8

    DQAFDQAF

    •• DQAF is based on the Fundamental DQAF is based on the Fundamental PrinciplesPrinciples

    •• PrerequisitesPrerequisites •• IntegrityIntegrity •• Methodological soundnessMethodological soundness •• Accuracy and reliabilityAccuracy and reliability •• ServiceabilityServiceability •• AccessibilityAccessibility

    •• Holistic approach to qualityHolistic approach to quality

  • DESA/UNSD 9

    Declaration of Principles (DPIS)Declaration of Principles (DPIS)

    •• Based on FPOSBased on FPOS •• FPOS text adapted to the international situationFPOS text adapted to the international situation •• Taking account of agreed interpretation of FPOS (see Taking account of agreed interpretation of FPOS (see

    DQAF), basic recommended practices were addedDQAF), basic recommended practices were added •• Rev. 2 now under consideration of the drafting groupRev. 2 now under consideration of the drafting group •• Issues: Issues: I.I. Principles or Principles & Practices?Principles or Principles & Practices? II.II. Are the recommended practices acceptable?Are the recommended practices acceptable? III.III. Will the organizations agree to sign up?Will the organizations agree to sign up? •• Next stepsNext steps

  • DESA/UNSD 10

    Comparison DQAF with Comparison DQAF with proposed DPIS practicesproposed DPIS practices

    •• Internal/external accessInternal/external access •• Advance notice of changes in methodology, Advance notice of changes in methodology,

    source data and statistical techniquessource data and statistical techniques •• Concepts, definitions, scope, classifications, basis Concepts, definitions, scope, classifications, basis

    of recordingof recording •• Intermediate data and analysis of revisionsIntermediate data and analysis of revisions •• Data presentation, release schedules, availability Data presentation, release schedules, availability

    of nonof non--confidential subconfidential sub--aggregatesaggregates •• Contact persons and catalogues Contact persons and catalogues

  • DESA/UNSD 11

    How to get to QFIS?How to get to QFIS?

    •• CCSA accepts DPIS, either as Principles or as CCSA accepts DPIS, either as Principles or as Principles & PracticesPrinciples & Practices

    •• If only P, what does it mean?If only P, what does it mean? •• If only P, what is the next step?If only P, what is the next step? •• Statistical Commission endorses P or P&P Statistical Commission endorses P or P&P •• If only P, what is the next step?If only P, what is the next step? •• If P&P, organizations have to sign up If P&P, organizations have to sign up •• From DPIS to QFIS to IDDSFrom DPIS to QFIS to IDDS

  • DESA/UNSD 12

    Conclusions and points for Conclusions and points for discussiondiscussion

    •• DQAF and DPIS both based on FPOSDQAF and DPIS both based on FPOS •• DQAF is a good starting point for QFISDQAF is a good starting point for QFIS •• DQAF contains elements that DPIS at this stage DQAF contains elements that DPIS at this stage

    does not includedoes not include •• Is a DPIS without practices useful?Is a DPIS without practices useful? •• How to apply QFIS?How to apply QFIS? •• Self assessment, peer review, assessment by Self assessment, peer review, assessment by

    countries?countries? •• Towards IDDS; generic or data specific?Towards IDDS; generic or data specific?