18
Commonwealth data as a strategic resource Data integration involving Commonwealth data for statistical and research purposes Name Position Organisation Date

Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Embed Size (px)

Citation preview

Page 1: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Commonwealth data as a strategic resource

Data integration involving Commonwealth data for statistical and research purposes

NamePosition

OrganisationDate

Page 2: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

What is data integration?

Dataset A Dataset B Integrated dataset

Education data + EMPLOYMENT data =

understanding education outcomes and workforce participation

Page 3: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Why a data integration initiative?• We need to use Commonwealth data as a

strategic resource

• Integrating data from multiple sources often helps provide solutions

• We need to protect privacy and maintain the trust of the public

Page 4: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Commonwealth arrangements for data integration• Create a safe and effective environment

• Framework endorsed by heads of Commonwealth Departments

• High Level Principles• Governance and Institutional arrangements

Page 5: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

1. Strategic Resource

2. Custodian’s accountabili

ty

3. Integrator’s accountabili

ty

4. Public benefit

5. Statistical & research purposes

6. Preserving privacy and confidentiali

ty

7. Transparenc

y

High level principles

High level principles

Page 6: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Cross Portfolio Data Integration Oversight

BoardMembers: ABS, DHS, Health, DSS

Secretariat

Guide

Integrating Authorities

: Accreditation Process

Education and

engagement

Public Register of data

integration projects

Governance and institutional arrangements

Page 7: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Governance and institutional arrangements:

Oversight Board

• Provides strategic and collaborative leadership

• Endorses changes or additions to the overall environment

• Helps manage the systemic risk associated with conducting data integration projects

• Accredits integrating authorities with the capacity to deal with high risk data integration projects

• Assisted by a small secretariat

Secretariat

Guidelines

Integrating

Authorities

EducationRegister of projects

Oversight Board

Page 8: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Accountable for the end-to-end management of a data integration project

What sort of entity? Must be in a position to comply with the Privacy Act 1988 Must be authorised to receive identifiable data by legislation or consent from

the data provider for any given project Has the skills to manage the project Is able to provide secure access to the integrated dataset

May work in partnership or outsource some aspects of the project. For example, a data linkage unit may be used to create linkage keys.

If the project is high risk, an accredited Integrating Authority is required

Most integrating authorities will charge for their services.

Governance and institutional arrangements:

Integrating authoritiesOversight Board

Secretariat

Guidelines

Integrating

Authorities

EducationRegister of projects

Page 9: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Governance and institutional arrangements:

Accreditation processSelf-Assessment

Audit

Decision

Independent party audits self-assessment

Publication of list of accredited agencies

Integrating authority prepares a report against criteria for

accreditation

Oversight Board makes final decision on accreditation

Oversight Board

Secretariat

Guidelines

Integrating

Authorities

EducationRegister of projects

Page 10: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Released in December 2012

Designed to provide transparency (High level principle 7)

Accessed from the NSS web address: www.nss.gov.au/dataintegration

Governance and institutional arrangements:

Public Register of Data Integration Projects Oversight Board

Secretariat

Guidelines

Integrating

Authorities

EducationRegister of projects

Page 11: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

A Guide to data integration projects involving Commonwealth data for statistical and research purposes – located on govspace.gov.au

Confidentiality Information Series and Data Linking Information Series

Supports stakeholder engagement

Governance and institutional arrangements:

A guide and supporting material Oversight Board

Secretariat

Guidelines

Integrating

Authorities

EducationRegister of projects

Page 12: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Opening up access to data

Where legislatively permissible and with agreements in place, the Commonwealth arrangements provide:

a framework for the approval and conduct of data integration projects

confidence to the data custodians by maintaining privacy and confidentiality

better data user access to administrative Commonwealth data for integration purposes

Page 13: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Key Stakeholders - Responsibilities

Data custodia

ns

Integrating authorities

Data users

Page 14: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

maximising the inherent value of Commonwealth data sources

minimising privacy concerns associated with the use of data

facilitating the use of this data within privacy and legislative requirements

Responsibilities of the data custodian

Data custodia

ns

Integrating authorities

Data users

Page 15: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Responsibilities of the integrating authority

the management of the data integration project on behalf of data custodians

minimising privacy concerns associated with the use of data once it is received from data custodians and after integration

facilitating the use of the integrated data within the constraints of privacy and legislation

Data custodia

ns

Integrating authorities

Data users

Page 16: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Propose projects that produce significant overall public benefit

Abide by signed access agreements where applicable (e.g. ensure privacy and confidentiality are protected)

Use information only for the statistical and research purposes agreed

Responsibilities of the data user

Data custodia

ns

Integrating authorities

Data users

Page 17: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Implementation from 1 July 2014Implementation priority in the first six months of

operations is to establish the arrangements for external projects: for statistical and research purposes only integrated at the unit record data custodian for at least one dataset is a Commonwealth

agency data user is external to the Commonwealth (i.e. state

government or academic research).

Initial implementation for selected external projects

During the initial implementation, the integrating authority is to be a Commonwealth agency.

Page 18: Name Position Organisation Date. What is data integration? Dataset A Dataset B Integrated dataset Education data + EMPLOYMENT data = understanding education

Thank you & Questions?

For more information

• A Guide for data integration projects involving Commonwealth data for statistical and research purposes (www.govspace.gov.au)

• National Statistical Service (NSS) (www.nss.gov.au/dataintegration)

• Online feedback mechanism (NSS website)• Secretariat to the Cross Portfolio Data Integration

Oversight Board ([email protected])