19
Survey of Digital Infrastructures and Services CONUL DIGITAL SERVICES & INFRASTRUCTURE SUB-GROUP

Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

  • Upload
    others

  • View
    1

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Survey of Digital Infrastructures and ServicesCONUL DIGITAL SERVICES & INFRASTRUCTURE SUB -GROUP

Page 2: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

CONUL Members

Page 3: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

DSI Sub-group - Terms of ReferenceIdentify and develop major issues and strategic priorities.

Identify and develop opportunities for cooperation and collaboration among CONUL libraries.

Identify and develop key relationships outside of CONUL.

To continue to identify affinities or overlap with other CONUL groups’ areas of enquiry.

To continue to identify an appropriate structure for CONUL to address the topic in the longer term.

To identify and track work underway, existing infrastructures and digitisation resources, pertinent expertise, policies etc., as well as additional relevant issues.

To consider a range of issues relevant to OPEN ACCESS.

Page 4: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Survey•Gather information about existing repository or archival information systems in use by CONUL libraries

•Based around the OAIS Reference Model• OAIS Functional Model (ingest, archival storage, disaster recovery, access, data management,

preservation planning, resourcing & skills)

• OAIS Information Model (SIPs, AIPs, metadata)

• Operating Environment (community, reporting, strategic planning)

•Survey yielded 14 responses from 10 institutions

Page 5: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Repository Maturity

Less than one year

One to three years

Four to five years

Six to seven years

Eight to ten years

Over ten years

System is currently being implemented

REPOSITORY MATURITY

Page 6: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Repository Technology

DSpace 17%

Eprints6%

Digital Commons12%

Fedora Commons47%

ContentDM (OCLC)6%

Pure12%

REPOSITORY TECHNOLOGY

Page 7: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Repository Alignment

Yes

No

Don't Know

CONSIDER MIGRATING TO ALIGN WITH OTHER CONUL MEMBERS?

Page 8: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Storage

•Storage procured by the library’s parent institution (57.1%)

•Rest split between local, hosted and third party-managed

•No institution using cloud storage as the main object store

•Canonical copy mostly stored offline (CDs/DVDs, disconnected external HDs)

•57.1% (8/14) using SAN storage 28.6% (4/14) using NAS

•Content managed in TB: 3 institutions > 10TB, mostly < 1TB

•71.4% (10/14) allow the repository to arrange data on filesystem (Akubra/Modeshape)

Page 9: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Backups

•Online backups 64.3%

•Nearline 71.4%

•Offline 42.9%

•Many have an instance of each, demonstrating multiple levels of backup policies

•Regular test of backups: 21.4% (3/14) regularly test, 42.9% (6/14) no schedule

•78.6% back up AIPs offsite

•50% (7/14) are continuously replicated to redundant copy, immediately available

Page 10: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Data Preservation

Yes

No

STAFF RESPONSIBLE FOR PLANNING PRESERVATION

Page 11: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Data Preservation

YesNo

PERFORM FIXITY CHECKS

Page 12: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Data Preservation

Yes

No

DOCUMENTED PRESERVATION POLICIES

Page 13: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Trustworthiness

0 2 4 6 8 10 12 14

Trusted Repository Audit Checklist (TRAC)

Data Seal of Approval

Not applicable

Assessment of Trustworthiness

Page 14: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Staffing

0

0.1

0.2

0.3

0.4

0.5

0.6

0.7

0.8

Ingest Data Management Preservation Planning Management Software development Systems Administration /Operations

Archival Storage Access

FTE per OAIS function

Page 15: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Skills: Data Management

Page 16: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Skills: Preservation

Page 17: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Skills: DevOps

Page 18: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

Conclusion•Technology aspects are in hand• Infrastructure

• Storage

• Backups

•Data Preservation is not considered a priority

•Room for improvement on all aspects

•All at the early stages

•Opportunities to share skills – not “reinvent the wheel”

•Survey results to be published on Github

Page 19: Survey of Digital Infrastructures and Services Clarke...preservation planning, resourcing & skills) •OAIS Information Model (SIPs, AIPs, metadata) •Operating Environment (community,

DSI Sub-group - Terms of ReferenceIdentify and develop major issues and strategic priorities.

Identify and develop opportunities for cooperation and collaboration among CONUL libraries.

Identify and develop key relationships outside of CONUL.

To continue to identify affinities or overlap with other CONUL groups’ areas of enquiry.

To continue to identify an appropriate structure for CONUL to address the topic in the longer term.

To identify and track work underway, existing infrastructures and digitisation resources, pertinent expertise, policies etc., as well as additional relevant issues.

To consider a range of issues relevant to OPEN ACCESS.