27
Going, going, gone Can Legal Deposit save us from the digital black hole? Margaret Flood Keeper, Collection Management Arlene Healy Sub-librarian, Digital Systems & Services CONUL Conference 3 rd June 2015

Going, going, gone - Can legal deposit save us from the digital black hole? - Margaret Flood, Arlene Healy

Embed Size (px)

Citation preview

Going, going, goneCan Legal Deposit save us from the digital black hole?

Margaret FloodKeeper, Collection ManagementArlene HealySub-librarian, Digital Systems & ServicesCONUL Conference 3rd June 2015

Overview

The question Legal Deposit - context and issues in a digital environment The UK Experience as case study

Progress to legislation

The technical challenges

What is in scope for collection?/what is collected?

Capturing the web

Balancing stakeholder interests Answering the question and lessons learned … and Ireland?

What is Legal Deposit?

“Legal deposit is a statutory obligation which requires that any organization, commercial or public, and any individual producing any type of documentation in multiple copies, be obliged to deposit one or more copies with a recognized national institution”.

Guidelines for Legal Deposit Legislation Unesco,

Paris, 2000

Objectives of Legal Deposit

To preserve the cultural, social and intellectual output of a nation for the benefit of future generations

To make it accessible to researchers & citizens both now and in the future

To record and describe what has been collected

Trinity College Dublin, The University of Dublin

The comprehensiveness of the national intellectual archive is becoming increasingly compromised as new types of publication are not covered by the legal deposit system.”

British Library, 2002

Image © British Library Board

Trinity College Dublin, The University of Dublin

UK - the path to legislation & realisation

British

Govt.

Consu

ltatio

n paper

Kenny Worki

ng Party

Joint C

ommittee fo

r Legal D

eposit

Key success factors:– Genuine cross-party support– High degree of cooperation between libraries and publishers both before and

after legislation– Publishers interest represented at all stages of the process– New UK legislation disassociates legal deposit from copyright framework– Enabling legislation which is flexible enough to cope with formats not yet

visualised– Full public consultation and regulatory impact assessment part of the process

Legal Deposit

Libra

ries

ActJoint C

ommittee fo

r Voluntary

Deposit

Voluntary Deposit

Sch

eme for O

ffline

and Micr

oform

First

reco

mm

enda

tions

Legal

Deposit

Adv

isory

Pan

el

Implementation

of Regulations

Revie

w

2004 2005 2008 2013 201720032000199919981997

Trinity College Dublin, The University of Dublin

The contents have it …

Legal Deposit Libraries (Non-Print Works) Regulations 2013 signed into law on the 6th March 2013

Extension of existing legal frameworks

Systematic collection of UK’s published output for heritage and preservation

By 6 UK Legal Deposit Libraries

Trinity College Dublin, The University of Dublin

Let’s party – The Launch

2013 Regulations: Access

Access only on the premises of a legal deposit library

One concurrent user per work No downloading/digital copying Limited printing (UK ‘Fair dealing’) “Perpetual copyright”[?]

Implications for Web Archive

Post-implementation review 2017/2018

Trinity College Dublin, The University of Dublin

Implementation: Digital Library System

Collaboration on implementation & shared costs

4 Storage Nodes (Complete Copies) British Library, St. Pancras British Library, Boston Spa National Library of Wales National Library of Scotland

Additional Access Points Bodleian Library, Oxford Cambridge University Library Trinity College Library, Dublin

Trinity College Dublin, The University of Dublin

INFO Page

Outside TCD Reading Room

Stella Search

TCD eLD Local Infrastructure

Secure Server

Book/Article

Web Archive

TCD Reading Room Desktop

Virtual Desktop

TCD Print Service

Stella Search

ERICOM CONNECT

REQUEST

REQUEST

Book/Article

Web Archive

RESPONSE Digital Library System

Web ArchiveRESPONSE

REQUEST

Implementation: Access & Print Service

2013 Regulations: Collecting

1. Offline works (CD-ROM) Publisher deposit by obligation

2. Open web LDL crawl for UK domain web archive

3. Web behind pay walls and password barriers Negotiated access for harvesting

4. Online works (e-journals, e-books) Publisher deposit (to each deposit Library) by mutual

agreement

Print or electronic version, not both

Trinity College Dublin, The University of Dublin

13

Collecting StrategyYear 1

2013 – 2014 Year 2

2014-2015Year 3

2015-2016Year 4

2016 - 2017

Themed crawls i.e. Focused crawls on event-based collectionsUK domain crawl – circa 4.8m websites

2 relatively small publishers (3,100 titles annually)

XML/SGMLe-journals

+PDF e-

journals andmonographs

EPube-books

Websites

2,881 e-journal titles from 3 major

publishers

To date: 711,145 e-journal articles deposited.

3 major publisher

13 major publishers set to transition to e-deposit (15,500 new titles annually)

Publisher deposit portal ‘beta’ launched

3,278 e-journal titles from 9

major publishers

3 additional relatively small publishers(3,585 titles annually)

Maps & Music Scores

Harvesting of individual documents from the Web

4,614 e-journal titles from 14

major publishers.(3 more in

negotiation)

139 publishers registered to date

Discussion in progress to prioritise publishers for 2016/17 –Focus on ‘born digital’ content

Active promotion of the Portal to smaller publishersc

Trinity College Dublin, The University of Dublin

The UK Web Domain

Over 10 million .uk registered domain

UK organisations also use non .uk domain names (eg .com or .org)

Non-print Legal Deposit applies to

the open (freely available) web: .uk

other UK-published (non .uk) websites, such as .com, .org…

made available to the public by a person or an organisation and the activities relating to the creation or the publication of the work take place within the United Kingdom

Trinity College Dublin, The University of Dublin

Web archive – collecting strategy

Domain Crawl

News

Special collection Special collection

Domain crawl: • Broad sweep

of UK domain

• Once or twice a year

Events & key sites and news: • Events of UK

interest• High value,

high impact sites

• National & regional news

Special Collection: • Focused,

thematic collections

• Support priority subjects

Key sitesEvents

Special collectionSpecial collection

Trinity College Dublin, The University of Dublin

Legal Deposit UK Web Archive

Annual Domain Crawl 2013: 31TB, 1.2 billion URLs, 4

million hosts 2014: 57TB, 1.9 billion URLs, 10.3

million hosts including 2.5 non .uk

Events, news sites, key sites ~15TB

Full-text searchable in Legal Deposit Libraries’ reading rooms

Discoverable through BL Web Archive Search Tool

Trinity College Dublin, The University of Dublin

Lessons Learned - UK Experience

• Ensure conditions of access are intuitive to how people find and use information online

• Balance security & access requirements

Trinity College Dublin, The University of Dublin

Lessons learned – UK Experience

The technical infrastructure and access solution meet the security requirements of the Regulations

– one concurrent user per Library premises

– no digital copying

However the end result is currently inflexible and inhospitable to integration with other systems.

– Provision of universal access problematic

– Self Service Printing – implementation challenges

Trinity College Dublin, The University of Dublin

Answering the question – a qualified yes

• National boundaries do not make sense in a digital world

• Content is to some extent pre-selected by technical capability

• The content producers and the formats are evolving faster than libraries can deal with

• There are open questions on sustainability and resourcing going forward

But

While Legal Deposit may not be the perfect answer, it is altruistic in its objective to serve the common good for the now and into the future

Trinity College Dublin, The University of Dublin

“Our commercial partners in the information delivery space do wonderful things and we couldn't live our lives without them.

But the time frame we think on, centuries back and centuries into the future, allows us to think about trust in its highest sense, and authentication and provenance of information, and digital information in particular”.

Roly Keating

CEO, British Library

The Mechanical Curator and Other Stories,

Hay Festival, 23rd May 2015

Trinity College Dublin, The University of Dublin

…. and Ireland

Small-scale commercial publishing, but significant publishing activity across a number of sectors.

Lack of effective legislative framework Copyright and Related Rights Act, 2000 – limited

provisions for non-print formats Irish Copyright Review, 2012, recommends the

insertion of a new section in the Act to deal with digital legal deposit.

What might be done in the absence of legislation?

Trinity College Dublin, The University of Dublin

Irish Publishing Landscape 2015

With thanks to Niamh Harte, TCD Library

Trinity College Dublin, The University of Dublin

With thanks to Niamh Harte, TCD,

Web-site publishing

Trinity College Dublin, The University of Dublin

Print Legal Deposit - monographs

With thanks to Niamh Harte, TCD Library

Trinity College Dublin, The University of Dublin

Initiatives in Ireland

Trinity College Dublin, The University of Dublin

While preserving the content, and safeguarding the interests of the rights-holders are critical, future Irish legislation should endeavour to create a legal framework that makes the content collected under digital legal deposit accessible and useful to the greatest number of our citizens

Final thoughts