November 2004

NDIIPP: Future Directions and Relevance to Other Countries

Beth Dulabahn

Office of Strategic InitiativesLibrary of Congress November 7, 2004

November 20042

NDIIPP Legislation and FundingNDIIPP Legislation and FundingNDIIPP Legislation and FundingNDIIPP Legislation and Funding

• Created by federal legislation (PL 106-554) in December 2000

• $100 million in appropriated funds

• Up to $175 million potentially invested– $75 million of the appropriated funds subject to $

for $ match from non-federal sources

November 20043

NDIIPP Goals

• Develop a national digital collection and preservation strategy

• Work with government agencies, libraries, archives, and other stakeholders to establish partnerships and form networks

• Help identify and preserve at-risk digital content

• Support development of tools, models, and methods for digital preservation

November 20044

Who’s Included?

• Key federal agencies (including NARA, NLM, NAL, Commerce)

• Libraries, archives, and other cultural institutions

• Non-profit entities (e.g., RLG, OCLC, CLIR)

• Non-federal and commercial sectors (e.g., motion picture studios, record labels, publishers)

November 20045

Initial Activities• Established the NDSAB in Spring 2001

– Representation from federal agencies, industry, research libraries and foundations

• Convened Stakeholder Meetings in Fall 2001– 3 workshops including representatives from the

commercial sector

• Commissioned environmental scans• Conducted Scenario Planning sessions• Defined preservation architecture space • Facilitated a National Science Foundation

research agenda• Developed Plan & presented to Congress

2003

November 20046

NDIIPP Strategy

• Iterative approach

• Learn by doing

November 20047

NDIIPP Focus Areas

• Preservation architecture

• Digital preservation research

• Network of preservation partners

November 20048

Preservation Architecture

• Architecture is a conceptual framework to guide development of national preservation network

• Build upon current work

• Provide basis for communication about the problem space

November 200410

Archive Ingest and Handling Test

• Document steps taken to ingest heterogeneous set of digital content

• Testers have digital preservation capabilities: Johns Hopkins, Old Dominion, Harvard, Stanford

• Each to work with GMU 9/11 Archive– 12gb with 57,000 objects associated metadata

– Diverse file formats

• Identify metrics for ensuring preservation of data integrity/document logical integrity

November 200411

Archive Test Activities

• Accept archive as-is

• Generate metadata

• Ingest content into the archive

• Migrate/emulate content as applicable to each archive

• Export content/metadata out of the archive

November 200412

Archive Test Outcomes

• List of logical candidate architectures for future work

• Understanding of the strengths and weaknesses of each

• Rough dollar cost figures for each solution

• Grasp of the possibilities and challenges of federating

November 200413

Research Program

• Joint LC/National Science Foundation (NSF) digital preservation research grants program

• NSF administers

• Agenda shaped by It’s About Time report

• Looking to fund cutting edge research to address major needs

• Proposals due 9/14/2004; peer review panels evaluating submissions

• Grants to be announced early 2005

November 200414

NDIIPP Partnerships

• Agreements finalized Sept. 2004

• Eight consortia involving over 30 partners– State government entities

– Universities

– Cultural heritage institutions

– Private & not-for-profit

• Awards totaling $15+ million

• Projects expected to last 3 years

• Aim is to spur collaboration in selecting and preserving at-risk content

November 200415

Diversity of Content

• Funded projects will work with diverse and challenging content, including

– TV broadcasts and digital video

– Web sites

– State and local government information

– Geospatial data

– Social science data

November 200416

NDIIPP Partner Projects with Web Harvesting Components

• The Web at Risk: A Distributed Approach to Preserving Our Nation’s Political Cultural Heritage

– California Digital Library, lead

• University of North Texas, New York University

– State & local gov’t publications, political campaigns, labor history, former federal agency sites

– Develop tools for selection and acquisition

November 200417

NDIIPP Partner Projects with Web Harvesting Components (Cont.)

• Exploring Collaborations to Harness Objects with a Digital Environment for Preservation– University of Illinois at Urbana-Champaign, lead

• OCLC; Tufts University; Michigan State, Arizona, Connecticut, Illinois, North Carolina, and Wisconsin State libraries

– Collect Web-based state gov’t agency publications

– Develop tools for selection, acquisition, and access

– Test existing repository architectures (Dspace, Greenstone, FEDORA, Eprints)

November 200418

The Next NDIIPP Area of Investment…• State and Local Governments

• Currently in planning phase

• Plan to award $$ to states through IMLS

November 200419

Achievements at End of 5 Years

• A network of 50-75 partners

• Vast archive of at-risk content

• Recommendations to Congress on long-term governance of a national digital preservation