NEXT-GENERATIONLIBRARY DISCOVERY:

Overview + Recent trends and developments

Marshall BreedingIndependent Consultand , Author, Founder and Publisher, Library Technology Guideshttp://www.librarytechnology.org/http://twitter.com/mbreeding

June 25, 2012 Computers in Libraries 2012

Abstract

Marshall Breeding will give an overview of the current scene in library discovery services. He will review the major products and technologies and give an update on recent developments and trends that libraries should be aware of as they consider these products.

Challenge: Disjointed approach to information and service delivery

Library Web sites offer a menu of unconnected silos: Books: Library OPAC (ILS online catalog module) Articles: Aggregated content products, e-journal

collections OpenURL linking services E-journal finding aids (Often managed by link resolver) Subject guides (e.g. Springshare LibGuides) Local digital collections

ETDs, photos, rich media collections Metasearch engines Discovery Services – often just another choice among

many All searched separately

Online Catalog

Books, Journals, and Media at the Title Level

Not in scope: Articles Book Chapters Digital objects Web site content Etc.

Scope of SearchSearch:

Search Results

ILS Data

Next-gen Catalogs or Discovery Interface (2002-2009)

Single search box Query tools

Did you mean Type-ahead

Relevance ranked results (for some content sources)

Faceted navigation Enhanced visual displays

Cover art Summaries, reviews,

Recommendation services

Discovery Interface search model

Search: Digital

Collections

ProQuest

EBSCOhost

…MLA

Bibliography

ABC-CLIO

Search Results

Real-time query and responses

ILS Data

Local Index

Meta

Search

En

gin

e

Discovery Products

http://www.librarytechnology.org/discovery.pl

Differentiation in Discovery

Products increasingly specialized between public and academic libraries

Public libraries: emphasis on engagement with physical collection

Academic libraries: concern for discovery of heterogeneous material types, especially books + articles + digital objects

Discovery from Local to Web-scale Initial products focused on technology

AquaBrowser, Endeca, Primo, Encore, VuFind, LIBERO Uno, Civica Sorcer, Axiell Arena Mostly locally-installed software

Current phase is focused on pre-populated indexes that aim to deliver Web-scale discovery Primo Central (Ex Libris) Summon (Serials Solutions) WorldCat Local (OCLC) EBSCO Discovery Service (EBSCO) Encore with Article Integration (no index, though)

Web-scale Index-based Discovery

Search:

Digital Collections

Web Site ContentInstitution

al Repositori

es

…E-Journals

Reference Sources

Search Results

Pre-built harvesting and indexing

Conso

lidate

d In

dex

ILS Data

Aggregated Content packages

(2009- present)

Web-scale Search Problem

Search:

Search Results

Pre-built harvesting and indexing

Con

solid

ate

d

Index

???

Non Participating

Content SourcesProblem in how to deal with

resources not provided to ingest into consolidated index

Digital Collections

Web Site ContentInstitution

al Repositori

es

…E-Journals

ILS Data

Aggregated Content packages

Encore Synergy

Search: Digital

Collections

ProQuest

…Lo

cal

Index

ILS Data

Web

S

erv

ices

Local Index Results

Local Index Results

Remote Search Results

EBSCOhost

…MLA

Bibliography

ABC-CLIO

Con

solid

ate

d in

dex

Search Engine

Unified Presentation LayerSearch:

Digital Coll

ProQuest

EBSCO…

JSTOR

Other Resour

ces

New Library Management Model

`

API Layer

Library Services Platform

LearningManageme

nt

LearningManageme

nt

Enterprise ResourcePlanning

Enterprise ResourcePlanning

StockManageme

nt

StockManageme

nt

Self-Check /

Automated Return

Self-Check /

Automated Return

Authentication

Service

Authentication

Service

Smart Cad /

Payment systems

Smart Cad /

Payment systems

Discovery

Service

The Discovery Services Market

Adoption of Discovery Services Next-gen catalogs or discovery services

have been around since 2002 Many mature products Continuing to evolve and expand Online catalog components of ILS

products have taken on many of the characteristics of discovery layers Examples: LS2 PAC, Polaris PowerPAC

Discovery Service Installations

Discovery Product 2007 2008 2009 2010 2011 Installed

Primo 12 37 53 506 111 914

AquaBrowser 55 339 64 69 74 254

Encore 72 72 109 56 72 326

LS2 PAC   46 77 58 88 236

Summon     50 164 214 407

Enterprise   16  75 100 251

Civica Sorcer     7 12 22 39

Axiell Arena     61 57 33 76

Chamo     10 34 7 51

EBSCO Discovery Service

Global Primo Installations

Summon Global Adoption

Expanding the Depth of Discovery

Citations / Metadata > Full Text Citations or structured metadata provide

key data to power search & retrieval and faceted navigation

Indexing Full-text of content amplifies access

Important to understand depth indexing Currency, dates covered, full-text or citation Many other factors

Full-text Book indexing

HathiTrust: 11 million volumes, 5.3 million titles, 263,000 serial titles, 3.5 billion pages

HathiTrust in Discovery Indexes Primo Central (Jan 20, 2012) [previously

indexed only metadata] EBSCO Discovery Service (Sept 8 2011) WorldCat Local (Sept 7, 2011) Summon (Mar 28, 2011)

Challenge for Relevancy

Technically feasible to index hundreds of millions or billions of records through Lucene or SOLR

Difficult to order records in ways that make sense

Many fairly equivalent candidates returned for any given query

Must rely on use-based and social factors to improve relevancy rankings

Quest for Improved Relevancy Example: Ex Libris Primo ScholarRank

Relevancy tuned for scholarly content Uses bX data to assign score that reflects

scholarly importance Able to weight by disciplines and filter by

other factors for signed-in users Now available in Primo Version 4

Challenges for Collection Coverage To work effectively, discovery services

need to cover comprehensively the body of content represented in library collections

What about publishers that do not participate?

Is content indexed at the citation or full-text level?

What are the restrictions for non-authenticated users?

How can libraries understand the differences in coverage among competing services?

Evaluating the Coverage of Index-based Discovery Services

Intense competition: how well the index covers the body of scholarly content stands as a key differentiator

Difficult to evaluate based on numbers of items indexed alone.

Important to ascertain now your library’s content packages are represented by the discovery service.

Important to know what items are indexed by citation and which are full text

Important to know whether the discovery service favors the content of any given publisher

Open Discovery Initiative

NISO Work Group to Develop Standards and Recommended Practices for Library Discovery Services Based on Indexed Search

Informal meeting called at ALA Annual 2011

Co-Chaired by Marshall Breeding and Jenny Walker

Term: Dec 2011 – May 2013

Open Discovery Initiative stakeholders

Libraries: provide discovery services on behalf of their patrons

Publishers: provide content to be indexed by discovery services

Discovery Service Provides: develop discovery interfaces and populate indexes

ODI Project Goals:

Identify … needs and requirements of the three stakeholder groups in this area of work.

Create recommendations and tools to streamline the process by which information providers, discovery service providers, and librarians work together to better serve libraries and their users.

Provide effective means for librarians to assess the level of participation by information providers in discovery services, to evaluate the breadth and depth of content indexed and the degree to which this content is made available to the user.

Summon

Disciplined Scoped Searching “With Summon, librarians can now easily

create, customize and embed discipline scoped search boxes and search widgets in any web environment—including research guides, course management pages, collaborative research portals and more—to provide users with the ability to search for highly relevant materials from a discipline focused setting. ” 

bX Recommendation Service Makes associations among scholarly articles

based on data mined from OpenURL resolver logs http://www.exlibrisgroup.com/category/bXUsageBasedServices

Finds associations not apparent from keyword matching or controlled vocabularies

New Services: bX Hot Articles (Current Month) bX Most Popular Articles (Current Year) bX Journal Popularity Report (Previous Quarter)

bX in Elsevier Scopus and Science Direct (limited to Elsevier content)

E-book Integration

The rise of e-books

Academic libraries: e-books included in aggregated content packages E-books used primarily for research and

consultation, not long reading Public Libraries: Subscriptions to e-book

services that provide an outsourced collection of loanable e-books

K-12 Schools, Colleges, Universities: interest in electronic textbooks

Integrating e-Books into Library Automation Infrastructure

Current approach involves mostly outsourced arrangements

Collections licensed wholesale from single provider

Hand-off to DRM and delivery systems of providers

Loading of MARC records into local catalog with linking mechanisms

No ability to see availability status of e-books from the library’s online catalog or discovery interface

Technology Issues

Access to materials controlled through Digital Rights Management

Closed ecosystems that control content through identity management and rights policies

Imposes significant overhead on the user experience: Download an install DRM components Establish user credentials in site trusted by DRM Works only with devices that comply with DRM

restrictions

BiblioCommons

Pilot at Boston Public Library, NYPL Based on intercepting HTML from

Overdrive Project on hold until Overdrive Releases its

API Full e-lending capabilities within the

discovery interface Overdrive

See: http://www.bibliocommons.com/sites/default/files/OverDriveintegrationcompanison.pdf

Polaris Library Systems

Announced e-book lending integrated within Polaris PowerPAC 3M Cloud Library

Expect partnerships with other e-book providers as APIs become available

Polaris e-book integration example

SirsiDynix eResource Central New product to facilitate management of

e-books and other electronic resources Single click to read and download e-

books Initial partnership with Axis 360 from

Baker and Taylor

Device AgnosticInterfaces must adapt to many devicesDecoupled Discovery?

Decoupled interfaces emerged from broken online catalogs Poor interfaces, inadequate scope

Inefficient integration between automation and discovery platforms

New wave of more tightly integrated suites: Ex Libris Alma > Primo / Primo Central OCLC WorldShare Management Services > WorldCat

Local Serials Solutions Intota > Summon

Still possible to decouple, but more effort, worse results

Next-Gen Library Catalogs

Marshall BreedingNeal-Schuman PublishersMarch 2010

Volume 1 of The Tech Set

Questions and discussion