Dana Thomas, Ontario Council of University Libraries Alan Darnell, Ontario Council of University Libraries Understanding Use of Networked Information Content:

Dana Thomas, Ontario Council of University LibrariesAlan Darnell, Ontario Council of University Libraries

Understanding Use of Networked Information Content: MINES for Libraries®

Implementations at Scholars Portal

Terry Plum, Simmons College Martha Kyrillidou, Association of Research Libraries

Why measure digital content use?

• More than 60% of the library materials expenditures

in major research libraries is spent on electronic resources

• This proportion is even higher for smaller college and university libraries

• The amount is yet higher considering consortial and state-wide and nation-wide deals

from ARL Statistics Source: http://interactive.arlstatistics.org

CNI Fall 2011 Membership Meeting 2

Ontario Council of University Libraries


Consortial Licensing

• Canadian Research Knowledge Network– National site licensing agency– Major publishers (e.g. Elsevier)

• OCUL-IR– Standing committee of OCUL– Large and small publishers

• Knowledge Ontario– Multi-sector


Scholars Portal

• Shared technology infrastructure hosted at University of Toronto

• Shared services (e.g ILL, SFX, VR, RefWorks)• Locally loaded content (aggregation and

archiving)– Journals – Books– Microdata– GIS


OCUL Scholars Portal

• In 2004 the digital content was primarily e-journals (8.2 million articles from 7,219 full text electronic journals)

• In 2010 Scholars Portal has 23 million journal articles from over 11,200 full text electronic journals

• Extensive growth has occurred in other formats: 350,000 e-books, statistical and geospatial data collections

• SFX, the open-URL resolver that connects users to this digital content, is an integral component of the 2010 implementation of MINES for Libraries® since it acts as the delivery mechanism by which the patron encounters the survey


What is MINES?• Action research– Historically rooted in indirect cost studies– Set of recommendations for research design– Set of recommendations for web survey

presentation– Set of recommendations for information

architecture in libraries– Plan for continual assessment of networked

electronic resources– An opportunity to benchmark across libraries


Library User Survey


Library User SurveyPatron Status


Library User SurveyAffiliation


Library User SurveyLocation


Library User SurveyPurpose

12CNI Fall 2011 Membership Meeting

Goals for MINES for Libraries at OCUL 2010-11• demonstrate the value of the library• secure resources as needed• understand use of resources within the library, on

campus outside the library, and off campus• understand use of resources across disciplines and

user groups• understand why people are using electronic resources• Track the trajectory of the use of the resources since

2004-05


OCUL MINES 2004 vs 2010

OCUL I : 2004• Randomly selected 2 hour periods each month for a year• Mandatory

OCUL II: 2010• SFX as delivery mechanism• Systematic sampling (every nth)• Mandatory and optional versions• Additional question: contact pool


Limitation: Variations in SFX as delivery mechanism

15

Institution Uses az list? SFX from OPAC? Google Scholar? Citation linker? bx?PRIMO?/

Discovery layer?

ALGOMA

BROCK YES NO YES YES

CARLETON NO NO YES YES YES

DURHAM

GUELPH YES NO YES YES YES YES

LAKEHEAD YES YES YES YES YES NO

LAURENTIAN YES YES YES YES NO NO

LAURIER YES NO YES YES YES YES

MCMASTER YES YES YES YES YES NO

NIPISSING YES NO YES YES YES NO

OCAD YES NO NO YES NO NO

OTTAWA YES NO YES YES NO NO

QUEENS NO NO YES YES NO YES

RMC

RYERSON YES YES YES YES NO NO

TORONTO YES NO YES YES YES NO

TRENT YES NO YES YES NO NO

UOIT NO NO YES YES NO NO

WATERLOO YES YES YES YES YES YES

WESTERN YES YES YES YES YES NO

WINDSOR YES YES YES YES YES NO

YORK NO NO YES YES NO NO

CNI Fall 2011 Membership Meeting

MINES survey using LimeSurvey software. Ryerson's optional survey

User gets directed to the proper MINES Survey or to their resource, as appropriate.


SFX source with Get it! link


SFX menu with full text target and other target services


Introduction to OCUL Report and Institutional Reports• 34,776 complete responses across all OCUL

institutions• 4,255 surveys from mandatory and 30,521 from

optional implementations• Summarized as:– PDF reports– Excel files– SPSS dataset(s)– SPSS syntax file(s)


Distribution of OCUL Partner Institutions' Enrollments as of July 2010, Responses to MINES for Libraries(R), and SFX

Statistics (Clicks) from 2/16/2010 to 2/17/2011


ARL Final Report

• Available at http://www.libqual.org/documents/LibQual/publications/MINES_OCUL2011.pdf


http://www.libqual.org/documents/LibQual/publications/MINES_OCUL2011.pdf

http://www.libqual.org/documents/LibQual/publications/MINES_OCUL2011.pdf

Findings: Frequency of Use of Electronic Resources by User Status (10/11)


Findings: Frequency of Use of Electronic Resources by Primary Purpose of Use (10/11)


Findings: Frequency of Use of Electronic Resources by Location (10/11)

Off Campus use up 23.5%

On Campus not in library down 15.9%Library use down

7.7%


Findings: Frequency of Use of Electronic Resources by Affiliation (10/11)


MINES for Libraries ® for CNISFX provided information to add six additional variables for each survey response:

• ISSN / ISBN• Normalized Publisher or Vendor Name• Database Name• Resource Type: EJournal, ebook. Database• Subscription Type: Consortial, Local, or Free/Open Access• Consortia: OCUL, CRKN, Knowledge Ontario


Consortia / Local / Open Access


Consortial Breakdown



Does purpose of use vary by subscription type?


Resource Type


MINES: Publisher / Vendor Breakdown


Which resources are used for funded research?


Publisher use by discipline


Are there differences in recommendations from librarians vs. faculty?


MINES: Are there differences in recommendations from librarians vs. faculty?


n=2467n=6336

Publisher/Vendor Uses in MINES for Libraries®


Within each publisher what is the breakdown by user role?


Within each user role what is the breakdown by publisher?


Within each publisher what is the breakdown by affiliation?


Within each affiliation what is the breakdown by publisher?


Within each publisher what is the breakdown by purpose of use?


Within specific purpose of use what is the breakdown by publisher?


Practical Implications/Value

• What are the implications of running the survey in session mode vs link-resolver?

• How does the use of consortial products compare to that individually-licensed content?

• What conclusions can be drawn about the efficacy of surveying users via an open-URL resolver?

• How will MINES fit into the overall assessment program for OCUL?

• How useful is the contextual information from MINES in understanding user workflows?

• Are there any lessons learned regarding discoverability?


What else would be useful to query?– the relation between mandatory and optional survey

methods– informing collection development decisions, – understanding the impact of open access, etc.– ……


Credits

• The presenters thank:– Catherine Davidson for her work contributing to

the slides– Vidhya Pathasarathy, Bilal Khalid, Agnes Bai, Gary

Roebuck and other systems staff for their work on the survey

– Kevin Wong for writing a program to complete a first pass at parsing target urls


Thank you

Alan DarnellProject Director, Scholars Portal [email protected]

Dana Thomas Evaluation and Assessment Librarian, Scholars Portal [email protected]

Terry Plum, Assistant Dean, Simmons Graduate School of Library and Information Science [email protected]

Martha Kyrillidou Senior Director, Statistics and Service Quality Programs, Association of Research Libraries [email protected]


mailto:[email protected]



Documents

Dana Thomas, Ontario Council of University Libraries Alan Darnell, Ontario Council of University Libraries Understanding Use of Networked Information Content: