A presentation by Olga Koz at the Kansas Library Association, College and University Libraries Section (CULS) Spring 2014 Conference. The rapid pace of change in today's higher education environment creates pressure within an academic library to implement change, new programs, strategy, and technology in order to meet the demands of its stakeholders. Studies have shown that approximately 70% of organizational innovations fail. One of the main causes for these failures is the lack of a thorough diagnostic investigation of stakeholders’ needs, university or college environment. A thorough diagnostic examination includes both an external and internal analysis using some form of assessment. The presenter, a doctoral candidate, OD consultant, and an academic librarian, briefly describes the usual library assessment tools and discuss non-traditional diagnostic methods.
Library, what's library?" Disc from the Library How does an
academic community view a library? How do librarians assess a
library? Prediction
Looking from different viewpoints Library prototype Students
schemata Faculty schemata Librarians Systems/functionalist approach
Managers Interpretive
Digging deeper or Working the Onion Quantitative research:
Surveys, statistical analysis, sociometry Qualitative research:
Interview, focus groups, ethnography, observations, archival
materials, discourse analysis, case study Action
researchEthnography Narrative analysis Types of tools and types of
data
Tools Traditional tools Non- traditional tools Our tools
Surveys simulation netnography social network analysis
Names Purpose Type LibQual+ users' opinions of service quality
survey DigiQual users opinion of digital services survey MINES for
Libraries Purpose of use of electronic resources survey Project
COUNTER electronic resources usage ClimateQUAL staff perceptions
concerning the library survey Library/ ARL Assessment tools
Institutional Effectiveness or Research or Assessment Name
Purpose Type CIRP/ HERI Complex. Student and faculty experience
surveys HEDS Impact of teaching, research practices, IL survey
IPEDS/NCES Integrated Postsecondary Education Data System survey
NSSE Student engagement/expe rience survey
Surveys Science + Experience Library survey library questions
Beware of asking about causality What are your main reasons for
using the Library (check all that apply)? No complex questions or
problems Ask 1 question at a time (double barreled questions First
hand experience Limit hypothetical questions What will be the great
source of information in your field in 2 years? Sensitive answers
How many times per month do you use library resources? vs. How many
times per term have you been asked by instructor to use library
resources? Leading and loaded questions Experts believeLibrary is
paying thousands of dollars to What do you see as the disadvantages
No unwarranted assumption With the budget like it is, do you think
we should buy more audio-visual materials? Geek Comic for April
20th A Contradicting Survey Result about Surveys .
Mission statement Learning Objectives Class observation forms
Assignments
Michael Wesch and his Digital Ethnography Research Team of 2011
has released Visions of Students Today: an exciting video collage
about student life created by students themselves.
Participatory approach: As a member of faculty online and
face-to- face committees and active member of online forums,
network and communities of practice, you have access to first hand
information for ethnographic research Adjunct faculty forum Q:
College required text books - Do you teach directly from them or do
you draw support for your subject from other mediums?
The median salary is $22,041 Some 89 percent of respondents
teach at two or more institutions Report to House Education and the
Workforce Committee, 2014)
Action Research Disadvantages: bias, cannot be generalized,
hard to get an outsider perspective, validity Advantages:
action-oriented, participatory
Organizational Diagnosis The systematic and scientifically
based assessment, description, explanation, and prediction of
regularly occurring experience, behavior, and performance of
members of organizations and their interaction.
Presentation Analytics Dashboards Indianapolis Museum of Art
UMASS Amherst Libraries Indiana U. Purdue U. NCSU Libraries UMASS
Dashboard based on Tableau software
Input, output, outcomes Assessment helps distinguish between
teaching (input) and learning (outcomes) Nelson, W.N, &
Fernekes, R. W. (2002). Standards and assessment for academic
libraries: A workbook. Chicago: Association of College and Research
Libraries. Mission Inputs Outputs Outcomes Strategies Actions
Goals
Prediction Excellent first year IL program Students know how to
find, assess, and use information No need in course or embedded
librarians? Optimization of searching experience Students are able
to find information No need for reference librarians Digitization
Everything is online! No need in face2face or brick & mortar
service
Will a Library go supernova or just fade away? X-ray images of
Cassiopeia A, taken by the Chandra satellite. CARTOON BY TOM
GAULD
References Duke, L. M., & Asher, A. D. (2011). College
libraries and student culture: What we now know. Chicago: American
Library Association. Gordon J. Hewitt, Hewitt R.T. (2010). Ability,
Assistance, and Collaboration in Academic Library Assessment.
Library Philosophy and Practice , 479 Retrieved from
http://digitalcommons.unl.edu/libphilprac/479 Nelson, W.N, &
Fernekes, R. W. (2002). Standards and assessment for academic
libraries: A workbook. Chicago: Association of College and Research
Libraries Kozinets, R. V. (2010). Netnography. Doing ethnographic
research online . Thousand Oaks, CA: Sage Publications.
Morton-Owens, E. & Hanson, K. (2012). Trends at a Glance: A
Management Dashboard of Library Statistics. Information Technology
and Libraries, 31 (3).
Oakleaf, M. J., Association of College and Research Libraries.,
& American Library Association. (2010). The value of academic
libraries: A comprehensive research review and report. Chicago, IL:
Association of College and Research Libraries, American Library
Association. Retrieved from www.aclr.ala.org/value. Rambler, L. K.
(1982). Syllabus Study: Key to a Responsive Academic Library.
Journal of Academic Librarianship, 8(3), 155.