Download pdf - ASSESSING THE VALUE OF LIBRARY INSTRUCTION USING … · For fall 2016, librarians created two online exit surveys (Option A & B). Librarians selected one survey to use after each

Transcript
Page 1: ASSESSING THE VALUE OF LIBRARY INSTRUCTION USING … · For fall 2016, librarians created two online exit surveys (Option A & B). Librarians selected one survey to use after each

ASSESSING THE VALUE OF LIBRARY INSTRUCTION USING QUALTRICS SURVEY SOFTWARELindsay Davis Instruction Librarian Sara Davidson Squibb Head of User Communication & Instruction

Elizabeth McMunn-Tetangco Instruction Librarian

BACKGROUNDLibrarians partner with faculty to teach students research skills in course-integrated library sessions. To assess students’ learning & what students value from library sessions, librarians analyze the following:

cover letters from student writing portfolios

resources used in final student papers

student reflections on library sessions

online exit surveys via Qualtrics

QUANTITATIVE ANALYSIS: MAJOR FINDINGSMost Valuable Skill or Concept Learned (Q2 Option A Online Exit Survey)

Learning.... n=341

Skills or Concepts Learned to Help Accomplish Coursework (Q1 Option B Online Exit Survey)

Learning....how to search databases28% 97 how to search databases26% 144

how to research in general25% 84 how to research in general22% 121

how to use specific research strategies23% 79 how to use specific research strategies20% 110

about different information types11% 39 about different information types14% 78

about other resources/tools8% 26 about other resources/tools13% 74

about the research process5% 16 5% about the research process165%

n=552

The responses to these questions were very similar. Students find value in learning about databases & how to search them using strategies such as keywords and Boolean operators.

METHODOLOGYFor fall 2016, librarians created two online exit surveys (Option A & B). Librarians selected one survey to use after each session.

Option A questions asked about students’ comfort level with librarians & what students found most valuable from the library sesssion

Option B questions were based on Keller’s ARCS (Attention, Relevance, Confidence, Satisfaction) Model of Motivational Design

FALL 2016 ONLINE EXIT SURVEY QUESTIONS

Option A

After leaving today’s session, what do you anticipate will be your next research step as you work on your upcoming assignment?

1)

2) What was most valuable to you in today’s session?

Do you feel comfortable contacting your library instructor if you have questions later in the semester? Yes/Uncertain/No

3)

4) Additional comments or suggestions?

Who was your instructor for this session?5)

6) Select which option best describes your class. Writing 10/UpperDivision Writing/Other subject area/ Graduate studies

Option B

What did you learn today that will help you accomplish the work you will be doing for this class?1)

2) Please respond to this statement: Today’s session increased my research confidence.Strongly agree/Agree/Uncertain/Disagree/Strongly disagree

What were you able to accomplish in today’s session?3)

4) Additional comments or suggestions?

Who was your instructor for this session?5)

6) Select which option best describes your class. Writing 10/UpperDivision Writing/Other subject area/ Graduate studies

BENEFITS & CHALLENGESOnline Survey Tool

Online Exit Survey Assessment Method

Intuitive & adaptable survey creation

Easily shared with colleagues

Robust reporting capabilities

Strong technical support

Institutional knowledge from Institutional Research and

Decision Support (IRDS)

Initial learning curve

Immediate feedback on instruction

Baseline for instructor effectiveness

Unusable in classrooms without technology

Limited view of student learning due to immediacy of

assessment

Qualitative data analysis requires significant time to

code & interpret results

FUTURE ASSESSMENTThe similarities between responses from both online exit surveys and previous online exit surveys suggests that librarians would benefit from learning what is still unclear to students regarding academic research.

QUANTITATIVE ANALYSIS: MAJOR FINDINGSComfort Level (Q3 Option A Online Exit Survey)Demographics by Online Exit Survey

Option A28142%

Option B38158%

n=662

300

200

100

95.4%

4.3% 0.4%Yes Uncertain No

n=280

Confidence Level (Q2 Option B Online Exit Survey)

n=382

200

100

45.3%

3.4% 0.3% 0.3%Strongly

AgreeAgree Uncertain

50.8%

Disagree StronglyDisagree

Over 95% of students felt comfortable contacting their library instructor.

96% of students stronglyagreed or agreed that thelibrary session increasedtheir research confidence.

ONLINE EXIT SURVEYIMPLEMENTATION TIPS

Connect questions to desiredoutcomes

Collaborate with colleagues onquestion design

Consider ratio of open-ended to closed-ended questions as significant time is needed to code & interpret qualitativeresults

Preliminarily sample qualitative data to develop tagging scheme for coding

Recommended

The Exit Poll Phenomenon - SAGE Publications Inc...3 The Exit Poll Phenomenon Preelection surveys typically sampled 1,000 to 1,500 adults nationwide about their backgrounds, issue
The Exit Poll Phenomenon - SAGE Publications Inc...3 The Exit Poll Phenomenon Preelection surveys typically sampled 1,000 to 1,500 adults nationwide about their backgrounds, issue Documents
M TRIANGLE EXPRESSWAY TOLL S HEDULE Exit 66 - NC … · triangle expressway toll s hedule exit 2 exit 3 exit 66 exit 69 exit 62 exit 59 exit 57 exit 56 exit 54 tolls are 35% less
M TRIANGLE EXPRESSWAY TOLL S HEDULE Exit 66 - NC … · triangle expressway toll s hedule exit 2 exit 3 exit 66 exit 69 exit 62 exit 59 exit 57 exit 56 exit 54 tolls are 35% less Documents
Education Resources Information Center - micuocopy lasoLti [loft … · 2013. 10. 24. · *Influences:. Librarians: Library Schools; Library--'7--Science: School Role, School Surveys-George
Education Resources Information Center - micuocopy lasoLti [loft … · 2013. 10. 24. · *Influences:. Librarians: Library Schools; Library--'7--Science: School Role, School Surveys-George Documents
Kazakhstan Presidential Election EXIT REPORT.pdf · EXIT POLL RESULTS. December 4, 2005. IRI, Baltic Surveys/The Gallup Organization Kazakhstan presidential election exit poll, December
Kazakhstan Presidential Election EXIT REPORT.pdf · EXIT POLL RESULTS. December 4, 2005. IRI, Baltic Surveys/The Gallup Organization Kazakhstan presidential election exit poll, December Documents
Librarians on the Move: Embedded Librarians · Librarians on the Move: Embedded Librarians Linda Masselink Grand Valley State University, masselil@gvsu.edu Anne Merkle MSL Grand Valley
Librarians on the Move: Embedded Librarians · Librarians on the Move: Embedded Librarians Linda Masselink Grand Valley State University, [email protected] Anne Merkle MSL Grand Valley Documents
Kentwood Public Schools - Michigan · Exit 79 Exit 81 Exit 43 Exit 44 Exit 80 Exit 78 Exit 15 Exit 77/8 Exit 75 Exit 11 Cascade Township Caledonia Township Byron Township Gaines Township
Kentwood Public Schools - Michigan · Exit 79 Exit 81 Exit 43 Exit 44 Exit 80 Exit 78 Exit 15 Exit 77/8 Exit 75 Exit 11 Cascade Township Caledonia Township Byron Township Gaines Township Documents
Evaluating Nurse Turnover: Comparing Attitude Surveys · PDF fileEvaluating Nurse Turnover: Comparing Attitude Surveys and Exit Interviews. ..~ "1::. "..~~1 High turnover rates among
Evaluating Nurse Turnover: Comparing Attitude Surveys · PDF fileEvaluating Nurse Turnover: Comparing Attitude Surveys and Exit Interviews. ..~ "1::. "..~~1 High turnover rates among Documents
1 Salvador Flor & Chia Her EOP Counselors San Diego State University Educational Opportunity Program EOP The Great Exchange: Exit Interviews/Surveys EOP
1 Salvador Flor & Chia Her EOP Counselors San Diego State University Educational Opportunity Program EOP The Great Exchange: Exit Interviews/Surveys EOP Documents
detroit City School District - Michigan · Exit 16 Exit 225 Exit 59 Exit 15 Exit 224B Exit 58 Exit 224 Exit 14 Exit 223 Exit 57 Exit 222B Exit 222A Exit 13 Exit 56 Exit 222 Exit 222
detroit City School District - Michigan · Exit 16 Exit 225 Exit 59 Exit 15 Exit 224B Exit 58 Exit 224 Exit 14 Exit 223 Exit 57 Exit 222B Exit 222A Exit 13 Exit 56 Exit 222 Exit 222 Documents
Online Senior Exit Surveys
Online Senior Exit Surveys Documents
Messenger Summer 2016 Spring 2016 Senior Exit Surveys · I just finished reviewing the Spring 2016 Senior Exit Surveys. We had 53 Man- We had 53 Man- agement majors and 14 MIS majors
Messenger Summer 2016 Spring 2016 Senior Exit Surveys · I just finished reviewing the Spring 2016 Senior Exit Surveys. We had 53 Man- We had 53 Man- agement majors and 14 MIS majors Documents
Progressive librarians
Progressive librarians Documents
IEEE COMMUNICATIONS SURVEYS & TUTORIALS ...IEEE COMMUNICATIONS SURVEYS & TUTORIALS, ACCEPTED FOR PUBLICATION 1 EXIT Charts for System Design and Analysis Mohammed El-Hajjar and Lajos
IEEE COMMUNICATIONS SURVEYS & TUTORIALS ...IEEE COMMUNICATIONS SURVEYS & TUTORIALS, ACCEPTED FOR PUBLICATION 1 EXIT Charts for System Design and Analysis Mohammed El-Hajjar and Lajos Documents
Classroom Management for Librarians · Classroom Management for Librarians. Objectives
Classroom Management for Librarians · Classroom Management for Librarians. Objectives Documents
Librarians & Wikipedia
Librarians & Wikipedia Education
The California Home Visiting Program External Evaluation · WestEd Ext. Eval. Exit Surveys Comprehensive Findings 2 ... The Exit Survey contained questions similar to those in the
The California Home Visiting Program External Evaluation · WestEd Ext. Eval. Exit Surveys Comprehensive Findings 2 ... The Exit Survey contained questions similar to those in the Documents
MACOMB COUNTY SCHOOL DISTRICTSrichmond.ss7.sharpschool.com/UserFiles/Servers/Server...Exit 236 Exit 235 Exit 69 Exit S234 ExitE 65 Exit 23 Exit 231 Exit 230 Exit 63 Exit 229/28 Exit
MACOMB COUNTY SCHOOL DISTRICTSrichmond.ss7.sharpschool.com/UserFiles/Servers/Server...Exit 236 Exit 235 Exit 69 Exit S234 ExitE 65 Exit 23 Exit 231 Exit 230 Exit 63 Exit 229/28 Exit Documents
Reel Librarians: Images and Stereotypes of Librarians and
Reel Librarians: Images and Stereotypes of Librarians and Documents