20
Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions Bonnie Swoger Kim Hoffman SUNYLA 2012

Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Embed Size (px)

DESCRIPTION

By Bonnie Swoger and Kim Hoffman At SUNY Geneseo, we wanted to know what students learned during reference transactions, beyond counts of reference questions or user satisfaction surveys. Building on library instruction assessment techniques, students answered a survey after each reference transaction that simply asked “What did you learn today from your meeting with the librarian?”

Citation preview

Page 1: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Bonnie SwogerKim HoffmanSUNYLA 2012

Page 2: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 3: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

What does this tell us? Not much

Page 4: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 5: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 6: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

• Student enrollment• Student learning

outcomes• Student

engagement• Student success• Graduation Rate• Retention/

Efficiencies (getting students through faster)

• Faculty teaching• External funding• Faculty research

Page 7: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

1. Student enrollment2. Student learning

outcomes3. Student

engagement4. Student success5. Graduation Rate6. Retention/

Efficiencies (getting students through faster)

7. Faculty teaching8. External funding9. Faculty research

In which of these areas does reference services have the most impact?

Page 8: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

A small step…

Page 9: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 10: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Response rate

Walk-in Scheduled Appointments

Total0

50

100

150

200

250

300

Survey ResponsesTotal questions

20.08%

20.36%

19.44%

Page 11: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 12: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

HistoryAnthropology

EnglishPolitical Science

PsychologySociology

CommunicationEducation

FrenchMusic

BiologyGeographyHumanities

ManagementPhysics

SpanishSpecial Education

0 2 4 6 8 10 12 14

Responses by Course

Page 13: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

HistoryEnglish

AnthropologyPolitical Science

BusinessInternational Relations

BiologyCommunication

PsychologySpanish

Special EducationBiochemistry

ChemistryEconomicsEducation

FrenchGraduate Students

LiteracyMath

PhysicsUndecided

0 1 2 3 4 5 6 7 8 9

Responses by Major

Page 14: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

• Evaluation of sources (General)– Types of scholarly articles (to include

different types of research studies – qualitative/quantitative)

– Peer review/Scholarly v. Popular– Evaluating websites– Reading level

• Finding Specific Material Type (General)– Books– Government Docs– Journal Articles– News Articles– Company/Business Info– Primary sources (historical)– Data– Maps

• Presenting information (General)

• Mechanics of Searching (General)– Boolean and truncation– Synonyms (brainstorming)– Subject heading vs. keywords– Narrower and broader search– Limiting results (i.e. date-sensitive, in a

foreign language)– Choosing appropriate databases– Choosing/narrowing a research topic– Citation tracking– Teaching a specific database [Name

database in notes]

• Citing Information (General)– Citation Style– Plagiarism/Paraphrasing

• Other (General)– Finding (physically) a particular item

Page 15: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Finding Specific Material Types (General)News Articles

Synonyms (brainstorming)Citation Style

Collaborative Tools (Google Docs)Evaluation of Sources (General)

BooksPrimary sources (historical)

Citation trackingNarrower and broader search

Boolean and truncationMechanics of Searching (General)

Teaching a specific databaseOther (General)Journal Articles

Choosing appropriate databases

0.00% 10.00% 20.00% 30.00% 40.00% 50.00% 60.00%

What did you learn?

Page 16: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Extremely helpful. Immensely helpful. Very helpful. Huge help.I now will find my information much more quickly.How to research news articles from other countries.

Page 17: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Special thanks to the librarian for her excellent advise [sic] & patience assisting me in my search. Extremely helpful. Thank you.

I worked with a very patient librarian who appears to be very professional and well-experienced at what she does

The librarian showed me plenty of useful resources online for my sociology project. Very helpful and informative.

Page 18: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Aligning the data?

Page 19: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions
Page 20: Going Beyond Anecdotes: Assessing Student Learning During Reference Transactions

Closing the loop

Gather evidence

Interpret evidence

Implement change

Establish learning

outcomes