Upload
others
View
5
Download
0
Embed Size (px)
Citation preview
Using Project Outcome to
Measure & Build a Better
Summer Library Program
April 27, 2017
What we will cover today
• Project Outcome & Summer Learning
oAdministering Project Outcome Surveys
oUsing Project Outcome Data
• From the Field
oPikes Peak Library District
oGeorgia Public Library Service
• Questions & Discussion
Today’s Speakers
Crystal SchimpfProject Outcome
Joanna Nelson RendónPikes Peak Library District
Colorado Springs, Colorado
Elaine BlackGeorgia Public Library Service
Atlanta, Georgia
About Project Outcome
Free Project Outcome Training Resources
• Getting Started
• Surveys
• Data Collection
• Data Analysis
• Taking Action
• From the Field
Webinar Archives
How to Successfully Roll Out Project Outcome in Your Library
Surveys for 7 Service Areas
Dummy Data
2015-2016 Totals
▪ 104 Libraries
▪ 16,800+ total responses
96% strongly agree or agreed that they
read more oftenas a result of the summer reading program
Summer Reading Surveys
If yes – click “Raise Hand” icon
Poll:
Did your library administer
Project Outcome surveys
for Summer Reading in
2015 or 2016?
Changes to Survey Management Tool
New site launches:
May 1
Old Survey Portal
closes:
April 30
Joanna Nelson Rendón
Adult Services Manager – East Library
Pikes Peak Library District
• Serve a population of 616,000
• 14 locations and bookmobile
• 477 employees
Pike Peak Library District
Our goal: Summer Reading Refresh
• Summer Reading participation was stagnant
• Intrinsic motivation
• Can Project Outcome guide our refresh?
Chocolate Olympics at High Prairie Library.
Summer Reading Participation: 2016
Teens: 4,843 registered | 2,017 completed
Children: 18,885 registered | 8,605 completed
After hours
Clue at the
Library!
Getting to know Project Outcome
• District-wide committee to
talk about and utilize
Project Outcome.
• First test with one of our
Adult Education programs.
Timeline
April 2016 Committee meetings about
Project Outcome
May 2016 Administer survey for Adult
Education - GED
July 2016 Children’s and teen services print
and distribute survey
August 2016 Analyze results
Fall/Winter 2016 Start planning for 2017
Implementing the Survey: Training Staff
• Children’s Services, Teen Services, IT,
Marketing
• Across 14 locations – point people
Implementation: Online Surveys
• Survey available online and on paper
• July 2016 we had the survey available
• Participants were emailed a link to the survey
A fantastic game of Quidditch!
Implementation: Paper Surveys
• Paper surveys available for parents/children/teens
Tip: have the parent and children/teen surveys on
different colors of paper!
• Prizes!
Dragon Eggs program!
Collecting Survey Data
• Project Outcome form is easy
• Paper surveys
▪ Tip: mark the survey when done entering
• Get contact info prize drawing
Analyzing the Data
• So much data with 2906 responses!
Results from the
children and teen
surveys.
Lessons Learned
• Paper surveys
▪ Use different colors!
▪ When entering, check each one as completed
• Location specific questions
• Surveys
Administering Surveys:
Summer Reading
Four Key Outcomes
Knowledge
Confidence
Skill/Application
Awareness
Survey Questions: Caregivers
• My child maintained or increased their reading skills
• My child is a more confident reader
• My child reads more often
• My child uses the library more often
• What did your child like most about the program/service?
• What could the library do to help your child continue to
learn more?
Summer Reading Surveys
Caregivers Children/Teens Adults
Summer Reading Survey Questions Updated in 2016
Immediate Survey Guidelines
• Patron-Reported
Learning
• Immediate Impact
• End of Program
Administering Immediate Surveys
• Give paper surveys out at end of program
• Email/text link to online survey at end of program
• Give clear instructions, including Likert scale order
• Have a drop-box for completed paper surveys
• Have a volunteer on hand to help
Administering Summer Reading Surveys
• Track attendance based on actual participation
• Survey overall summer program participation,
not individual events
• Use the appropriate survey for the age group
Creating Summer Reading Surveys
• Survey Topic & Age Group
• Program Info: Name, Dates, & Locations
• Survey Customization
• Access Paper Surveys
• Get Links to Online Surveys
Create New Survey
Dummy Data
1
2
3
Summer Reading Surveys
Caregivers Children/Teens Adults
Administering the Surveys
• Each survey must be given in its entirety
• Survey questions cannot be edited
https://pixabay.com/en/pencil-pencils-eraser-1277094/
Integrating Additional Questions
• Limit 3 per survey
• Common multi-choice questions available in tool
• Add your own open-ended question
• May increase survey fatigue
• May remove anonymity of surveys
What questions do you have for Joanna?
What questions do you have about
Summer Reading survey administration?
Please share your questions in chat
Elaine Black
Director for Youth Services
Georgia Public Library Service
First Year Project Outcome Pilot
Implemented with 6 Georgia Public Libraries
• Why
• Set-up
• Library buy-in
• State expectations
Results from pilot--takeaways and redux
• Better, more consistent communication for
State Library
• Limited participation in surveys
• Uneven implementation
• Results helpful for LSTA year-end reports
State Level Reports: Georgia
State Level Reports: Georgia
Plans for 2017
• May Work Day
• Consistent messaging
• Regular check-ins
• Goals for survey participants
Using Project Outcome Data:
Summer Reading
Dummy Data
Using Survey Results
General Advocacy
Justify Funding Requests
Programming Decisions
Community-Based
Partnerships
What is your goal?
Programming Decisions: Tips
1. Review open-ended feedback for suggestions
2. Ask for programming staff input
3. Identify areas for improvement
Detail Dashboard
Raw Data: Open Ended Responses
What questions do you have for Elaine?
What questions do you have about using
Summer Reading outcome data?
Please share your questions in chat
Are you ready to use Project Outcome for
Summer Reading in 2017?
What else do you need?
Please share your questions in chat
Changes to Survey Management Tool
New site launches:
May 1
Old Survey Portal
closes:
April 30
Next Webinar
Project Outcome Update:
Website & Survey Management Improvements
Thursday, May 11, 2017
1-2 pm Central
Registration is open now!
Consultant Webinar
Project Outcome for Library Consultants ($)
Thursday, May 18, 2017
1-2 pm Central
Registration is open now!
Free Project Outcome Training Resources
• Getting Started
• Surveys
• Data Collection
• Data Analysis
• Taking Action
• From the Field
Community of Practice
www.projectoutcome.org
If you haven’t already…
• Sign up on the Project Outcome website
• Browse free training resources
• Continue the conversation on Community of Practice
• Create your Summer Reading Survey (after May 1)
www.projectoutcome.org
Thank you!