55
Colleen Eggett h b Utah State Library [email protected]

Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

  • Upload
    others

  • View
    11

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Colleen Eggetth bUtah State Library

[email protected]

Page 2: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Today’s GoalsBy the end of today’s session you will be able to…

Understand why and how to conduct a survey Discover the steps to running a survey Describe the elements of an effective survey Identify 5 main question types

Page 3: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

How surveys impactimpact ourour lives

Page 4: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

• Make informed or “good” decisionsTh   lt   i ht  i  • The results might surprise you

• Fast & easy to administery• Meeting peoples’ needs = succe$$

Page 5: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Surveys are great for:

Short answersIdentifying issues

l i  Evaluating programsInput from many peoplep y p pDecisions based on numbers( tit ti  d t )(quantitative data)

Page 6: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Surveys are poorer for:

Knowing whyg yComplex issues

 f  f   lInput from few peopleKnowing “how good” not g g“how much” (qualitative)

Page 7: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

A Steps to running a surveyA. Steps to running a surveyB. Elements of an effective 

surveyC Five 5 main question typesC. Five 5 main question types

Page 8: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

A. Steps in running a survey

1 Clearly define1. Clearly define the goal of the survey

Page 9: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Why are we conducting this survey? What do we want to know? How will we use this info? Keep your goal focused and specific. 

EX: “The goal of this survey is to understand the needs f    t  i  th   t t   6 ”  of our customers in the next two years‐ 2014‐16.”  

Page 10: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

SMART goals

Page 11: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a
Page 12: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

2. Decide whom to survey

Page 13: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

3 Prepare questions that match3. Prepare questions that match the goalsg

Children will read more books as a result of story hourresult of story hour

Page 14: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

End the survey with a positive tone

Page 15: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

4. Decide: online vs. paper, or both

Page 16: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Free online survey tools

www.questionpro.com

docs.google.com/forms

www.surveymonkey.com

www.skydrive.com

Page 17: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Advantage: computerized surveysAdvantage: computerized surveys summarize for you

Page 18: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

5. Pre‐test your survey Ask 5‐10 people to take the survey

W   hi  diffi l     f i Was anything difficult or confusing?

Look at how people responded Look at how people responded—Did the right questions get asked? Did people answer consistently with what was asked? p p y(If you expected an apple did you get one?)

Page 19: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

M k i t b d thMake improvements based on the pre‐testpre test

Page 20: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

6. Get the survey out

ListservsYour website

b kFacebookUtility billUt ty bPaper copy 

Page 21: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Publicize the survey

B      Be sure your target audience knows about the surveyy

Take our survey!

Page 22: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a
Page 23: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Effective library surveys

have clear questions & answersq

Page 24: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Clear, straightforward language that is easy f    t   d t dfor everyone to understand

d lk ( l b )No trade talk (EX: library acronyms)

No highfalutin words 

Page 25: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Divide questions into 3 groups:

1. Must know 2. Useful to know2. Useful to know3. Nice to know

Focus on #1 and get rid of the rest

Page 26: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Clearly outline what info you need 

Page 27: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Logical flow to the questions

Page 28: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Use demographics

Age in roughly equal ranges Gender Library use Other things that may impact g ythe results

Page 29: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Add a comments section People can write in things not asked elsewhere Adds stories & interest to the results You’ll get lots of positive feedback

Page 30: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

d d &Consider your target audience & how to reach themhow to reach them 

Page 31: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid measurement errors

Poorly worded questions Faulty assumptions Imperfect scales

Page 32: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid biased questions

EX: Do you think it is unfair for training to only be offered when training to only be offered when mothers are at home during the day?

Better: When do you think training h ld b   ff d    h  lib ?should be offered at the library?

Page 33: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

One word may bias a question

Page 34: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid modifying adjectives such as

Page 35: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid questions with negativesEX: Are you against having EX: Are you against having computer training for seniors?

Better: Would you like computer training for seniors?training for seniors?

Page 36: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid double questionsEX: Do you think the library should offer computer training and offer follow‐up training as requested? 

Page 37: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Avoid Difficult questions Hypothetical questions: what if…

Page 38: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Effective Answers:Have mutually exclusive options – A or B, not both (unless they can check all that apply)

If using multiple choice, list all possible responses

Gi  “ h ”  i   d l   h   i  i   h i  Give “other” option and let them write in their answer, if appropriate 

Page 39: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Which answer set works best for,  “Do you like children?”Do you like children?

Yes — No

OROR

Y M b   N   N/AYes— Maybe — No — N/A

Page 40: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Which answer set is better?

Poor –Average –Above Average –Excellent –Superior

Poor –Below Avg. –Average —Above Avg. –Excellent

Page 41: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Distinct answers

Page 42: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

d d h fStandardize the arrangement of responsesresponses

EX: high to low in allEX: high to low in all

Page 43: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Case study: 1936 Literary Digest pollg p

Largest ll   poll ever: 

10 million peoplep p

Page 44: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

5 main types of survey questions

Multiple choicepOrdinalI t lIntervalRatioOpen ended

Page 45: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Multiple choice Choose from options

Page 46: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Use an “Other” option

Page 47: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Ordinal

Please rank the following from 1‐5 in order of importance  1 for the least important and 5 for the importance, 1 for the least important and 5 for the most important.

___ Hours openComputers available___ p

___ Books/ materials I want___ Programsg___ Children’s homework help

Page 48: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

IntervalMost commonly used—scales of agreement, satisfaction

Page 49: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Ratio EX: Income, hours, age

Page 50: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Open ended

Page 51: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

U bi ti f tiUse a combination of question stylesstyles Mostly checklists, with one or two open‐ended 

ti  Thi         t h d f t   d questions. This way you can get hard facts and supporting beliefs and feelings.

Page 52: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Improving your response rates The shorter your survey the better the response rate Make the questions relevant to your audience Third party endorsement

Page 53: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Incentives

Page 54: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

Use the results to

EvaluateImproveAdvocateAdvocate

Save the galaxy

Page 55: Today’s Goals - WebJunction · Today’s Goals By the end of today’s session you will be able to… Understand why and how to conduct a survey Discover the steps to running a

We can do this!

Colleen Eggett, Training Coordinator Colleen Eggett, Training Coordinator Utah State Library 

[email protected]

801‐715‐6776801 715 6776