Developmental Research MethodsTopic 14: Questionnaires, and surveys

04/10/2023CEDP 321/322 Ryan Sain, Ph.D. 1

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

2

Open ended questionsDoes not impose bias on subjectGives you data you may not have

expectedDifficulty in analysis

◦Finding patterns◦Expert coding

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

3

Fixed alternativeDichotomous

◦Yes, noMultiple alternatives

◦Yes….., Yes…. Only if …, NoFunneling

◦Start broad – get narrowMake sure you do not have

overlap in options

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

4

Likert-type scalingMinimum of 5 options7 – 9 preferredAdd the scores for an index of

somethingSelf-efficacy

◦22 Likert-type questions, 1-5 then summed

◦Ranges indicate levels of self efficacy

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

5

Semantic DifferentialsGood __ __ __ __ __ __ __ BadSoft __ __ __ __ __ __ __ HardSexy __ __ __ __ __ __ __ repulsive

Measured differentialsGood BadSoft HardSexy

Repulsive

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

6

ConsiderationsVagueness is your enemyQuestion order

◦Rate the worst things about your relationship

◦Rate the best things about your relationship

Leading/loaded questions◦Have you stopped driving drunk?

One topic at a time◦President Obama is doing a good job

and handled the Korea issue well.

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

7

Reactive questionsSensitive questions – non

anonymous◦E.g., sexual or illicit topics

Random response ◦Flip a coin and tell them to answer

YES or tell the truth.◦Must not be open ended

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

8

Survey administrationFace to face

◦Get clues about motivation◦Judge comprehension◦Interviewer bias◦Not anonymous

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

9

Survey administrationTelephone interviews

◦Benefits of face to face ◦More efficient◦No longer a random sample◦Must be done quickly (about 15

minutes)◦Still an issue with anonymity

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

10

Survey AdministrationMailed surveys

◦Response rate◦50% is good, below this is normal◦Look professional◦Make it easy to complete

04/10/2023 CEDP 321/322 Ryan Sain, Ph.D.

11

Survey AdministrationComputers

◦Faster◦More enjoyable◦More honest!◦Easier to control proper responding◦Inexpensive◦biased