PowerPoint PresentationThird Grade Evaluation Survey School Year
2016-2017
October 11, 2017
N=63 schools
Step 2 Contact Superintendents
Joel Pedersen, Superintendent May 6, 2016 Cardinal School District
4045 Ashland Rd. Eldon, IA 52554
Dear Superintendent Pedersen:
Students in your school district have participated for several
years in the Pick a better snack™ program, a nutrition education
program funded by the USDA Supplemental Nutrition Assistance
Program (SNAP) and coordinated by the Iowa Department of Public
Health (IDPH).
IDPH will be conducting a statewide evaluation of the Pick a better
snack™ program with third grade children during Fall 2016 and
Spring 2017. The survey will collect information about the
knowledge, attitudes, and behavior regarding nutrition and physical
activity that students have learned by participating in the Pick a
better snacktm program.
Third grade students at Cardinal Elementary School have been
randomly selected for inclusion in the survey. The information
collected will only be reported for the entire school or all Iowa
students included in the survey, not individual children. The
survey should take no more than 20 minutes.
Parents will be notified of the survey. There will be a parent
assent form where parents can opt to withdraw their child from
survey participation by returning the form to the classroom
teacher. In addition, each child will assent to the survey
participation.
Individual buildings and districts will not be identified by name
in any reports. Results will compare student responses from the
beginning to the end of the school year.
For the time and effort required to administer the survey, each
participating school will receive $200 at the conclusion of the
project. The data obtained from the survey will provide valuable
information to help sustain the program thereby improving and
protecting the health of all Iowa children through better
nutrition. We appreciate your involvement in this process.
The program evaluation will involve a Service Agreement with IDPH.
We will follow-up with you in the near future about that process.
Please contact Catherine Lillehoj (515 242 5913 or
[email protected]) at IDPH with any questions you
might have.
Sincerely,
Jill Lange, MPH, RD, LD Bureau Chief, Nutrition & Health
Promotion Cc: Principals
Gerd W. Clabaugh, MPA Director
Terry E. Branstad Kim Reynolds Governor Lt. Governor
Spring 2016
• Pilot survey & instructions with 2 small groups of students •
Readability of survey & instructions • Understanding of
emojis
Step 4 Communicate with local project coordinators about
delivery of classroom supplies & teacher communications
Classroom Teachers Communication Package from Nutrition
Educator
Coversheets Assessment implementation protocol Class roster form
Number stickers to attach to the pre-assessments Parent consent
forms in envelopes Pencils Pre-paid UPS envelope
Protocol for Implementing the Assessments
Choose a day in September for your class to take the
pre-assessment. The assessment process takes about 15-20
minutes.
Send the parent consent forms home at least a week prior to the
date of the pre- assessment. Only parents refusing student
participation in the survey need to return surveys prior to the
pre-survey date.
Please complete the numbered log sheet with the names of the
children in your class the day of the survey. It is important that
each child has a unique ID and that the same ID number is used at
the post-assessment. The unique ID numbers and the numbered surveys
match. Make a note next to the child’s name if their parent or
guardian did not give permission for them to participate in the
assessment.
Lucas State Office Building, 321 E. 12th Street, Des Moines, IA
50319-0075 515-281-7689 www.idph.iowa.gov DEAF RELAY (Hearing or
Speech Impaired) 711 or 1-800-735-2942
Terry E. Branstad Kim Reynolds Governor Lt. Governor
Gerd W. Clabaugh, MPA Director
-----, 2016 Dear Parent or Guardian, Your child’s elementary school
is involved in the project called Pick a better snackTM. The
purpose of the project is to encourage fruit and vegetable choices
for snacks. We would like to invite your child to participate in
the evaluation part of the project. The evaluation will include a
survey for your child about fruits and vegetables. Participation is
voluntary and all information will be handled in a confidential
manner. Completion of the survey will take approximately 15 to 20
minutes and will be conducted during the Fall, 2016 and Spring,
2017. If you do not want your child to participate, he or she will
engage in other school-related activities as directed by their
teacher. Information collected from students will remain strictly
confidential. Students will not be asked to put their names on any
survey materials. Assessments will be identified only by an ID code
and will be seen only by the teacher and Iowa Department of Public
Health staff. Participation in this survey is completely voluntary.
If you do not wish your child to participate in this survey, please
inform us of your decision using the attached form. In addition, if
your child does not wish to participate, he/she may withdraw from
the survey process at any time. Any questions concerning your
child’s participation in this assessment should be addressed to
Catherine Lillehoj, at 515-242-5913. The evaluation assessment has
been approved by the --- Institutional Review Board. We would like
to have good participation to provide the best information about
nutrition. We would greatly appreciate your child’s participation.
If you AGREE to allow your child to participate in the student
assessment, you do not need to return this form. If you DO NOT want
your child to participate in the student survey, please write your
child’s name and school, check the appropriate box below, and
return this form to the teacher.
Gerd W. Clabaugh, MPA
-----, 2016
Dear Parent or Guardian,
Your child’s elementary school is involved in the project called
Pick a better snackTM. The purpose of the project is to encourage
fruit and vegetable choices for snacks.
We would like to invite your child to participate in the evaluation
part of the project. The evaluation will include a survey for your
child about fruits and vegetables. Participation is voluntary and
all information will be handled in a confidential manner.
Completion of the survey will take approximately 15 to 20 minutes
and will be conducted during the Fall, 2016 and Spring, 2017. If
you do not want your child to participate, he or she will engage in
other school-related activities as directed by their teacher.
Information collected from students will remain strictly
confidential. Students will not be asked to put their names on any
survey materials. Assessments will be identified only by an ID code
and will be seen only by the teacher and Iowa Department of Public
Health staff.
Participation in this survey is completely voluntary. If you do not
wish your child to participate in this survey, please inform us of
your decision using the attached form. In addition, if your child
does not wish to participate, he/she may withdraw from the survey
process at any time. Any questions concerning your child’s
participation in this assessment should be addressed to Catherine
Lillehoj, at 515-242-5913.
The evaluation assessment has been approved by the ---
Institutional Review Board. We would like to have good
participation to provide the best information about nutrition. We
would greatly appreciate your child’s participation.
If you AGREE to allow your child to participate in the student
assessment, you do not need to return this form.
If you DO NOT want your child to participate in the student survey,
please write your child’s name and school, check the appropriate
box below, and return this form to the teacher.
Student’s Name Student’s School
I AGREE to have my child participate in the Pick a Better Snack
survey (please keep this form for your records).
I DO NOT want my child to participate in the Pick a Better Snack
survey (please return this form to the school nurse).
Signature of Parent or Guardian Date
Sincerely,
Iowa Dept. of Public Health
Lucas State Office Building, 321 E. 12th Street, Des Moines, IA
50319-0075 515-281-7689 www.idph.iowa.gov
DEAF RELAY (Hearing or Speech Impaired) 711 or 1-800-735-2942
UNIQUE ID Name 7301 7302 7303 7304 7305 7306 7307 7308 7309 7310
7311 7312 7313 7314
Assessment Class Roster
Please list each child in your class alphabetically in the table
below. If a child returns a parental consent that indicates they
are NOT to take the assessments, please write their name in the
roster with a note that they are not to take the pre or the post-
assessment.
Keep the list of pre-survey numbers and the corresponding students’
names until the post-assessment is given to your students in May.
As a backup, scan or photograph the list and save the file.
On the day of the assessment give each child a form, making sure
the number on the form matches their number and name on the
roster.
Instruct students to not put their names on the survey.
Inform the students that their answers will remain anonymous
Tell the students there are no right or wrong answers; this is not
a test. It is ok to answer students’ questions to ensure they
understand the meaning of a question or statement.
Please read the questions to your students. When the class has
completed the assessment, please collect all surveys, place the
coversheet on the top of the batch of surveys and put them into the
provided addressed UPS envelope, seal itand mail back to The
University of Iowa.
Spring 2017 3rd Grade PABS Survey Administration
February, 2017 Change in protocol to allow PABS educator to hand
out survey at end of last class May 2017
Key points for survey administration:
• Teacher administer the survey • PABS educator can deliver and
pick up completed surveys to send in the provided UPS envelope or
teacher can
send back
Each contractor should have enough surveys and labels for spring
administration and have UPS labeled envelopes
For classroom rosters:
• Classroom teachers should have saved roster from September 2016
survey • If classroom teachers do not have the saved roster,
contact C. Lillehoj • For survey, each child received labeled,
numbered survey corresponding to their ID # on the September 2016
roster • For new students, assign a new ID #. When surveys are
returned, let us know the number of new students and the
ID # each was assigned. In protocol for teachers, include an
example of this. • For students who did not participate in May 2017
survey (e.g., sick, left school), include a note indicating this
with the
returned survey packet.
Do NOT need to have parent consent form administered. Consent in
September 2016 covered May 2017 survey.
If possible, PABS educators have face-to-face contact with
classroom teachers to explain May 2017 protocol.
March 2016 April 2016 June 2017September 2016
Email each educator, cc contractor to verify classroom
teacher
Remind educator, contractor about supplies (e.g., surveys, ID
labels). Remind about ID # system
Email principals about survey & incentive
Email teachers about training & remind survey protocol
including parent consent
Survey returned to U IA
Example of Email Communication Timeline
Step 5 Teacher Understanding Survey
Administration
Classroom Teacher Understanding of the Evaluation Protocol
17 respondents 1 did not understand the survey administration
protocol 1 was not able to match student ID #s pre to
post-survey
2 were new teachers in May
I think there were too many directions. It was much simpler than
what it seemed Incredible Program
No, it was easy! Make it electronic instead of paper! It would be
easier for you as well
Step 6 Lesson Implementation Fidelity
Dosage Report by Program/School Pick a better snack Lesson
Activities
Project School District/ School
XYZ County
MNO County
School 1 8 8 8 8 8 8 8 8 8
School 2 8 8 8 8 8 7 7 8 8
School 3 8 8 8 8 8 8 8 8 8
Step 7 Survey Results
September 2016 N=1,263
May 2017 N=1,158
555 (49%) boys; 590 (51%) girls
13 not provide gender
Logo Familiarity Increased Significantly for All 3
Pick a better snackTM Successful Increasing Awareness of Logos Pre-
to Post-program
Normative Behavior
• Most of the time: Like to eat fruit (Pre: 63.6% Post: 61%); Try
new fruit (Pre: 67% Post: 65.3%)
• Most of the time: Like to eat vegetables (Pre: 28.1 Post: 19.1%);
Try new vegetables (Pre: 35.9% Post: 33%)
• Surprisingly, significant decrease from pre- to
post-assessment
• Overall, liked to consume fruit more than vegetables regardless
of the intervention
Most of the time: Like to eat yogurt (Pre: 68% Post: 64.7%)
Most of the time: I like to drink flavored milk like chocolate or
strawberry (Pre: 79.3% Post: 74.4%)
Preferred flavored milk significantly less on post-
assessment
I like to have fun by doing active things like biking, playing
sports, and jumping rope (Most of time: Pre: 79.7% Post:
82.5%)
Overall, Surprising Results
• Decrease in level of agreement • I like to eat vegetables for
snacks • I like to eat yogurt
• Mixed changes in F&V & dairy normative behaviors
• Increase physical activity normative behaviors
Self-efficacy
• Few changes self-efficacy pre- to post-assessment • Significant
increase How sure are you that you can play outside
instead of watching TV after school (Very Sure Pre: 69% Post:
72.2%)
• Marginally significant increase How sure are you that you can eat
vegetables for snacks at home (Very Sure Pre: 44.9% Post:
45%)
• Few significant changes for Self-efficacy Most significant
change: Confidence in ability to be physically active
• Similar to normative behavior where significant change observed
preference being physically active & participate in activities
(e.g., biking, playing sports, jumping rope)
• Significant increase pre- to post-assessment Intervention
resulted significant knowledge gains of healthy milk (fat free/1%)
(Pre: 63.3% Post: 70%)
• More students knew fat free/1% milk healthier after
intervention
Fruit & Vegetable Preferences
Cranberry, Mango, Strawberry, Pepper, Jicama, Broccoli,
Cauliflower, Asparagus
• Two (Cranberry (Pre: .66 Post: .73) Pepper (Pre: .50 Post .59))
significant increase
• Asparagus approach significance (Pre: .39 Post: .43)
• Percent responding I do not know what this is decreased for every
F&V included in Pick a better snackTM (Significant increase
knowledge 7/10)
• Most Well-known: Strawberry, Orange, Broccoli
Pick a better snackTM highly successful building familiarity with
& knowledge of different F&V
Possible some who learned what a specific F&V was through Pick
a better snackTM may also have learned to like that specific
F&V
0.23
0.82
0.5
0.22
0.81
0.52
0
0.2
0.4
0.6
0.8
1
Pre Post
Fruit & Vegetable Asking Behaviors
• Most common asking behavior both time points Ask family member to
buy F&V (Pre: 81.9% Post: 81.8%)
• Least common asking behavior both time points Ask a family member
to have F&V at home for breakfast
3 of 6 asking behaviors significant increase pre- &
post-assessment Ask to have fruit or vegetables at home for
breakfast (Pre: 46.1% Post: 49%) Ask to have fruit or vegetables so
you can reach them in your house? (Pre: 61.7% Post: 67.7%) Ask for
fruit or vegetables at dinner (Pre: 62.6% Post: 64.6%)
Fruit & Vegetable Perceptions
• Minor fluctuations in levels of agreement with each
statement
• Not surprisingly, responded more positively to questions about
fruits compared to vegetables
• Overwhelmingly, felt parents proud of them for eating F&V
& that friends liked to eat fruit but did not like to eat
vegetables as much
Summary • Pick a better snackTM assessment showed important growth
in
some areas: knowledge, self-efficacy, & preferences for
physical activity.
• In other areas, (e.g., F&V & dairy, self-efficacy to ask
for F&V & dairy, & normative behaviors regarding
F&V) few significant increases & some decreases from pre-to
post-assessment.
• Importantly, most of items in assessment started with very high
level of preference, familiarity, or self-efficacy before
program.
• Possible that some positive attitudes & behaviors at pre-
assessment could be result of previous exposure to program &
social marketing campaign.
Limitations
Student roster
Had program 3-4 years (not going see big changes with 3rd
graders)
No control group (Wave II)
“Every single young person has to be prepared for a very
competitive world economy. They have to be at the top of their
game, and for that, they need to be healthy. They need proper
nutrition and access to healthy meals at school and at home in
order to reach their full potential.” - Tom Vilsack, (Former)
Secretary, U.S. Department of Agriculture
Slide Number 1
Step 2Contact Superintendents
Classroom Teacher Understanding of the Evaluation Protocol
Step 6Lesson Implementation Fidelity
Slide Number 18
Step 7Survey Results
September 2016N=1,263 62 schools623 (50%) boys; 623 (50%) girls17
not provide gender
Logo Recognition
Summary
Limitations
Student rosterHad program 3-4 years (not going see big changes with
3rd graders)No control group (Wave II)
Slide Number 57
