Embed Size (px)
Citation preview
Feel the Love from Your Students: Brightspace Tools for Increasing End-of-Course Student Ratings
Thomas J. [email protected]
Who’s Here Today?
Using the chat feature, please let us know who is participating from your institution today.
A. AdministratorB. Academic AdvisingC. Admissions/Enrollment ManagementD. Student AffairsE. FacultyF. Other (please specify)
Image © 2011 University of Michigan Medical School. Shared under CC BY license from Flickr.com.
Oh, was that important?
Um, I was on Instagram.
I am so great. Remember this!
Learning Outcomes
After attending, you will be able to
• identify four common e-survey strategies that don’t increase response rates.
• implement four specific strategies to increase survey response rates.
• identify which 3 questions give the most actionable response information.
• increase electronic survey adoption across campus.
Image © 2008 James Beilin. Shared under CC BY-ND license from Flickr.com.
How Is It Now?
• How many courses, programs, departments, or colleges use eSurveys at your campus?
• What are the biggest obstacles to using eSurveys?
• What do you do with the results of eSurveys?
Image © 2016 SmartEvals. Used with permission.
Share your responses for any of the questions.
Four Things That Don’t Work
Image © 2012 US Mission Geneva. Shared under CC BY-ND license from Flickr.com.
1. Prize Drawings
Image © 2010 Marlon E. Shared under CC BY-SA license from Flickr com.
1. Prize Drawings
Image © 2010 Marlon E. Shared under CC BY-SA license from Flickr com.
2. Repeated Reminders
Image © 2010 S. Innen. Shared under CC BY license from Flickr com.
2. Repeated Reminders
Image © 2010 S. Innen. Shared under CC BY license from Flickr com.
3. Longer Time Windows
Image © 2011 Dafne Cholet. Shared under CC BY license from Flickr com.
3. Longer Time Windows
Image © 2011 Dafne Cholet. Shared under CC BY license from Flickr com.
4. Direct Monetary Rewards
Image © 2010 Carissa Rogers. Shared under CC BY license from Flickr com.
4. Direct Monetary Rewards
Image © 2010 Carissa Rogers. Shared under CC BY license from Flickr com.
What other things don’t seem to work?
Four Things That Do Work
Image © 2006 Robert Terrell. Shared under CC BY-NC-ND license from Flickr com.
1. The SCARF Loop
Image © 2015 Thomas J. Tobin, B. Jean Mandernach, & Ann H. Taylor. Used with permission.
1. The SCARF Loop
Image © 2016 Northeastern Illinois University. Used with permission.
2. Academic Reward
Image © 2012 Patrick McGarvey. Shared under CC BY-ND license from Flickr com.
2. Academic Reward
Image © 2012 Patrick McGarvey. Shared under CC BY-ND license from Flickr com.
3. Everyone Does It
Image © 2011 Kris Krüg. Shared under CC BY-NC-ND license from Flickr com.
3. Everyone Does It
Image © 2011 Kris Krüg. Shared under CC BY-NC-ND license from Flickr com.
4. Making Time for It
Image © 2016 Catalyst Open Source. Shared under CC BY-SA license from Flickr com.
4. Making Time for It
Image © 2016 Catalyst Open Source. Shared under CC BY-SA license from Flickr com.
Success Strategies
Image © 2013 Frank Lindecke. Shared under CC BY-ND license from Flickr com.
• Focus on formative feedback to drive response rates on summative instruments.
• Show actions related to e-survey responses.
• Tie response rates to course-related rewards.
Formative Questions
Image © 2013 Frank Lindecke. Shared under CC BY-ND license from Flickr com.
W2: How is the course going so far?
How much of the reading that has been assigned so far have you completed?
• 100%• 90%• 75%
W5: How do you rate the instructor's performance so far? [1-5]
How do you rate your own performance so far? [1-5]
What elements of the course could we cut back on or omit?
W8: In total, how many hours per week do you spend on this class?
• 1-2• 2-4• 4-6
Is anything getting in your way?
W12: What are the most important things you have learned so far in this class?
What don’t you think you understand well enough yet?
What should we keep doing (or do differently) between now and the end of the semester?
• 50%• 25%• less than 25%
• 6-8• 8-10• more than 10
Take-Aways
What will you take away from our time today?
Benton, S. L. and Cashin, W. E. (2011). Student Ratings of teaching: a summary of research and literature. IDEA Paper series. 1(50). Manhattan, KS: Kansas State University, Center for Faculty Evaluation and Development http://www.theideacenter.org/sites/default/files/idea-paper_50.pdf.
Berk, R. A. (2013a). Top 10 Flashpoints in Student Ratings and the Evaluation of Teaching. Sterling, VA: Stylus Press.
Hativa, N. (2013). Student Ratings of Instruction: A Practical Approach to Designing, Operating, and Reporting. Lexington, KY: Oron Publications.
John A. Dutton e-Education Institute, College of Earth and Mineral Sciences, the Pennsylvania State University. (2013). Student Rating of Teaching Effectiveness [SRTE] item choices. Penn State University. https://www.srte.psu.edu/SRTE_Items/.
Johnson, T. (2002). Online student ratings: Will students respond? Paper presented at the annual meeting of the American Educational Research Association, New Orleans. http://www.armstrong.edu/images/institutional_research/onlinesurvey_will_students_respond.pdf.
Nulty, D. D. (2008). The adequacy of response rates to online and paper surveys: What can be done? Assessment & Evaluation in Higher Education 33(3): 301-314. https://www.uaf.edu/files/uafgov/fsadmin-nulty5-19-10.pdf.
The Pennsylvania State University (2004). Guidelines for use and administration of the Student Rating of Teaching Effectiveness (SRTE) forms. http://www.psu.edu/dept/vprov/pdfs/srte_guidelines.pdf.
Perkins, R. A. (2011). Using research-based practices to increase response rates of web-based surveys. EDUCAUSE Review. http://er.educause.edu/articles/2011/6/using-researchbased-practices-to-increase-response-rates-of-webbased-surveys.
Further Resources
CopyrightAcademic Integrity
Accessibility & UDLEvaluating Online Teaching
thomasjtobin.com
