WHEN RESPONSE RATES MATTERUsing Triton Data Collection System for Course Evaluations

Introduction

We live in a data-driven, information gathering society. When a consumer buys a product, they are sure to be inundated e-mails, calls or mail asking them to respond to a survey about their buying experience and the product. Our schools and universities have adopted this same philosophy through course evaluations to gauge student perceptions of the class, the instructor and overall experience.

Researchers generally consider student evaluations to be a more reliable and valid way to measure the effectiveness of a course instead of other methods such as evaluations by trained observers. Using paper and pencil surveys to conduct course evaluations has long been the traditional method used for collecting data, but many schools are now moving to electronic alternatives. These methods typically have low response rates because students do not view the evaluations positively. They tend to see the evaluation as something that will require more of their time without providing an impact. Because students rarely see the results, they feel that nothing will change about the course no matter what feedback they provide including how the course is structured or the instructional methods that are used. In order to get valid data about a course, the response rate must be higher and students must feel confident that their time isn’t being wasted.

Responsive Evaluations

Response rates and acceptance of course evaluations are higher when using a student response system because of its effectiveness and efficiency for data collection. Clickers serve as a real-time data collection device that can easily gather group response data. The ability to collect data anonymously creates a safe environment during the gathering of information. Student response technology is straightforward and simple, enabling the instructor to customize the survey questions to their department or class and drill down to specific items in which to gather feedback. Students appreciate the real-time data and ability to see how their responses match up with their peers. Because they can see the data, students have more confidence that their voice is being heard and their thoughts are being considered because of the feedback that they are providing.

Mentioned in an article by Derek Bruff (2009), Mark Scarbecz of the University of Tennessee College of Dentistry used clickers for evaluating teaching at UT and stated, “Response rate and acceptance of the ARS (Audience Response System) for course evaluation were greater than for a web-based system. The ARS was effective and efficient for data collection. Random selection of keypads provided anonymity.”

Triton Improves Results

Turning Technologies, the global leader in student response systems, has developed Triton Data Collection System that provides the following advantages:

• Simple: Triton is an easy to use system with a minimal learning curve. Anyone could walk in and administer the evaluation if the professor isn’t comfortable doing so.

• Secure: Encryption ensures security of evaluation data from the point of answer submission until the evaluation is complete.

• Reliable: The system performs without reliance on an external network, bandwidth or internet availability; creating an evaluation environment where every response counts.

• Affordable: The system uses the same ResponseCard NXT that is widely adopted throughout universities and schools, maximizing return on investment and reducing the costs of manual processing of the evaluation sheets.

• Efficient: High response rates can be expected. Near immediate digital results are transmitted and received once the evaluation is complete. No need to wait for scanning.

• BuildsConfidence: Students can review and validate their responses, providing strong confidence that their voice will be heard and changes will be made ensuring valuable use of their time

Higher response rates on instructional evaluations are necessary to gauge how well a course and an instructor are hitting their mark. Good teachers will listen and respond well to valid data; therefore, having a system in place that will provide a trusting evaluation experience while reporting the needed data accurately, efficiently and effectively is imperative. Turning Technologies and Triton provide a solid solution to improving the overall course survey experience.

Resources

D Bruff. (2009, July 24). Evaluating teaching with clickers. Retrieved from http://derekbruff.org/?p=287