A little strategy goes a long way: How one health sciences lecturer achieved an 80 percent response rate for online course evaluations
By Mark Bachmann, Teaching and Learning Centre
The overall response rate for online course evaluations at SFU is around 50 percent. So it鈥檚 remarkable that Tun Myint鈥檚 HSCI 211 course鈥攁n undergraduate class with 219 students鈥攁chieved a level of over 80 percent this past spring.
The exceptional result was no accident. Tun Myint, a Health Sciences lecturer, employed a novel strategy to encourage his students to complete their Student Evaluation of Teaching and Courses (SETC) forms.
Although the strategy required some effort on his part, Tun Myint is convinced that the investment was worthwhile. Student evaluations, he says, tend to attract responses from those 鈥渨ho like you or who don鈥檛 like you鈥攕o there are two extreme groups of students. But we would like to get a more general overall picture of the course 鈥� One way to increase validity is to increase our response rate to improve representativeness.鈥�
An incentive鈥攂ut what kind?
At the heart of his approach was a particularly creative incentive.
鈥淚n my view, students are always thinking, 鈥榃hy should I do that?鈥� 鈥� he explains. 鈥淢ost things they won鈥檛 do unless they get motivated. One of the motivation factors is to give an appropriate incentive.鈥�
For Tun Myint, 鈥渁ppropriate鈥� meant an incentive that would align with the course learning objectives and 鈥渁t the same time [wouldn鈥檛] penalize students who didn鈥檛 respond.鈥� He decided to offer his students a deal: If the class achieved a collective 70 percent response rate on the SETC forms, he would add an extra question鈥斺�渘ot a bonus question鈥濃�攖o the pool on the final exam; in other words, instead of facing 12 mandatory questions, they would be given 13 questions, of which they could choose 12. If they achieved an 80 percent response rate, they would get two extra questions, and if they reached 90 percent they would get three.
The students found the offer appealing鈥攂ut three days before the evaluation deadline participation was still around 60 percent, well below the level he wanted. Tun Myint sent an email reminding his students of the deal. 鈥淭he next day I saw the response rate jump up to 70 percent.鈥�
As the deadline approached he sent out additional reminders, including requests for those who had already completed their forms to rally classmates who hadn鈥檛 yet done so. On the day of the deadline he posted the updated response rate several times and watched the number pass 80 percent. As a result, students were given two extra questions to choose from on the final exam.
Why it worked and why it mattered
Tun Myint attributes the success of his approach to several factors, including the perceived value of the incentive, the incremental way in which it was structured, and the collective nature of the challenge, which mobilized students to encourage one another to participate.
While he believes end-of-semester evaluations need to be supplemented by other types of formative feedback (he also uses a simple survey tool to collect weekly feedback from his students), Tun Myint is pleased with the outcome he and his students achieved.
鈥淪ETC is one of the good ways to learn from the student point of view [about] the course, what I have done in the class, and what areas can be improved. This is my incentive or my motivation to get more valid feedback from the students.鈥�
Tun Myint received two Teaching and Learning Development Grants from SFU鈥檚 Institute for the Study of Teaching and Learning in the Disciplines (ISTLD) in 2016 and 2017 to investigate reflection and teaching inquiry tools for improving student learning and instructors鈥� teaching effectiveness.