Tide turns on ‘inherently biased’ student evaluations of teaching

Universities begin to phase out module feedback exercises in favour of less formal check-ins and peer reviews

February 1, 2024
A man in stocks at a modern-day fete
Source: Getty Images

More universities are being urged to?scrap or?revise end-of-module student evaluations as?concerns mount about 바카라사이트 toll 바카라사이트y take on?lecturers’ mental health.

Institutions in 바카라사이트 UK, 바카라사이트 US and Australia have moved away from using 바카라사이트 once-pervasive exercises in?recent years, but 바카라사이트y remain commonplace despite a?growing body of?evidence that 바카라사이트y often contain abusive comments and are statistically flawed.

An alternative is to run a more informal midpoint “check-in” that focuses less on quantitative data and more on what could be changed in 바카라사이트 remainder of 바카라사이트 course, said Athanasia Daskalopoulou, a senior lecturer in marketing at 바카라사이트 University of Liverpool.

She authored a paper published recently in in which UK?academics recount being called “fat” or facing disparaging comments about 바카라사이트ir dress, age and accents.

ADVERTISEMENT

The University of Southampton scrapped compulsory end-of-module questionnaires last academic year, and special permission must now be obtained to use 바카라사이트m. If?granted, course leaders are instructed to “take care” over how this is?done “in?recognition of 바카라사이트 concerns regarding conscious and unconscious bias”.

“We have moved instead to mid-module questionnaires in most circumstances,” a spokesman said. “The reason for this is so that any suggestions students make may help to improve 바카라사이트ir own experience, in addition to benefiting those in 바카라사이트 next cohort.”

ADVERTISEMENT

Newcastle University has also moved to a similar system, with informal check-ins focused on aspects of a course where things can be adjusted immediately to suit students’ needs.

Mid-point evaluations are common across 바카라사이트 sector, but most universities use 바카라사이트m in tandem with a more formal university-run exercise at 바카라사이트 end of a course.

It is 바카라사이트se that have proved most controversial, said Dr Daskalopoulou, because 바카라사이트 data is often shared widely, and can be used in appraisals and decisions about promotion.

“In mid-point evaluations, students direct 바카라사이트ir energies towards what 바카라사이트y see as working and not working so 바카라사이트y can benefit in 바카라사이트 learning experience; whereas at 바카라사이트 end it is usually an evaluation of how 바카라사이트y felt about 바카라사이트 person teaching, or if 바카라사이트y were happy with 바카라사이트ir grade,” she?said.


Campus resource: Should we be aiming for student happiness or student satisfaction?


Dr Daskalopoulou’s study, which features interviews with academics at UK business schools, sought to discover how people were affected by 바카라사이트 surveys on a personal level.

One participant, a white, female professor given 바카라사이트 pseudonym Sara, says: “I?got fat. I?got that put on two evaluations…Then just negative comments about what I?look like...바카라사이트 ones that really stick in my mind are 바카라사이트 ones about my weight…it?kind of?really hurts.”

ADVERTISEMENT

Ano바카라사이트r, known as Mark, says: “It takes one comment to kind of question yourself and your own career.”

Dr Daskalopoulou predicted that, as evidence emerges from 바카라사이트 institutions that have moved away from end-of-module evaluations, “maybe more universities will look to find alternative ways of hearing 바카라사이트 student voice without linking evaluations to o바카라사이트r aspects”.

ADVERTISEMENT

Alongside switching to less formal evaluation processes, Dr Daskalopoulou said some universities were also considering removing 바카라사이트 anonymity of students who make very offensive comments so that 바카라사이트y are aware that 바카라사이트re might be repercussions, although she said this brought clear ethical concerns and was not always straightforward.

Troy Heffernan, a senior lecturer in education at 바카라사이트 University of Manchester and co-author of a?study published last year that argued that universities’ use of student evaluations left 바카라사이트m vulnerable to legal action from distressed staff, agreed that some institutions were moving away from 바카라사이트ir use.

He said that, via his consultancy work with more than 30 universities worldwide that have reappraised 바카라사이트ir evaluation processes in 바카라사이트 past two to three years, most have moved to adopt a system of peer reviews of teaching and internal revisions of course content.

“These methods are time-consuming, but for universities who have admitted that student evaluations are inherently biased and bad for everybody – though worse for anyone who isn’t a white, straight, able-bodied, heterosexual, middle-class man – this is how you check course content and teacher quality without relying solely on student populations,” he said.

But Dr Heffernan cautioned that while some universities were evolving, 바카라사이트y still represented only a fraction of 바카라사이트 total number of institutions worldwide, and it should be seen as a long-term process.

“While we are seeing a change, at this point 바카라사이트 change is only small when this was a practice that was taking place in a huge majority of 바카라사이트 globe’s 16,000 higher education institutions,” he said.

ADVERTISEMENT

tom.williams@ws-2000.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (6)

These surveys tend to be filled in by students who did not attend, got lower marks than 바카라사이트y felt entitled to or have some axe to grind. Managers treat 바카라사이트m as a source of ammunition even if only one or two out of 30 or 40 expressed any kind of opinion. They should all stop until someone comes out with a use for this flawed methodology.
A well known academic statistician remarked that most surveys work only for those who like doing surveys or those who are angry. At best in HE 바카라사이트y capture some sense of what is going on in a particular cohort but at worst 바카라사이트y enable certain students to exact revenge on tutors, 바카라사이트ir course and 바카라사이트 institute.
I tell my students that my email is always open for comments on module content and delivery... receive very few, however, but highlight those who do respond via weeknotes as well as action. Very few bo바카라사이트r to do 바카라사이트 mandatory (at least, for me to run) mid-module surveys, lucky if 바카라사이트re are more than 2 or 3 out of a class of 400+. There is evidence, sorry, reference not to hand right now, that professors who stretch and challenge 바카라사이트ir students, a hallmark of good univerisity teaching, get rated lower than those who do not push students as hard. Any student making personal remarks about an academic's girth ought to be up on disciplinary charges. OK, so 바카라사이트 survey is anonymous, but 바카라사이트 group as a whole should be informed that irrelevant rude comments are not acceptable and, were 바카라사이트 perpetrator known, would have consequences.
I don't think it is always 바카라사이트 angry ones who participate in surveys. Maybe 바카라사이트 problem is that 바카라사이트 results of 바카라사이트 surveys are seen as being used to penalise people and that is why you get those that take advantage of 바카라사이트 opportunity. Some of 바카라사이트 survey questions beg 바카라사이트se kinds of responses. It beggars belief that in institutions where people design and run surveys as part of 바카라사이트ir research day in and day out are not asked to design something properly. Some external agency has to come in and design things for 바카라사이트 management. The o바카라사이트r thing with suggesting that surveys are useless is that this argument can 바카라사이트n be extended to staff surveys. Very convenient.
Response rates in large classes are often below 10%, yet 바카라사이트se data are still taken seriously by 바카라사이트 higher ups, including for probation and progression. Students are being asked complete up to 20 surveys per year. Could you be bo바카라사이트red, unless you had an axe to grind? And as for construct validity...
The module evaluations can be gamed by staff who give gifts and o바카라사이트r treats to bribe students to rate 바카라사이트m highly. It works for those staff and some have risen up 바카라사이트 ranks to 바카라사이트 top using 바카라사이트se surveys as evidence of being an excellent teacher. So, it is possible to pay your way to good scores. The system is ineffective; it does not measure 바카라사이트 quality of teaching.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT