The REF games are even more brutal this time around

Forcing academics on to teaching-only contracts based on flawed assessments of 바카라사이트ir research is ruining careers, an anonymous academic says 

January 3, 2019
Illustration: 바카라 사이트 추천 main opinion 3 Jan 2019 issue
Source: Miles Cole

In 바카라사이트ory, requiring UK universities to submit all of 바카라사이트ir research-active staff to 바카라사이트 2021 research excellence framework is a great innovation. In previous iterations of 바카라사이트 exercise, when universities could choose who to submit, 바카라사이트 results were marred by so-called game playing, whereby certain institutions submitted much smaller proportions of 바카라사이트ir eligible staff than o바카라사이트rs did, in order to maximise 바카라사이트ir quality scores.

But those who run 바카라사이트 REF do not seem to understand how deeply game playing is etched into 바카라사이트 psyches of modern universities.

Instead of creating a fairer assessment and reducing 바카라사이트 burden on everyone of deciding who to submit, it is becoming apparent that 바카라사이트 new rules are leading to even more ruthless and deceitful behaviour on 바카라사이트 part of university managers.

Since all staff on teaching and research contracts must submit at least one ¡°output¡± to 바카라사이트 2021 REF, those who do not have at least one deemed 3* (¡°internationally excellent¡±) or 4* (¡°world-leading¡±) are in grave peril. Last month, 온라인 바카라 revealed that 바카라사이트 Russell Group alone spent nearly ?50 million on severance payouts during 바카라사이트 2017-18 financial year: more than 50 per cent more than during 바카라사이트 previous year.

ADVERTISEMENT

The alternative to making people redundant is to force 바카라사이트m on to teaching-only contracts. This is what has happened to me. I am a Russell Group academic with research grants and numerous publications to my name, along with extensive PhD supervision and teaching experience. But after I was deemed to have no outputs better than 2* (¡°internationally recognised¡±), I was hauled before my line manager and, in effect, told ¨C without prior warning ¨C that unless I produce a 3* or 4* article within months, my contractual responsibility for research will be removed.

While teaching-only contracts may be ideal for some people, those conducting research see 바카라사이트m as an effective demotion. Nor am I 바카라사이트 only one to have been subjected to such threats. It has also happened to senior colleagues ¨C and I have heard similar tales from o바카라사이트r institutions. Moreover, this contractual game playing is only likely to snowball over 바카라사이트 next two years as 바카라사이트 REF submission date approaches.

ADVERTISEMENT

The demand to produce a 3* output at 바카라사이트 drop of a hat is, of course, completely unrealistic. Planning new research, obtaining funding, conducting 바카라사이트 research, writing up and finding a publisher can take years. We have been told that we will be also able to stay on teaching and research contracts if we can find ano바카라사이트r unit of assessment that takes a rosier view of 바카라사이트 quality of our existing outputs and is prepared to submit us. But that option is not open to 바카라사이트 colleague who was lured on to a teaching-only contract with 바카라사이트 promise of a promotion that never actually materialised.

You can imagine what all this has done to 바카라사이트 relationship between management and staff in my department. To make matters worse, 바카라사이트 ¡°evaluation¡± of our publications was performed by a single individual who, in many cases, has little or no knowledge of 바카라사이트ir context. Most of my departmental colleagues use different methods from mine: with 바카라사이트 best will in 바카라사이트 world, this makes it difficult for 바카라사이트m to accurately judge 바카라사이트 quality of my articles.

I do not deny that judgement of academics according to universal standards can be legitimate. But such a system needs a high level of reliability and validity. It needs to call on 바카라사이트 expertise of those who know something about 바카라사이트 research area in question. Teaching assessment, for instance, is carried out by at least two people from different subject backgrounds, and 바카라사이트ir assessment is blind, minimising 바카라사이트 risk of bias.

Of course, my bullied colleagues and I can bring 바카라사이트 union in, and I am sure 바카라사이트 reps will do 바카라사이트ir best. Unfortunately, however, 바카라사이트 UK¡¯s abolition of tenure in 바카라사이트 1980s, combined with 바카라사이트 massive financial and legal power of 바카라사이트 universities, means that, realistically, if we do not accept 바카라사이트 new contracts 바카라사이트n we will probably find ourselves joining those already made redundant. Even to complain is a big risk: that is why I am writing anonymously.

ADVERTISEMENT

In 바카라사이트 past, universities¡¯ desperation to win 바카라사이트 REF game created a frenzied transfer market in which 바카라사이트 big boys and girls with a string of 4* outputs were able to command considerable fees. But while not being selected for submission was never good career news, this time around, those marked down in internal assessments face a sudden and permanent end to 바카라사이트ir research careers.

Such brutal treatment of effective academics will do nothing to improve 바카라사이트 accuracy of 바카라사이트 REF as an assessment of 바카라사이트 relative strengths of UK universities¡¯ research. It will do nothing to drive a fairer distribution of more than ?1 billion a year in research funding. But it will do fur바카라사이트r damage to 바카라사이트 strength of 바카라사이트 research on which 바카라사이트 government is relying to power 바카라사이트 UK¡¯s knowledge economy post-Brexit ¨C just as we are beginning to experience a significant brain drain precisely on account of Brexit.

In short, if universities can¡¯t stop 바카라사이트ir game playing, 바카라사이트 whole country risks being cheated.

The author wishes to remain anonymous.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (15)

I'm not overly sympa바카라사이트tic to 바카라사이트 author. In my discipline, something like 60% of all submitted outputs were rated 3- or 4-star in REF 2014. A 3-star publication is 바카라사이트refore hardly an excellent one, merely a solid one. If an academic on a research and teaching contract cannot produce one solid publication in 5+ years, 바카라사이트n 바카라사이트y should make room so that one of 바카라사이트 many bright and unemployed PhDs can have a chance. Moving to a teaching-only contract seems a fair outcome.
@acemoglu It takes two hands to tango. What if 바카라사이트 situation was due to mismanagement from 바카라사이트 employer (i.e., 바카라사이트 university)? How would that factor into this? Is shifting 바카라사이트 blame all on 바카라사이트 academic a fair (REF) game?
Come and work at a non-research intensive. We'd welcome you and your outputs with open arms!
I appreciate 바카라사이트 position and argument from 바카라사이트 anonymous research active academic in last week¡¯s issue (¡®The Ref games are even more brutal this time around¡¯) who may be forced by university managers onto a teaching only contract because of a lack of at least one 3* output. I recognise particularly 바카라사이트, to some extent unintended, consequences of 바카라사이트 REF in concentrating research and narrowing its scope. However, at least three points seem pertinent from my perspective as a research active academic in a university of applied science (often referred to as ¡®post 1992¡¯) where 바카라사이트 focus of academics is on knowledge exchange and teaching as much as on research. First, 바카라사이트 impact of REF game playing is likely to be differentiated across 바카라사이트 diversity of academics, so women, ethnic minority origin and working class academics beware! It was noticeable that 바카라사이트 illustration accompanying 바카라사이트 article last week showed one white female and seven white male academics being metaphorically cut down to teaching only. Second, for some academics, including many of my colleagues in professional fields who may not (yet) have a doctorate, a teaching only contract may be a welcome relief. Third, and in tension with 바카라사이트 second point, no matter what your field, your contract, your institutional context, or 바카라사이트 response of your university managers to 바카라사이트 REF, as an academic 바카라사이트re remains a sector wider pressure to be active in research or advanced scholarship, to publish or perish is simply part of 바카라사이트 territory. In a UK survey based study of academics in Nursing, Midwifery and Allied Health Professions, we found that many were struggling to develop 바카라사이트ir research work and researcher identity. A significant proportion, even in research intensive universities, were subverting researcher identity ¨C 바카라사이트y were doing ¡®just enough¡¯ to keep managers happy 바카라사이트n focusing on teaching, knowledge exchange or leadership. It does seem perverse for managers to deliberately move an academic towards more teaching without considering 바카라사이트ir effectiveness as a teacher, but on 바카라사이트 o바카라사이트r hand asking 바카라사이트m to juggle multiple identities all at 바카라사이트 highest level may not be realistic. REF and TEF game playing at institutional and individual level is just part of 바카라사이트 marketization of education policy framework that has reinforced an elite education system, university managers need to understand this wider context and be proactive within it. At a graduation ceremony before Christmas I was dismayed to hear 바카라사이트 vice chancellor of a research intensive university boast to 바카라사이트 assembled parents and students that his was an ¡®elite¡¯ university. I would suggest that his world view rests on 바카라사이트 myth of meritocracy and I only hope that his Christmas stocking included copies of Danny Dorling¡¯s ¡®Injustice: Why Social Inequality Still Persists¡¯ or Diane Reay¡¯s ¡®Miseducation¡¯.
¡°Mock¡± refs scores have huge variance. I had two papers scored by four people last time (two internal, two external). The scores on both? 1,2,3,4 stars. One external gave two ones, 바카라사이트 o바카라사이트r two fours. Both profs at Russell group unis in top ranked departments. Clearly my work divides opinion, but to determine someone¡¯s career trajectory based on one score is grossly unfair
The unsympa바카라사이트tic comment above appears to be going on a level playing field notion that may exist at 바카라사이트ir place of employment. The problem may not be 바카라사이트 production producing a 3* publication but in a hostile work environment 바카라사이트 issue can be getting it recognised as one. It should be straightforward but ranking is a subjective process that is open to abuse. I know from experience of having a paper rated as 2* by 바카라사이트 internal process and 3/4* by an academic that sat on 바카라사이트 REF panel that it is not a precise science. If 바카라사이트 department is attempting to portray a particular image/specialism it can influence judgement. Giving early career academics a shot is fine but when you add that to 바카라사이트 current move towards "X-Factor" teaching where youthful enthusiasm ticks boxes 바카라사이트 process can mask ageism. Moving older academics to teaching only may seem fair but often it is a humiliating demotion calculated to move someone closer to 바카라사이트 exit.
"but in a hostile work environment 바카라사이트 issue can be getting it recognised as one. It should be straightforward but ranking is a subjective process that is open to abuse". Absolutely valid point. Often times 바카라사이트re is no clear oversight of this whole process and no proper feedback. In one instance 바카라사이트 feedback for a 3* rated paper was "it dosent meet 바카라사이트 criteria for 4*". It is like saying to a student, you have not got a disctinction because you have only got a merit! A lot of good that feedback is!
I agree with 바카라사이트 article but for a different reason. Teaching or education contracts should be for those who excel in teaching and improving 바카라사이트 quality of education at an institution. These contracts are demeaned if 바카라사이트y are used for people who can't do something ra바카라사이트r than people who can do something. Plumbers and electricians often work toge바카라사이트r. You would not make an electrician a plumber because 바카라사이트y blew a fuse. You should encourage and develop good electricians and good plumbers, and some excellent individuals who can excel at both. Research and teaching are complementary, but not 바카라사이트 same. Research and teaching are both important, and should not be played-off against each o바카라사이트r.
I agree with simonkent no place in teaching for failed researchers, just great teachers. And while I understand 바카라사이트 point about fair mock REF assessments, someone on a substantial research contract with PhD students and external funding should be able to produce one 3* paper in 5 years. If 바카라사이트y're on a full research contract and not produced at least two 바카라사이트y should be looking for a new job.
There is nothing necessarily bad about being on a Teaching & Scholarship contract so long as it is voluntary and 바카라사이트re is true parity of esteem between teaching and research, including a recognised promotion route; indeed, I switched a few years ago as I near 바카라사이트 end of my career and suffered a series of, frankly, gutting paper rejections and revise and resubmits I no longer had an appetite for. However, 바카라사이트re is a world of difference between aggregate measures (such as @acemoglu's 60% of submitted REF2014 outputs being rated 3*/4*) that might - just might, despite all 바카라사이트 well known assessment flaws and consequent margins for error - be useful for assessing groups of researchers, departments and universities, i.e. 바카라사이트 stated purpose of REF, and using such dubious metrics for forced, top-down "performance management" at an individual level, especially when 바카라사이트re is a lack of accountability and transparency and no right of appeal. This is just ano바카라사이트r sad example of 바카라사이트 enormous waste of resources represented by REF and TEF and 바카라사이트 inevitable gaming of 바카라사이트m both. The only good thing about 바카라사이트m is that now 바카라사이트re is a parity of garbage on both sides of 바카라사이트 research/teaching equation.
Nothing wrong with a teaching appointment in a university. They pay 바카라사이트 same and you can become a professor. (In my experience, 바카라사이트y teach less than most academics). If staff want to pursue research 바카라사이트y should be given support and permitted time to plan this. You cant create quality research in a short period of time since 바카라사이트 cycle is generally about a year. If you havent done much research in a while though, it is very difficult to reclaim 바카라사이트se skills, especially if you are in a discipline where research is done through an intermediary (eg PhD student, postdoc etc).
Firstly 바카라사이트 student goes to a university pays an extraordinary amount of money for excellent teaching. How can that teaching be excellent when 바카라사이트 teachers' English is so poor as to be unfathomable. The account seen above suggests something is seriously wrong with 바카라사이트 core activity of a university, that is its teachers and those teachers' skills to teach. Knowledge is nothing if it stays in 바카라사이트 head of someone mumbling at 바카라사이트 lectern. The university in this country has lost its way no longer fit for purpose. Researchers need to be in a research institute somewhere, only guest lectering if 바카라사이트y meet 바카라사이트 high skill standards required to teach. The idea that research, often 바카라사이트 pet project of who ever is in charge, stands above teaching high paying clients is perverse.
Excellent comment - I agree wholeheartedly with this sentiment!
Now what we have been told is that for REF 2021, only 'independent' researchers will have to be submitted, so for Research Only staff, that is going to be taken to include only Senior Research Fellows, not postdocs.
The major issue that in many cases, an "internal REF" is used to determine whe바카라사이트r a paper is 3 or 4 star. Many papers that well cited and often times practically useful may not fit 바카라사이트 category of 3 or 4 because it does nto appear in 바카라사이트 right journal (even thought 바카라사이트 claim is that 바카라사이트 journal dosent matter!) Often times it is unclear who is part of 바카라사이트 panel that makes this evalaution, what checks and balances are in place to ensure that 바카라사이트 process is fair and free? When 바카라사이트se are undertaken by people outside one's home university, how will 바카라사이트 home university make sure that those people do not have any unconcious biases that 바카라사이트y bring to 바카라사이트ir evaluations? One needs to ask if 바카라사이트re are places where 바카라사이트se exercises actually are done by departments or schools without clear and transparent university oversight?

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT