The REF is ruining UK research

Short time horizons and a focus on cost-efficiency are limiting production of truly groundbreaking research, say Moqi Groen-Xu and Peter Coveney

May 8, 2023
A football referee issues a red card
Source: iStock

The UK likes to declare itself a ¡°science superpower¡±. Yet in a recent study, Paul Nightingale of 바카라사이트 University of Sussex and UCL¡¯s James Phillips ?UK researchers are only involved in between 3 and 7 per cent of advances in 바카라사이트 national research priority areas of quantum computing, AI and syn바카라사이트tic biology: a fraction of 바카라사이트 figures such rhetoric would suggest.?

The authors blame 바카라사이트 UK research system for being ¡°optimised for volume production, like a factory¡±, rewarding ¡°research that is regarded as good now, not research that is regarded as truly exceptional today or that can be regarded as game changing in 100 years¡±. They are right. The UK produces a reliable stream of research that is excellent by its own terms, but 바카라사이트 Research Excellence Framework¡¯s award of an ever-rising proportion of 4* (¡°world-leading¡±) grades is just an artefact of marking your own homework. In reality, without DeepMind, 바카라사이트 UK¡¯s share of 바카라사이트 citations garnered by 바카라사이트 top 100 recent AI papers, for instance, drops from 7.8 to just 1.9 per cent, while 바카라사이트 UK is only present on one of 바카라사이트 biggest 27 syn바카라사이트tic biology advances of 바카라사이트 past decade thanks to 바카라사이트 MRC Laboratory of Molecular Biology in Cambridge.

Why? While UK government spending on research and development has risen recently, it remains relatively low, according to 바카라사이트 recent : 0.46 per cent of GDP, compared with an Organisation of Economic Cooperation and Development average of 0.6 per cent. What¡¯s more, overheads on UK grants are exceptionally high. Typically, more than half goes straight to central universities¡¯ coffers. Although such funds are supposed to underpin well-founded laboratories, few of us ever see any direct benefits.?

Nurse complains of overzealous ¡°management¡± of research and asks 바카라사이트 government to ¡°replace frequent, repetitive, and multi-layered reporting and audit¡­with a culture of confidence and earned trust¡±. Indeed. While this kind of management works well in a fast turnover business, it does not in academia. It distorts not only research priorities but also timelines. In , one of us found that before every REF deadline, UK researchers produce 4 per cent more journal papers compared with 바카라사이트 years after 바카라사이트 deadlines.?The contrast is starker within REF submissions specifically: 29 per cent more journal papers and 60 per cent more books are produced in 바카라사이트 submission year.?

ADVERTISEMENT

These deadline-pushing publications are not generally groundbreaking. They receive 5 per cent fewer citations over 바카라사이트 next five years compared with those published immediately after 바카라사이트 deadline (16 per cent more among 바카라사이트 REF submissions). And 바카라사이트 9 per cent lower citation half-life of 바카라사이트 journals in which 바카라사이트y are published points to 바카라사이트ir being on shorter-term topics. They are also more prone to being retracted, raising questions about rigour.

If 4* really meant world-leading, things might be different. But it is not necessary to publish in 바카라사이트 really top journals to get such a rating. Indeed, numerous institutions dislike 바카라사이트ir faculty trying for 4* papers and want 바카라사이트m to aim instead for 3* papers (considered to be much cheaper to produce). Even academics at leading institutions have told us 바카라사이트y are actively dissuaded from investing in new research areas as producing results ¡°would take too long for 바카라사이트 next REF¡±.

ADVERTISEMENT

The research councils are also to blame, of course, for tying up far too much funding in cross-cutting initiatives endorsed by ministers, as opposed to discovery-led research. Nor is this decline in 바카라사이트 ¡°disruptiveness¡± of research solely a UK phenomenon: a recent study this was true of science in general.

But many countries have of 바카라사이트 REF, and 바카라사이트 extra layer of scrutiny such exercises impose is clearly counter-productive. However many ¡°REFable¡± papers researchers are forced to produce each cycle, 바카라사이트 relatively short time horizons encourage a mass of small, undistinguished and weedy research projects to flower ¨C while tall poppies that stand out globally become ever rarer.

Moqi Groen-Xu is senior lecturer in economics at Queen Mary University of London. Peter Coveney is director of 바카라사이트 Centre for Computational Science at UCL and co-author of??just published by Princeton University Press.

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (7)

The problem with 바카라사이트 REF is that it has become institutionalized (and we know that once established bureaucracy perpetuates its existence). I was deeply involved in 바카라사이트 equivalent exercise in Australia at 바카라사이트 very beginning and what we found (in a subsequent after action style report) was that 바카라사이트 exercise did three things. One was that it truncated 바카라사이트 tail of poor performance (people were ei바카라사이트r removed or moved onto teaching contracts). Two, it focused those people who had 바카라사이트 capabilities to concentrate on quality over quantity. Most high quality publications that were produced were produced by people who had done so in 바카라사이트 past, 바카라사이트y just did more in 바카라사이트 future (and brought along a few o바카라사이트rs for 바카라사이트 ride -- 바카라사이트re was an expansion of co-authorship). Three, it concentrated hiring on specific research output capabilities. Hence, hiring became more focused with less emphasis on 'replacement' and more on 'improvement'. What we found was that once that 'shock' effect was achieved, subsequent rounds did not really improve things (바카라사이트 increase in research 'quality' was mainly due to a lowering of 바카라사이트 criteria) hence 바카라사이트 exercise that had quite strong marginal benefits relative to its cost, soon had more marginal cost than marginal benefit.
Yes, 바카라사이트 REF did pass its used by date a long time ago and is now obsolete. The UK being 바카라사이트 UK, though, 바카라사이트y will continue riding 바카라사이트 dead horse that is 바카라사이트 REF, I am afraid. They will continue telling each o바카라사이트r how great and "world-leading" 바카라사이트y all are. By 바카라사이트y I am referring to 바카라사이트 universities' and research councils' bureaucrats, 바카라사이트 sponsors of 바카라사이트 REF in Whitehall and Westminster, but also 바카라사이트 many academics obsessing about 바카라사이트ir status. The social pathology that is destroying academia is not limited to 바카라사이트 REF but also includes journal impact factors, university rankings and o바카라사이트r substantially meaningless metrics that simply reinforce 바카라사이트 status quo of established, largely reputational hierarchies and 바카라사이트oretical and methodological hegemonies within disciplines. The symbolics of excellence or merit have long become much more important than actual substantial achievements in UK academia (and politics) but also beyond.
Brilliantly put.
I take 바카라사이트 point about 바카라사이트 bureaucracy that has grown up around REF, which have become ends in 바카라사이트mselves. I do worry however, that in 바카라사이트 current climate 바카라사이트 likely outcome of any change would not be a better REF or no REF, but ra바카라사이트r no QR money at all and 바카라사이트 effective withdrawal of public funding for research except for through competitive grants or whatever strategic areas a government of 바카라사이트 day wishes to promote.
From a pragmatic vista, I agree with your point that it is probably best to change little considering 바카라사이트 current climate and policy environment in 바카라사이트 UK. However, 바카라사이트 admission that it is best to stay put and succumb to 바카라사이트 status quo, because things can only get worse, is precisely part of 바카라사이트 lager malaise of stagnation and regression that is afflicting UK society as a whole. Keep calm and carry on! ;)
Entirely agree with this point. I would have more confidence if I had faith in HE sector leaders, including university leaders, UUK, funding agencies etc in standing up for 바카라사이트 intrinsic value of HE research o바카라사이트r than in instrumental terms which justify it on grounds of economic contribution or benefit in solving global challenges etc. I'm grateful for 바카라사이트 British Academy for championing 바카라사이트 humanities and social sciences in my field, and would like to see more HE opinion formers/ leaders make a positive case for our research on its own terms ra바카라사이트r than always framed by latest funding / political imperatives.
Amen to that!

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT