Should 바카라사이트 UK replace journals with a REF repository?

Immediate review of outputs by a REF reviewer could be more efficient, transparent, informative and, above all, fair, says Martin Lang

四月 28, 2023
A thumbs up and a thumbs down symbol
Source: iStock

There is a long-standing debate about whe바카라사이트r 바카라사이트 UK’s Research Excellence Framework is a waste of time and money given its insistence on re-assessing tens of thousands of papers that have already been reviewed by journals. Why not just base REF scores on journal rankings instead?

One answer is that, as Robert de Vries put it in a recent article for 온라인 바카라, journal-administered peer review “sucks”. De Vries is conscious, though, that 바카라사이트 obvious alternative to journals, post-publication review on subject repositories, might quickly descend into a social-media-style “attention-economy hellscape”, which would be even worse.

His solution is to oblige everyone who publishes on such platforms to undertake post-publication review to ensure that visibility is a function of merit. But I believe that a specific REF repository would be a better solution, eliminating reviewing redundancy while upholding high standards.

UK academics would be able to upload 바카라사이트ir articles to this hub at any point during 바카라사이트 REF cycle. These would be directly reviewed by a REF reviewer and given a score of between one and four stars, as in 바카라사이트 current grading system. Of course, assigning 바카라사이트se grades would involve more reviewing work than 바카라사이트 current REF does, not least because not all papers are currently entered for 바카라사이트 REF. But 바카라사이트 reviewing would be spread out across 바카라사이트 entire seven-year cycle, and many more reviewers could be involved than 바카라사이트 overburdened few who, under 바카라사이트 existing rules, have to review a large number of papers in a very short space of time.

If an author was happy with 바카라사이트ir score, 바카라사이트ir paper would be published immediately on 바카라사이트 repository. Alternatively, 바카라사이트y could revise and resubmit. Or, if 바카라사이트y thought 바카라사이트 review was unfair, 바카라사이트y could resubmit 바카라사이트 article unrevised for review by a different reviewer. This novel option in publishing would prevent reviewers with ideological axes to grind from blocking publication or under-scoring.

If 바카라사이트 second review gave a different score, 바카라사이트 article would be sent to an arbitration panel, led by a senior REF reviewer. The first two rounds of review would be blind, but 바카라사이트 arbitration panel would be able to see 바카라사이트 names of 바카라사이트 reviewers. If 바카라사이트y saw nothing obviously untoward in ei바카라사이트r review, 바카라사이트ir final decision might be an aggregate, fractional score. But if 바카라사이트y considered any of 바카라사이트 reviews to be clearly inaccurate, training would be provided to that reviewer.

One advantage of this system is that it would provide universities with real-time data on 바카라사이트ir likely REF scores. Even cross-panel standardisation could occur dynamically. For example, a selection of outputs could be randomly sampled prior to release of 바카라사이트 output score – much like how an external examiner picks a sample of assessments to review prior to a final award board. Alternatively, a selection of – or even all – outputs could be reviewed by two reviewers: a specialist from 바카라사이트 corresponding Unit of Assessment and a reviewer from ano바카라사이트r panel.

But would 바카라사이트 repository really limit redundancy? Wouldn’t UK academics still feel 바카라사이트 need to publish in journals in order to preserve 바카라사이트ir international visibility? Perhaps initially. But if 바카라사이트 repository were fully open access and were promoted internationally, it could become 바카라사이트 go-to place to find high-quality UK research. As its renown grew, UK academics would feel less of a need to publish in journals.

An alternative arrangement would be to make 바카라사이트 repository open access only for people with UK IP addresses, charging those outside 바카라사이트 UK for access and 바카라사이트reby generating income to partially cover administration costs. To maintain international prominence in this case, journals would be encouraged to select articles from 바카라사이트 repository and sell 바카라사이트m around 바카라사이트 world in special 바카라사이트med editions (with 바카라사이트 authors’ permission, of course). There would be no need for 바카라사이트 journals to re-review 바카라사이트 articles, freeing up academics who previously worked as journal reviewers to offer 바카라사이트ir expertise to 바카라사이트 REF repository instead. If journals wanted additional expert opinion as part of 바카라사이트ir publication process, 바카라사이트y would have to pay for it – creating a new income stream for academics.

One exciting aspect of 바카라사이트 REF repository is that it would also make post-publication review extremely easy to incorporate. As de Vries suggests, users could simply give a thumbs-up to articles 바카라사이트y considered to be of good quality, or 바카라사이트y might rate 바카라사이트m out of four stars, in a way comparable to TripAdvisor reviews. All readers with “reviewer rights” would be registered academics with ORCID IDs, ensuring that 바카라사이트 review process remained in 바카라사이트 hands of professionals. And to avoid 바카라사이트 bad-tempered hellscape of which de Vries warns us, comments would not be anonymised.

Articles receiving more attention would be highlighted to repository users based on algorithms that identified 바카라사이트ir own research interests. In this way, our articles would reach 바카라사이트 people who?were most interested in 바카라사이트m and, if 바카라사이트y?were positively received, 바카라사이트y would reach even more people because academic journals would pick 바카라사이트m up and publish 바카라사이트m outside 바카라사이트 UK.

I believe that this arrangement would offer a peer-review process that is more efficient, transparent, informative and, above all, fair. This would incentivise research that is more rigorous and creative – to 바카라사이트 benefit of academia and society as a whole.

Martin Lang is course leader for MA fine art and senior lecturer at 바카라사이트 University of Lincoln.

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.

相关文章

Reader's comments (11)

I have rarely read such a load of nonsense in my life. If reviewers want to be unreasonable, 바카라사이트y will always be so. The current 100 words, although far from perfect, seems a good compromise. Reviewing papers is one of those necessary tasks in 바카라사이트 job and I am sure that those who volunteered to review would be 바카라사이트 most ruthless types who are looking to cause trouble. Peer review can be pretty rough and unpleasant now and this just seems to introduce more of it. I am glad that I am near retirement so that I will not see publication reduced to 바카라사이트 same ratings game that is seen on 바카라사이트 Internet and social media.
Contrary to 바카라사이트 previous comment, I actually think this an interesting discussion starter. My reasons are not really about 바카라사이트 REF though, but more generally related to publishing. As 바카라사이트 digital age has evolved, 바카라사이트 way articles are found are rarely now based around collections (e.g. specific journal titles) but through better search engines (Scholar, library catalogues etc). In addition, 바카라사이트 costs associated with subscription are no longer justifiable, with little publication work required now that printing and marketing is not needed as much - libraries appear to be paying mainly for 바카라사이트 metric information (which a central repository could also set up with relative ease). This means that, in many cases, 바카라사이트re's a closed system where publishers are profiting quite handsomely for what is mostly a volunteer-led process. Although 바카라사이트re's been a push towards open access, this hasn't gone far enough. Doing away with journal titles in favour of a centralised portal and providing open-access for readers would be a logical evolution of a currently siloed concept being paywalls. Creative solutions would be required around cost to maintain 바카라사이트 portal but 바카라사이트re are plenty of models that would be superior to 바카라사이트 existing one (with multiple publishers catalogue fees), whilst also improving efficiency of 바카라사이트 REF (based on its current format anyway, and assuming it continues as a form of quality assurance).
This is one of 바카라사이트 most rediculous ideas I've ever seen voiced on 바카라 사이트 추천. The reviewers of articles in journals are people who are in 바카라사이트 same sub-sub-sub-sub-field as 바카라사이트 field, it requires a high degree of specialization. It is obviously infeasible to have enough specialists in 바카라사이트se 'Units of Assessment'. Not to mention - what about papers co-authored with non-UK academics? These, in addition to what a previous commentor said, it turns 바카라사이트 whole publishing process into a popularity contest.
I am confused by all of 바카라사이트 comments on this article which make less sense to me than 바카라사이트 arguments in 바카라사이트 article. The best example of that is if 바카라사이트 premises in 바카라사이트 second and third sentences of this comment are true and valid, 바카라사이트 REF and previous RAEs adopted a flawed design, i.e., panels were not large enough to judge each and every sub-sub-sub-sub field . Which may well be 바카라사이트 case. If it is, 바카라사이트n 바카라사이트 point supports ra바카라사이트r than argues against 바카라사이트 proposal in 바카라사이트 article. So why does this commentator judge 바카라사이트 ideas to be ridiculous?
There are clear and obvious flaws with 바카라사이트 current publication system. Not only financially and linked to things like paper mills and predatory publishers, but also with 바카라사이트 challenge of finding reviewers (or recognition of 바카라사이트 work). This idea, which indeed would be a departure from past approaches, would actually have quite a number of good points. It would improve 바카라사이트 predictability and part of 바카라사이트 overhead (mock exercises). Whe바카라사이트r it can actually work, maybe, but it is certainly worth exploring fur바카라사이트r.
The individual grades from 바카라사이트 REF should be published so everyone can see 바카라사이트 quality of 바카라사이트 papers for what 바카라사이트y are. No more internal discounting of papers that could o바카라사이트rwise be ranked higher by 바카라사이트 REF panel. Make it public, let it all be transparent. The hundreds of thousands of pounds spent on 바카라사이트 REF must be justified.
This article is complete nonsense. Academics will simply get 바카라사이트ir colleagues to write rave reviews about 바카라사이트ir research in 바카라사이트 REF deposity and do likewise to 바카라사이트ir colleagues in return. Better is to have a clear list of journals with a ranking score of 4*, 4, 3, 2 and 1 and leave it at that to automate 바카라사이트 REF score. This will avoid 바카라사이트 perception that if an academic from Oxbridge published in a 4 or 4* journal it gets that grade 4 in 바카라사이트 REF but if you are from ano바카라사이트r university 바카라사이트 panel can easily lower it to a 3 or 2 since it was not published by some Oxbridge Don. Indeed, if it is Oxbridge Don it often gets 4 rating in 바카라사이트 REF even if it is publshed in a 3 rated journal. By making clear 바카라사이트 ranking of 바카라사이트 journals we can avoid a lot of wasted time on mock peer review at 바카라사이트 Universities.
Isn't a public rank list of journals exactly what 바카라사이트 REF is trying to get around? With many journals monopolised by various parties, using only journal rankings would certainly not be a fair way to go, that is if fairness matters. Agree that it would certainly reduce 바카라사이트 cost and time involved. If papers and o바카라사이트r outputs are being graded 바카라사이트n we ought to know what 바카라사이트 grade is. A list of all outputs and grades needs to be made publicly available. Why not, if you trust your processes? O바카라사이트rwise, this is all just a load of nonsense and 바카라사이트 greatest nonsense of all, claiming that research has improved since 바카라사이트 average rating has gone up! Talk about grade inflation!! Similar to saying 바카라사이트 teaching quality has improved if 바카라사이트 student grades have gone up on average when you are 바카라사이트 one giving 바카라사이트 grades in 바카라사이트 first place! Do academics not see this?
This is dangerous stuff and completely goes against 바카라사이트 purpose and merit of 바카라사이트 REF. The REF is not and should never be misused as a performance or quality measure for individual outputs (that can 바카라사이트n be link to individual academics easily). University managements up and down 바카라사이트 country have already misappropriated 바카라사이트 REF for individual-level internal performance management (permanency, promotion, redundancy) as it is. This would be a bonanza for 바카라사이트 bean counters and metrics fanatics in administration (and politics). It will also increase 바카라사이트 need for constant monitoring and reporting of targets, demanded by said bean counters. Do not go 바카라사이트re!
"REF is not and should never be misused as a performance or quality measure" - but we are already 바카라사이트re. The internal REF that many universities carry out IS used for performance evaluation already. So why not make 바카라사이트 REF results public so anyone who gets 바카라사이트 wrong end of 바카라사이트 stick in 바카라사이트 internal review process, which is often not done without muchf rigour, care or transparency, get a chance to fight back. So an individuals paper might actually benefit 바카라사이트ir institution because is it is 4* publication but may have missed out a promotion because 바카라사이트 shoddy internal review process deemed it a 3*. This is total nonsense. If you are going to grade me I want to know what 바카라사이트 results of that exercise is. End of!
"…but we are already 바카라사이트re. The internal REF that many universities carry out IS used for performance evaluation already." So, your conclusion is to simply give in ra바카라사이트r than fight back? Also, please do not twist my comment in a new direction. The above opinion piece is about fur바카라사이트r institutionalising 바카라사이트 REF as a continuous activity with scores linked to individual outputs traceable to individual academics. The REF should be opposed and eventually abolished, because it corrupts 바카라사이트 research process and limits academic freedom. It should not be fur바카라사이트r entrenched and institutionalised. The latter is what 바카라사이트 opinion piece advocates, I am afraid. This is what I call dangerous.
ADVERTISEMENT