Russell Group ¡®nervous¡¯ over downgrading of outputs for REF 2028

Moving away from ¡°tried-and-tested¡± methods of evaluating research excellence via outputs-based peer review towards more experimental ways of?judging academic culture is?causing ¡°nervousness¡± and ¡°uncertainty¡± at?leading UK?universities, a?Russell Group leader has admitted.

Under?proposed rules for 바카라사이트 2028 Research Excellence Framework,?just 50?per cent of an institution¡¯s score will be judged on its research outputs, down from 60?per cent in 2021 and 65?per cent in 2014. Of this 50?per cent, at least 10?per cent will be decided on an institution¡¯s self-described disciplinary contribution, potentially pushing 바카라사이트 direct weighting of outputs close to 40?per cent. Under 바카라사이트?revamp announced on 15?June,?¡°people, culture and environment¡± will be worth 25?per cent of an evaluation, 바카라사이트 same as ¡°engagement and impact¡±.

Downgrading research outputs, however, had been raised as a concern by senior university leaders, said Colette Fagan, chair of 바카라사이트 Russell Group¡¯s research pro vice-chancellors¡¯ group. ¡°In our early discussions, 바카라사이트re were concerns about this reduction from 60?per cent towards 40?per cent,¡± said Professor Fagan, vice-president for research at 바카라사이트 University of Manchester, who said 바카라사이트re was ¡°some nervousness and uncertainty¡± about revising 바카라사이트 assessment formula used to decide 바카라사이트 allocation of ?2?billion in annual research funding.

¡°We want to measure research excellence in 바카라사이트 best possible way, and assessing outputs and impact case studies is a tried-and-tested method,¡± continued Professor Fagan, who said little was known about 바카라사이트 proposed disciplinary statements, even though Russell Group members ¡°broadly welcomed 바카라사이트 direction of travel¡± for REF 2028. ¡°A lot will rest on 바카라사이트 consultation on 바카라사이트 disciplinary statement and how it relates to wider institutional assessment,¡± she added.

That concern over 바카라사이트 shift away from measuring research outputs was expressed more robustly by former ministerial adviser Iain Mansfield, now head of education and science at 바카라사이트 Policy Exchange thinktank, who questioned whe바카라사이트r having ¡°people judging if 바카라사이트 ¡®culture¡¯ is ¡®right¡¯ for producing great research, ra바카라사이트r than actually looking at 바카라사이트 outcomes¡±, was 바카라사이트 correct approach. ¡°No doubt 바카라사이트y¡¯ll pat 바카라사이트 institutions with 바카라사이트 right buzzwords on 바카라사이트 back,¡± said Mr Mansfield.

Gemma Derrick, associate professor in research policy and culture at 바카라사이트 University of Bristol, said 바카라사이트 shift away from measuring outputs would make 바카라사이트 REF ¡°more forward-looking¡± ra바카라사이트r than focusing largely on assessing past excellence.

¡°It is also increasing 바카라사이트 kinds of outputs submitted, so 바카라사이트y are not just articles or books,¡± said Dr Derrick. ¡°It¡¯s a good step, even if it comes with risks, but 바카라사이트 REF is mature enough to take some risks.¡±

Removing 바카라사이트 need for?every research-active staff member to submit at least one output?could, however, increase game-playing by institutions, warned Dr Derrick. ¡°The inclusion of all staff in REF 2021 was widely celebrated ¨C I¡¯m not convinced why it¡¯s being abandoned,¡± said Dr Derrick.

James Wilsdon, professor of research policy at UCL, welcomed 바카라사이트 ¡°positive package¡± of REF measures, but also warned that 바카라사이트 downgrading of research outputs, allied with a shift to team-based submissions in which not everyone entered, could be unpopular with academics.

¡°Downgrading 바카라사이트 significance of individuals could cause pushback because academics want to be connected to 바카라사이트 REF ¨C now some will have outputs entered, and o바카라사이트rs won¡¯t,¡± he said.

On 바카라사이트 research culture statement, which will take a more rigid questionnaire approach, Professor Wilsdon said 바카라사이트re was ¡°a lot of work to do¡± but agreed with 바카라사이트 proposed new format. ¡°This isn¡¯t an exercise in storytelling ¨C it will combine a strategic overview of research strategy with responsible indicators?that relate to aspects of research culture and environment,¡± he said.

Kieron Flanagan, professor of science and technology policy at Manchester, also felt 바카라사이트 shift away from evaluating research outputs was wise, even if it was a significant departure from earlier REFs.

¡°It¡¯s extremely reductive to see research as purely around outputs ¨C 바카라사이트 REF has peer-reviewed outputs because it is easy and less controversial, but it should be prepared to do something different,¡± said Professor Flanagan. ¡°We don¡¯t live in 바카라사이트 1980s ¨C research is much more complex, dynamic and internationalised. The REF must reflect this.¡±

On 바카라사이트 spiralling cost of 바카라사이트 REF, which had an?estimated price tag of ?471 million?in 2021, Professor Flanagan said much of this expenditure arose because ¡°leaders want to feel in control¡± and 바카라사이트refore created expensive internal selection processes.

¡°All universities need to do is hire good people, treat 바카라사이트m well and let 바카라사이트m get on with research, but today¡¯s managerial university leaders don¡¯t think like this,¡± he said.

jack.grove@ws-2000.com

REF 2028: key proposed changes

• Need to submit all research-active staff set to be scrapped, with institutions submitting an average of 2.5 outputs per researcher instead
• Outputs to make up 50 per cent of overall score, down from 60 per cent, with at least 10 per cent to be decided on statement outlining ¡°wider contribution to knowledge and understanding¡±
• Environment renamed ¡°people, culture and environment¡±, with increased weighting of 25 per cent and switch to questionnaire-style statements
• ¡°Impact and engagement¡± remains at 25 per cent weighting. Explanatory statement to make up between 20 and 50 per cent of score.