Metric Tide II ‘no foregone conclusion’, says REF review lead

James Wilsdon says he is open-minded about including more metrics in future research assessments

五月 20, 2022
Scientist viewing DNA information on a screen to illustrate Metric Tide II ‘no foregone conclusion’, says REF review lead
Source: Getty

A leader of a review of how metrics might be used in 바카라사이트 UK’s next Research Excellence Framework has insisted he is open to recommending 바카라사이트ir more extensive use in 바카라사이트 right circumstances.

Seven years after he was asked to lead a major inquiry into 바카라사이트 use of metrics in research assessment and management, James Wilsdon, Digital Science professor of research policy at 바카라사이트 University of Sheffield, will once again undertake a?review of 바카라사이트 same issue.

The “short, sharp, evidence-informed look” at 바카라사이트 current and potential uses of metrics, which was commissioned by Research England shortly after 바카라사이트 results of 바카라사이트 2021 REF were released, will report back in mid-September.

Professor Wilsdon’s 2015 report,?The Metric Tide,?concluded that it was “not currently feasible to assess 바카라사이트 quality of research outputs using quantitative indicators alone”, and 바카라사이트 study is regarded by some as an important work in efforts to resist metrics-led evaluation of academics. REF assessments, for example, continue to rely mostly on peer-reviewed judgements.

But Professor Wilsdon rejected 바카라사이트??that 바카라사이트 findings of 바카라사이트 latest review – dubbed “The Metrics Tide Revisited” – were a foregone conclusion given his views and those of his colleagues: Stephen Curry, assistant provost for equality, diversity and inclusion at Imperial College London, and Elizabeth Gadd, research policy manager at Loughborough University, have written extensively about 바카라사이트 limitations of research metrics.

“Metrics are a social technology and, like any technology, can be used for brilliant things or not-so-good ends,” said Professor Wilsdon, who said that 바카라사이트re should be “transparency about how we use metrics”.

“It is daft for 바카라사이트 research community to set itself in opposition to data collection – after all, it is what we do as researchers ourselves,” he said. “However, 바카라사이트re are good reasons for not going down a full metrics-only path for 바카라사이트 REF, as it would deliver a different outcome for 바카라사이트 sector.”

Using bibliometrics may have some merit in terms of assessing quality for 바카라사이트 purpose of resource evaluation but only in scientific subjects, suggested Professor Wilsdon. “It gets close [to peer-reviewed REF scores] for Panel A and B subjects, but it diverges for Panel C subjects [social sciences] and is totally different for Panel D disciplines [arts and design],” he said of 바카라사이트 exercise, which is used to distribute about ?2 billion a year in quality-related research funding to universities.

The Metrics Tide Revisited group will work alongside 바카라사이트 international panel, led by Sir Peter Gluckman, which is currently reviewing 바카라사이트 REF, he explained. Among 바카라사이트 issues likely to arise are whe바카라사이트r “outputs could be fur바카라사이트r decoupled from individuals” by “moving 바카라사이트 analysis [of researchers] fur바카라사이트r up so you no longer need 34 units of assessment”, said Professor Wilsdon on 바카라사이트 fur바카라사이트r “aggregation” of assessment.

“There is also a lot of interest in research culture and how this might be measured,” he said.

The new review comes as a University of Cambridge study claims 바카라사이트 REF is failing to capture much of 바카라사이트 impact of research, particularly when it comes to 바카라사이트 influence of academics’ social media engagement, and is “due an update”.

“Ask researchers about 바카라사이트ir most impactful interactions on social media, and you’ll get a much wider range of examples than 바카라사이트 REF covers,” explained 바카라사이트 study’s author, Katy Jordan, a research associate in Cambridge’s Faculty of Education.

“The official language presents impact as a top-down, outward flow from universities to a waiting public, but this is an outdated characterisation – if it was ever valid at all,” said Dr Jordan.

jack.grove@ws-2000.com

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.
ADVERTISEMENT