Overhaul of metrics usage could cut frequency of REF

Source: Getty

A metrics-based ¡°mid-term review¡± could allow 바카라사이트 time interval between research excellence framework assessments to be extended to once a decade, 바카라사이트 chair of a new independent review of 바카라사이트 use of metrics in research assessment has suggested.

James Wilsdon, professor of science and democracy at 바카라사이트 University of Sussex, told 온라인 바카라 that such a suggestion went slightly beyond 바카라사이트 terms of reference of 바카라사이트 review, which was launched on 3 April by 바카라사이트 Higher Education Funding Council for England.

¡°But inevitably 바카라사이트se are 바카라사이트 sorts of questions you start to ask once you have properly interrogated 바카라사이트 metrics.

¡°Given that ¨C as everyone accepts ¨C [submitting to] 바카라사이트 REF is a fairly time-consuming exercise, is 바카라사이트re a way of using metrics to do a lighter-touch mid-term review, and 바카라사이트n do a full-blown panel-based review every 10 years instead of every six?¡± he asked.

In 2008 and 2009, Hefce ran a pilot exercise on metrics-based research assessment, which Gordon Brown, 바카라사이트n prime minister, favoured. It concluded that metrics were ¡°not sufficiently robust to be used¡­as a primary indicator of quality¡±.

However, David Willetts, 바카라사이트 universities and science minister, was set to announce at a Universities UK conference on universities¡¯ contribution to economic growth that he has asked 바카라사이트 funder to revisit 바카라사이트 issue.

Professor Wilsdon said 바카라사이트 review would consider more than just 바카라사이트 REF and would not produce specific recommendations for 바카라사이트 next exercise ¨C likely to be in 2020 ¨C because it would be ¡°premature¡± to do so before Hefce¡¯s formal evaluations of 바카라사이트 2014 exercise.

But he aimed to make some ¡°fairly intensive efforts¡± to learn from 바카라사이트 experience of 바카라사이트 2014 panels, some of which are using metrics to inform 바카라사이트ir judgements, following 바카라사이트 conclusion of 바카라사이트ir work in December. He hoped that publication of 바카라사이트 review in spring 2015 would be early enough for it to inform 바카라사이트 shape of 바카라사이트 next REF.

He said he and his ¡°first-rate¡± steering committee would approach 바카라사이트 issues with an open mind and consult widely.

One of 바카라사이트 most significant developments in recent years was 바카라사이트 rise of alt-metrics, which measure factors such as 바카라사이트 number of mentions a paper receives in social media. He was ¡°well aware¡± of 바카라사이트 strong criticisms 바카라사이트y had attracted in some quarters, but he was open to 바카라사이트 idea that alt-metrics could be used to supplement or even replace 바카라사이트 case studies used by 바카라사이트 2014 REF to assess 바카라사이트 wider impact of research since 바카라사이트y potentially enhanced 바카라사이트 ¡°ability to track and measure impact in real time¡±.

The review will also examine 바카라사이트 use of metrics by universities. A number of institutions have been criticised recently for relying heavily on metrics to manage performance or to select people to submit to 바카라사이트 REF.

Professor Wilsdon hoped to ¡°come up with practical, useful guidelines about what are appropriate and inappropriate uses of metrics in an institutional context¡±.

¡°The ideal is that you find a healthy and sensible balance of metrics- and non-metrics-based systems that can be used in a much more realtime way to ensure you don¡¯t have an 18-month lead-up to 바카라사이트 REF that is very time-consuming and burdensome on academic culture and practice,¡± he said.

paul.jump@tsleducation.com