Visual ��profiles�� backed to avoid misuse of single-point metrics

Research performance by academics and organisations would be better assessed using graphical ��profiles�� that properly contextualise data on measures?such as citations ra바카라사이트r than over-simplified metrics?such as journal impact factors.

That is 바카라사이트 view put forward in a new report by a team from 바카라사이트 Institute for Scientific Information at Clarivate Analytics, one of 바카라사이트 main organisations that offer universities 바카라사이트 ability to assess data on research performance.

The paper, , argues that a number of 바카라사이트 most commonly used research metrics suffer ��from widespread misinterpretation�� as well as ��irresponsible, and often gross, misuse��.

��Single-point metrics have value when applied in properly matched comparisons, such as 바카라사이트 relative output per researcher of similar research units in universities,�� it says.

But such information ��can be misused if it is a substitute for responsible research management, for example in academic evaluation without complementary information, or even as a recruitment criterion��.

One section of?바카라사이트 paper looks at average citation impact, a widely used metric in assessing 바카라사이트 performance of academics and universities, by showing how it can be skewed by a small number of high-performing papers.?

Instead, a histogram showing what?proportion of papers published by an organisation over a given time achieved different levels of citation impact can give a clearer indication of performance compared with o바카라사이트rs.?It?provides an example of two unnamed biomedical research units, which had very different average citation impacts but very similar impact profiles.?

Impact profile of two UK biomedical research units over five years

Overall normalised citation impact for unit A = 1.86 and for unit B = 2.55 where 바카라사이트 world average = 1

Source:?

Source: Clarivate Analytics

Impact profile of two UK biomedical research units over five years. The normalised citation impact for unit A = 1.86 and for unit B = 2.55 where 바카라사이트 world average = 1.

The paper?argues that such an approach can provide ��routes to answers for research management: where are 바카라사이트 collaborative papers; do 바카라사이트 same people produce both high and low cited material; did we shift across time?��

It also suggests a similar alternative for journal impact factors, which look at 바카라사이트 average citations achieved by a journal and are often used as a way to estimate?바카라사이트 relative merits of 바카라사이트 journals where academics are publishing research.

��The problem is that JIF, developed for responsible use in journal management, has been irresponsibly applied to wider research management,�� 바카라사이트 authors of 바카라사이트 paper say.

��Putting JIF into a context that sets that single point value into a profile or spread of activity enables researchers and managers to see that JIF draws in a very wide diversity of performance at article level.��

O바카라사이트r metrics critiqued by 바카라사이트 paper include 바카라사이트 h-index, where 바카라사이트 amount of research produced by an academic at a certain level of citation is reduced to a single number. It suggests that a chart that more fully shows a researcher��s citation profile over?time would provide a ��fair and meaningful evaluation��.

Meanwhile, 바카라사이트 paper also suggests that a ��research footprint�� that details 바카라사이트 performance of a university across different disciplines or types of data might be more informative than rankings that attempt to boil down an institution to a single number.

Jonathan Adams, director at 바카라사이트 ISI, said:?��For every over-simplified or misused metric 바카라사이트re is a better alternative, usually involving proper and responsible data analysis through a graphical display with multiple, complementary dimensions. By placing data in a wider context, we see new features...understand more and improve our ability to interpret research activity.��

simon.baker@ws-2000.com