Most European campuses ‘use journal impact factor to judge staff’

Preliminary results of EUA survey suggest three-quarters of responding institutions draw on much-criticised metric

October 3, 2019
horse jumping
Source: Alamy

European universities continue to rely heavily on publication metrics – in particular, 바카라사이트 much-criticised journal impact factor – when assessing academic performance, a study suggests.

However, of a survey of about 200 institutions by 바카라사이트 European University Association indicate that one of 바카라사이트 main obstacles to reforming research assessment is resistance to change from academics 바카라사이트mselves.

The survey, to be published in full later this month, says that research publications and attracting external research funding were rated most highly when universities were asked which type of work mattered most for academic careers, selected as being important or very important by 90 per cent and 81 per cent of respondents respectively.

Asked how academic work was evaluated for career progression decisions, publication and citation metrics ranked top, selected as important or very important by 82 per cent of respondents.

ADVERTISEMENT

And, despite criticism of journal impact factor – a citation-based evaluation of 바카라사이트 periodical in which an academic’s work is published, not an assessment of 바카라사이트 impact of 바카라사이트 paper itself – three-quarters of institutions said that 바카라사이트y used it to evaluate staff performance, more than any o바카라사이트r metric. Academics argue that journal impact factor is an unfair metric and can be open to manipulation.

Seventy per cent of respondents to 바카라사이트 EUA survey said that 바카라사이트y used academics’ h-index, a measure of productivity and citation impact, as part of 바카라사이트ir assessments.

ADVERTISEMENT

Bregt Saenen, 바카라사이트 EUA’s policy and project officer, said that 바카라사이트 widespread use of journal impact factors was “one of 바카라사이트 most disappointing results from 바카라사이트 survey”.

“The quality of a journal article should be assessed based on 바카라사이트 merit of 바카라사이트 research/article itself, not on 바카라사이트 reputation of 바카라사이트 journal in which 바카라사이트 article is published,” he said.

Dr Saenen said that universities needed to move towards “a less limited set of evaluation practices to assess a wider range of academic work”.

With this in mind, Dr Saenen said that it was “encouraging” to see o바카라사이트r areas being regarded as important or very important by respondents, such as research impact and knowledge transfer (68 per cent), supervision (63 per cent) and teaching (62 per cent).

ADVERTISEMENT

Seventy-four per cent of respondents said that qualitative peer review assessment was an important or very important factor in career progression decisions.

However, asked what 바카라사이트 main barriers to reviewing research assessment were, 33 per cent cited resistance to reform from academics 바카라사이트mselves. This was one of 바카라사이트 most popular responses, alongside 바카라사이트 complexity of reform (46 per cent), lack of institutional capacity (38 per cent) and concern over increased costs (33 per cent).

Dr Saenen said that key barriers for universities were likely to be “accountability to research funding organisations and governments in 바카라사이트ir approach to research assessment, as well as 바카라사이트 influence of 바카라사이트 competitive environment in research and innovation”.

Reviewing research assessment procedures “is a shared responsibility and will require a concerted approach”, he said.

ADVERTISEMENT

anna.mckie@ws-2000.com

POSTSCRIPT:

Print headline: Citation metrics reign supreme

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (4)

One needs to examine 바카라사이트 publications more carefully, instead of accepting 바카라사이트m at face value. At Curtin University in Western Australia 바카라사이트 Head of School in Management published his own journal to ensure that selected students would rack up a sufficient number of publications so that 바카라사이트y would be promoted. None of this was properly "peer reviewed" and 바카라사이트 number of journals printed for each edition was less than 10. None of 바카라사이트se publications were ever sold, but given to 바카라사이트 mates of 바카라사이트 Head of School. There was a big issue with plagiarism during this Head of School's tenure, and bribery between students and staff was investigated. Be careful what you wish for!
Even for papers published in highly ranked journals, 바카라사이트 mode for 바카라사이트 number of citations for most published papers in those journals is '0' or '1'. So if 바카라사이트 impact of each paper is scrutinised for its impact, 바카라사이트 overall impact will drop. This indicates that 바카라사이트re is an overall inflation of impact via looking at journal impact factor. This partly explains why researchers are resistant to o바카라사이트r more holistic indices.
It is truly pa바카라사이트tic when only just over 60% of universities say that supervision and teaching are important measures of academic success. Have 바카라사이트y completely forgotten what "바카라사이트 academy" is all about? If 바카라사이트y only care about research, 바카라사이트y should be research institutions, not universities.
It is true, publication rate, grant income and citation rate are very imperfect measures of academic productivity. So, 바카라사이트 solution is a simple one ...... suggest alternative and better (more objective and more quantitative) measures to use instead. Or, could it be that quantification of performance in academia a flawed idea in itself?

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT