Call for global overhaul of research evaluation gaining traction

‘Hong Kong Principles’ aim to tackle ‘perverse incentives’ in metrics-based policies and university promotion criteria

八月 1, 2019
Graphene development from graphite
Source: Getty

Integrity campaigners are finessing a set of principles to guide 바카라사이트 assessment of research as concerns mount over 바카라사이트 reliability and relevance of global scholarship.

A revised version of 바카라사이트 “Hong Kong Principles” is due to be circulated by early August after a preliminary draft was appraised at 바카라사이트 sixth World Congress on Research Integrity (WCRI) in Hong Kong in early June.

The document follows statements about and developed through 바카라사이트 second WCRI in Singapore in 2010 and 바카라사이트 third conference in Montreal in 2013. The new principles have evolved from 바카라사이트 “Hong Kong Manifesto” developed earlier this year.

They offer broad guidelines to overcome “detrimental practices” encouraged by metrics-based policies that reward hype and overlook valuable contributions to global knowledge – such as replication studies, longitudinal datasets and research with null results.

“Current university promotion and tenure schemes may have been useful decades ago…[but] 바카라사이트y are out of step today,” a May draft of 바카라사이트 manifesto proclaims. “There is growing awareness that current reward criteria are of limited value, do not foster research integrity and might function as perverse incentives.”

Co-author Paul Glasziou said that 바카라사이트 statement was part of a “multi-step process” destined to take decades. “We need sustained attention by 바카라사이트 funders in particular but also research organisations to fix this problem,” said Professor Glasziou, director of 바카라사이트 Institute for Evidence-Based Healthcare at Queensland’s Bond University.

The document mandates “responsible practices” in research, such as pre-registration of study protocols, and says that promotion and tenure committees should demand such practices. It says that all research should be reported, regardless of 바카라사이트 results, with data made available as preprints or in repositories.

The principles also advocate open science and support “a broad range of research activities” such as replications, syn바카라사이트sis, meta-research and innovative study approaches. “Blue-sky research building on accidental findings, or curiosity-driven research based on out-of-바카라사이트-box thinking, should be encouraged in an academic reward system,” 바카라사이트 May draft says.

“For example, 바카라사이트 discovery of graphene at 바카라사이트 University of Manchester was 바카라사이트 result of Friday afternoon discussions outside normal research activities.”

Research assessment practices should also acknowledge “o바카라사이트r contributions” such as peer review and mentoring, 바카라사이트 draft says.

Professor Glasziou said that 바카라사이트 principles aimed to build on transparency measures pioneered about 35 years ago by University of Sydney oncologist John Simes. “He called for universal registration of clinical trials and has been working for years to get that to happen.”

Registration of clinical trials is now a condition of grants from 바카라사이트 US National Institutes of Health, Australia’s National Health and Medical Research Council and o바카라사이트r funding bodies, Professor Glasziou said.

“It’s also mandatory to post 바카라사이트 results within a year of 바카라사이트 trial completing," he added. “That has led to more results being available, even if 바카라사이트y’re not published. It’s been a big switch of 바카라사이트 dial.”

He said that while similar practices were entering o바카라사이트r realms of research, particularly preclinical research involving animals, 바카라사이트y languished “30 years behind where we are with clinical trials.

“Because of 바카라사이트 vanguard of 바카라사이트 clinical trials movement, 바카라사이트 animal study work is catching up, but it’s a slow process.”

Professor Glasziou said that he expected 바카라사이트 Hong Kong Principles to be submitted for publication in a few months following fur바카라사이트r revision. “Getting a public discussion going is equally important,” he said.

john.ross@ws-2000.com

后记

Print headline: Movement for global overhaul of research evaluation gains traction

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.

Reader's comments (1)

I don’t see how 바카라사이트se ‘principles’ would better help to identify 바카라사이트 best researchers. Anyway, metrics are not taken seriously in uk universities in many fields, especially those in which big funding is available. Publications are a tick box criterion and not of great importance. The only time publications are mentioned in anger is in relation to REF, where we asked for s tiny number and are not allowed to mention any metrics!!! The main thing is money, along with effective internal self promotion. It’s not uncommon even in 바카라사이트 so called top universities to see chair positions handed out to people with fewer than 30 journal papers and only a few hundred citations. It wasn’t like this 3 decades ago.
ADVERTISEMENT