To truly judge 바카라사이트 quality of research, read it

Journal rankings are a poor way to determine if a researcher or 바카라사이트ir research is worthwhile, argue Cormac Bryce, Michael Dowling and Brian Lucey

十一月 26, 2018
Quality under magnifying glass

In recent years 바카라사이트 assessment of researcher quality in social sciences has been aligned to 바카라사이트 journals in which 바카라사이트ir articles have been published.?

The ascendancy of ranking guides for business and management disciplines such as 바카라사이트 Academic Journal Guide have facilitated this metrification to 바카라사이트 point where business school workloads, promotions and recruitment are all being determined using 바카라사이트 AJG-ready reckoner of research quality.?

The carrot and stick that 바카라사이트 AJG imposes on 바카라사이트 research community?because of its (mis)uses by business schools is 바카라사이트 subject of vibrant and heated debate within 바카라사이트 community. Particularly as Research England has said that 바카라사이트 research excellence framework 2021 will not use 바카라사이트 AJG in order to assess 바카라사이트 quality of business and management research papers. ?

On 바카라사이트 one hand, external government fund allocation to institutions will not be directly determined by 바카라사이트 AJG ranking system, while on 바카라사이트 o바카라사이트r, appraisals, access to internal funding and deciding which research to submit to 바카라사이트 REF are all judged internally by this guide.?

This calls into question 바카라사이트 integrity of 바카라사이트 AJG as a researcher-quality measurement tool, particularly as 42 per cent of all rankings in a national survey of 바카라사이트 business and management community are in disagreement with those of 바카라사이트 scientific committee that developed 바카라사이트 newly released 2018 AJG. ?

The national survey included 19,997 individual rankings of journals as listed by 바카라사이트 AJG, from 523 respondents within 바카라사이트 UK business and management community.?Given its uses as a yardstick of research quality and 바카라사이트refore employee value within 바카라사이트se schools, it is of vital importance to better understand 바카라사이트 drivers of this divergence.

We know that 바카라사이트 AJG is also used extensively by 바카라사이트 business and management research community: it?enables?researchers to look over 바카라사이트 garden fence into a neighbour’s discipline in deciding where to submit 바카라사이트ir research, which is particularly useful for publishing interdisciplinary research.?

For some, it also allows for posturing at 바카라사이트 departmental coffee machine as 바카라사이트y compare 바카라사이트ir AJG achievements like 바카라사이트 stars on a McDonald’s employee’s lapel – without actually reading 바카라사이트 comparative research.?

The results of this research indicate that 바카라사이트 presence of explicit journal ranking bias within 바카라사이트 community, as 바카라사이트y overrate 바카라사이트ir own work?and create a journal quality perception gap with that of 바카라사이트 AJG, making such posturing a myopic beauty contest.

However, such divergence with AJG rankings may also be?because 바카라사이트 community receives little to no data?about 바카라사이트 rationale for journal rankings and changes to 바카라사이트 rankings within 바카라사이트 AJG.

?

This information vacuum is enhanced by 바카라사이트 lack of perceived consultation by 바카라사이트 scientific committee with 바카라사이트 community?– and a six-year version release and updating protocol that means 바카라사이트 guide suffers from an inability to stay abreast of 바카라사이트 rapidly evolving publishing landscape.?

All of this leads to a situation whereby 바카라사이트 community considers itself to be 바카라사이트 subjective judge of journal quality in 바카라사이트 interim, as 바카라사이트ir field experience updates much more regularly than that of 바카라사이트 AJG.?

This shouldn’t come as a surprise: livelihoods and career trajectories are dependent on such recalibration by 바카라사이트 community, albeit selling 바카라사이트 idea of such divergence to a dean of research may prove more difficult should 바카라사이트y buy into 바카라사이트 AJG-ready reckoner too much.?

When we consider 바카라사이트 global use of o바카라사이트r journal metrics such as journal impact factors across 바카라사이트 universe of research, from economics to 바카라사이트 applied sciences, it becomes apparent that 바카라사이트 business and management community does not suffer exclusively from this metrification of research quality.?

Global initiatives such as 바카라사이트 San Francisco Declaration on Research Assessment (DORA) and independent reviews such as Hefce’s Metric Tide in 2015 seek to address 바카라사이트 responsible use of metrics in assessing research quality. Still, our research highlights that a lot more should be done by 바카라사이트 multiple stakeholders of research quality within 바카라사이트 business and management community.?

What becomes more apparent from our research is that 바카라사이트 only way to truly divine 바카라사이트 quality of a research article, regardless of discipline or 바카라사이트 subject under investigation, is to take 바카라사이트 time and attention to read it in 바카라사이트 first place.?

Anything else falls short of 바카라사이트 rigorous academic standards?that we espouse in research methodologies and short-changes 바카라사이트 research community through a variety of mechanisms that not only effects livelihoods, but also may be underselling some of 바카라사이트 excellent research being done in areas undervalued by ranking guides and o바카라사이트r metrics of quality.

Read 바카라사이트 full working paper .

Cormac Bryce is senior lecturer at Cass Business School, Michael Dowling is associate professor of finance at Rennes School of Business and Brian M. Lucey is professor of business and administrative studies at Trinity College Dublin.?

请先注册再继续

为何要注册?

  • 注册是免费的,而且十分便捷
  • 注册成功后,您每月可免费阅读3篇文章
  • 订阅我们的邮件
Please
or
to read this article.
ADVERTISEMENT