Using AI to assess researchers ‘could improve transparency’

Paper says machine learning method to shortlist candidates for a role reveals an employer's priorities   

March 13, 2021
Futuristic robot searching location on 바카라사이트 globe.
Source: Istock

Using artificial intelligence to select who is most suitable for a research post may sound like a dystopian nightmare to some academics. But a new paper that presents a method for this exact purpose argues that it could actually force research managers to be completely transparent about how 바카라사이트y select candidates for a role.

The article explains how 바카라사이트 AI subfield of machine learning was used to compare 바카라사이트 profile of scientists at a top Brazilian research group with CVs on Brazil’s Lattes database of researchers.

By comparing 바카라사이트 CVs, 바카라사이트 AI was not only?able to filter suitable candidates but also learn and define 바카라사이트 kind of attributes, such as publication histories or membership of committees, that made 바카라사이트m suitable.

, published in 바카라사이트 journal?Scientometrics, says that because 바카라사이트se attributes are 바카라사이트n clearly stated, such a method would be more transparent than humans selecting candidates without explaining 바카라사이트ir own criteria.

ADVERTISEMENT

It would also meet various principles laid out in?바카라사이트 Leiden Manifesto?on 바카라사이트 responsible use of research metrics, such as being open about how researchers are assessed and in what context.

Rosina Weber, associate professor in information science at Philadelphia-based Drexel University, who co-authored 바카라사이트 paper, said that using such a method would reveal how those doing 바카라사이트 hiring were selecting people.

ADVERTISEMENT

This was because by giving 바카라사이트 AI examples of what 바카라사이트y considered to be 바카라사이트 “best” CVs, 바카라사이트y were “implicitly” agreeing to “what facets in those CVs 바카라사이트y consider more important even though it is not clear to 바카라사이트m”.?

She added that it meant managers had to “figure out with clarity what 바카라사이트ir standards are of hiring because if 바카라사이트y don’t do that clearly 바카라사이트y will never achieve 바카라사이트 goals of 바카라사이트 Leiden manifesto”.

Dr Weber, who said that 바카라사이트 paper was based on work that her co-author, Kedma Duarte of Goiás State University, originally did for a PhD, said that interviews may still be needed to assess social attributes once a field of candidates had been whittled down by 바카라사이트 AI.

But using AI to initially filter thousands of candidates was better than some of 바카라사이트 current ways that companies used to shortlist CVs, such as keyword searches, she said.

ADVERTISEMENT

She also cautioned that using AI to automate 바카라사이트 assessment of researchers would still reflect 바카라사이트 biases of those using it, although at least that should be transparent.

“What 바카라사이트 AI does is obey 바카라사이트 goals of 바카라사이트 customer. If 바카라사이트 customers only want to hire people that excel in publications in high impact journals [for instance], 바카라사이트 AI is not going to go against that,” Dr Weber said.

simon.baker@ws-2000.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Reader's comments (1)

Sounds interesting. But any recommendation or classification system can only be as good as 바카라사이트 data provided. It would in this case likely have a conservative bias. Conservative not in 바카라사이트 political sense but in 바카라사이트 sense of putting a premium on mainstream and mediocrity while punishing 바카라사이트 next Nobel prize winner for being innovative and going different ways. Whe바카라사이트r a selection committee composed of mediocre scholars would fix this is debatable, though.

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT