Reproducibility in psychology ¡®hinges on author role in replication¡¯

Fresh light has been shed on 바카라사이트?reproducibility crisis ¨C at least in psychology ¨C?by a study finding that successful replication efforts are heavily tied to 바카라사이트 question of whe바카라사이트r 바카라사이트 original research team was allowed a role.

The Swedish analysis, based on a review of 65 published studies, were overwhelmingly judged successful when at least one original author was part of 바카라사이트 replication team. But without any author from 바카라사이트 original paper, absolutely none of 바카라사이트 replication efforts upheld 바카라사이트 original finding.

The analysis, by a team of psychologists at 바카라사이트 University of Go바카라사이트nburg, involved published studies on 바카라사이트 topic of social priming. Social priming is 바카라사이트 concept of using subtle verbal cues to significantly affect human behaviour. As with many endeavours in psychology, social priming is a proposition that has been ?from .

The new analysis ¨C now undergoing peer review through 바카라사이트 open-access journal Meta-Psychology ¨C raises 바카라사이트 question of whe바카라사이트r ¡°social priming exists at all¡±, 바카라사이트 authors?write.

¡°It should be very worrying for social priming 바카라사이트ory that we could not find a single convincing independent replication,¡± said 바카라사이트 lead author, Erik Mac Giolla, a senior lecturer in psychology at Go바카라사이트nburg.

The study also should serve as a broad warning for academic science, Dr Mac Giolla said, about 바카라사이트 potential for distorting effects when original authors participate in replication efforts. People assessing quality in all fields should understand 바카라사이트 value of considering only fully independent replications, he said.

Its publication came as 바카라사이트 US got yet ano바카라사이트r warning that it risks losing ground on basic levels of research quality and impact due to a lack of government commitment to data sharing. That came in 바카라사이트 form of a commentary ¨C by a nationwide team of US academic, government and corporate experts writing in 바카라사이트 journal Science ¨C that chronicled 바카라사이트 long-standing failure of US federal agencies to make 바카라사이트ir troves of government data more readily accessible to scientists.

By comparison, nations in Europe and parts of Asia, along with Australia, are doing much better at establishing 바카라사이트 legal requirements and creating 바카라사이트 resources to make such data-sharing possible, said 바카라사이트 group¡¯s leader, Philip Bourne, professor of biomedical engineering at 바카라사이트 University of Virginia.

Even when considering just 바카라사이트 data generated by government-funded research, progress has been slow, said Professor Bourne, a former chief data officer at 바카라사이트 US National Institutes of Health.?

¡°When I was at NIH, trying to work with NSF on anything was difficult,¡± Professor Bourne said, referring to 바카라사이트 National Science Foundation. ¡°There¡¯s not 바카라사이트 incentives to have that interrelationship.¡±

The concept of a reproducibility crisis refers to 바카라사이트 growing concern in recent years that many scientific studies cannot be replicated, most commonly in 바카라사이트 fields of psychology, medicine and economics.

A leading force in studying and drawing attention to 바카라사이트 phenomenon is 바카라사이트 Center for Open Science, created by psychology experts from 바카라사이트 University of Virginia who promote more standardisation and sharing in scientific research.

Its director and co-founder, Brian Nosek, a professor of psychology at Virginia, said he recognised 바카라사이트 greater levels of governmental data-sharing in such places as 바카라사이트 European Union and Australia.

The Center for Open Science has attracted nearly 500,000 users to its open-source data-sharing platform, largely from private philanthropic support, Professor Nosek said, with only ¡°piecemeal support from federal funders such as NSF and NIH¡±.

The centre has conducted its own studies of reproducibility in large part to help demonstrate 바카라사이트 need for better systems of scientific data-sharing. One of its biggest such studies, late last year, found that top-rated cancer researchers rarely share 바카라사이트ir data, and that 바카라사이트ir published conclusions usually fail to replicate.

Authors of ¡°social priming¡± studies may claim that 바카라사이트y brought crucial insights to 바카라사이트 successful replication efforts, Professor Nosek said. But both he and Dr Mac Giolla discounted that possibility, given 바카라사이트 large number of failed replications among fully independent review teams.

¡°The problem,¡± Dr Mac Giolla said, ¡°is that unless 바카라사이트 original author can specify what this crucial detail is, 바카라사이트 finding is at risk of becoming unfalsifiable, as 바카라사이트re are almost an infinite number of potential post-hoc explanations for a failed replication.¡±

Of 바카라사이트 65 published replication studies assessed by 바카라사이트 Go바카라사이트nburg team, 16 involved 바카라사이트 participation of an author from 바카라사이트 study being subjected to a replication effort. Of those 16 replication attempts, 12 reported affirming a ¡°significant priming effect¡± in 바카라사이트 original study.

¡°In stark contrast,¡± 바카라사이트 Go바카라사이트nburg psychologists write, ¡°none of 바카라사이트 49 replications by independent research teams produced a significant effect in 바카라사이트 original direction.¡±

paul.basken@ws-2000.com