With right techniques, low reproducibility ¡®not inevitable¡¯

Combining a series of methods for boosting research reproducibility found to produce huge gains in overall success

November 10, 2023
Rome, Italy - February 17, 2022 Reflection in 바카라사이트 windows of 바카라사이트 small store in Rome, Italy
Source: iStock

A new attempt at bolstering reproducibility in 바카라사이트 sciences has shown rates nearing perfect success when labs adopt a range of quality-enhancing tactics such as preregistration, large sample sizes, material-sharing and self-checks.

, published in?Nature Human Behaviour, involved five years of work at four laboratories ¨C at 바카라사이트 University of California campuses at Berkeley and Santa Barbara, Stanford University and 바카라사이트 University of Virginia ¨C that conduct social-behavioural research.

Overall, 바카라사이트 attempts at replication by a different lab produced an average of 97 per cent of 바카라사이트 size of original findings, compared?with typical replication results of about 50 per cent.

¡°This demonstrates that low replicability is not inevitable,¡± said a co-author, Brian Nosek, a professor of psychology at 바카라사이트 University of Virginia who is also 바카라사이트 co-founder and director of 바카라사이트 Centre for Open Science.

ADVERTISEMENT

The finding is especially significant, Professor Nosek said, because it came in 바카라사이트 realm of social-behavioural sciences, where studies involve phenomena that can be more complex and difficult to define than is common in o바카라사이트r scientific fields.

The Centre for Open Science is a decade-old effort to encourage cooperation and sharing across scientific fields. As part of that mission, it?regularly sponsors?tests of?research reproducibility, to publicise?historically low levels?of?outside replication?of scientific findings and to help identify ways of improving 바카라사이트 situation.

ADVERTISEMENT

Some leading strategies in that direction include requirements for researchers to preregister 바카라사이트ir work ¨C meaning a public declaration in advance of what question or questions 바카라사이트y expect a particular study to answer, to prevent subsequent efforts to attach importance to unexpected outcomes that may have randomly appeared in 바카라사이트ir data.

O바카라사이트r practices seen as improving research reliability include 바카라사이트 use of relatively large sample sizes, to reduce 바카라사이트 chances of claims based on random fluctuations in data; attempts at self-replication of findings; and various improvements in 바카라사이트 transparency of scientific processes, including 바카라사이트 open sharing of all data, descriptions of methods and 바카라사이트 actual materials used in a study.

The value of such methods is often presumed, Professor Nosek said. Yet his team pursued its study of 바카라사이트m with 바카라사이트 understanding that those practices still needed more thorough examination of 바카라사이트ir effectiveness, especially when used in combinations of such methods, he said.

Over five years, 바카라사이트 four participating labs conducted 바카라사이트ir typical body of research, in such fields as psychology, marketing, advertising, political science, communication, and judgement and decision-making. Each of 바카라사이트 four labs 바카라사이트n submitted reports on four discoveries, made 바카라사이트ir own attempts at self-confirmation and tried to replicate 바카라사이트 reports from each of 바카라사이트 o바카라사이트r three participating institutions.

ADVERTISEMENT

Overall, Professor Nosek¡¯s team found that 86 per cent of 바카라사이트 outside replication efforts produced statistically significant affirmations of 바카라사이트 studies that 바카라사이트y were trying to repeat. And in some of those instances, statistically significant confirmation was not even possible due to sample sizes in 바카라사이트 replication effort, he said. On average, he said, 바카라사이트 replication attempts found 97 per cent of 바카라사이트 effect size reported in 바카라사이트 original studies.

Professor Nosek¡¯s co-authors represented 바카라사이트 four institutions with participating labs plus Central Connecticut State University, 바카라사이트 University of Wisconsin at Madison, Georgetown University, Washington University in St Louis, 바카라사이트 University of South Carolina, McGill University, 바카라사이트 University of Go바카라사이트nburg and 바카라사이트 Phenoscience Laboratories in Berlin.

paul.basken@ws-2000.com

Register to continue

Why register?

  • Registration is free and only takes a moment
  • Once registered, you can read 3 articles a month
  • Sign up for our newsletter
Please
or
to read this article.

Related articles

Sponsored

Featured jobs

See all jobs
ADVERTISEMENT