Papers that get more media coverage ¡®less likely to replicate¡¯

The more media coverage that an academic paper gets, 바카라사이트 less likely its findings are to be successfully replicated, according to a study focused on psychology scholarship.

The study, published in 바카라사이트 on 30?January, says that ideally ¡°media should cover credible and rigorous research. Yet in reality, 바카라사이트 mainstream media tends to highlight research that finds surprising, counterintuitive results.¡±

¡°Media attention and replication success are negatively correlated,¡± it concludes.

Building on smaller, previous studies that found that more surprising findings were less likely to replicate, 바카라사이트 research examined more than 14,000 psychology papers, covering nearly every paper published over 바카라사이트 past 20 years across six subfields in six top-tier journals.

Academics at Northwestern University, 바카라사이트 University of Notre Dame and UCL developed a machine learning model that predicted 바카라사이트 likelihood of replication based on a paper¡¯s text and was found to have a level of accuracy on a par with ¡°prediction markets¡± of academics estimating a paper¡¯s replicability ¨C a method that has in itself been shown to be a good match for manual replication tests.

¡°The media plays a significant role in creating 바카라사이트 public¡¯s image of science and democratising knowledge, but it is often incentivised to report on counterintuitive and eye-catching results,¡± write Brian Uzzi, Wu Youyou and Yang Yang.

¡°Deciding a paper¡¯s merit based on its media coverage is unwise. It would be valuable for 바카라사이트 media to remind 바카라사이트 audience that new and novel scientific results are only food for thought before future replication confirms 바카라사이트ir robustness.¡±

The results also showed that 바카라사이트 prestige of an author¡¯s university and a paper¡¯s citation rate have no association with replicability in psychology.

However, it did find that replicability is positively correlated with researchers¡¯ experience and competence, based on 바카라사이트ir publication and citation record.

The study also found that experimental work replicated at significantly lower rates than non-experimental methods, which it described as ¡°worrisome¡± given that psychology¡¯s scientific reputation ¡°is built, in part, on its proficiency with experiments¡±.

Manual replications are critical but too expensive to do on a large scale, said Professor Uzzi, a professor of leadership at Northwestern.

¡°Our work provides 바카라사이트 first population-level replication study across subfields of psychology, methods, journals and authorship characteristics that promotes better manual replication and science policy strategies,¡± he said.

Last year a study found that manual replication studies in psychology were more likely to be successful when a member of 바카라사이트 original research team played a part, raising concern about possible distorting effects.

patrick.jack@ws-2000.com