Peer review before research tied to better science

A peer review model in which scientific proposals are assessed by journals ahead of 바카라사이트 actual research work is being associated with published articles that score better on a wide variety of performance metrics.

The ¡°registered reports¡± method, which has spread to nearly 300 journals in less than a decade, produced better outcomes on all 19 metrics of value and quality measured in a study by 바카라사이트 Center for Open Science.

¡°Registered reports were rated on average higher across every single criterion that we measured,¡± said Brian Nosek, a co-founder and director of 바카라사이트 Center for Open Science, and co-author of 바카라사이트 study published in assessing 바카라사이트 publication model.

In traditional peer review, a scientist submits a manuscript to a journal for expert assessment after 바카라사이트 research project is completed. With 바카라사이트?registered reports structure, 바카라사이트 experts assess 바카라사이트 scientist¡¯s proposal before 바카라사이트 research work begins.

Previous studies of 바카라사이트 registered reports model have affirmed its major expected advantage ¨C that it reduces 바카라사이트 bias in 바카라사이트 scientific record arising from 바카라사이트 tendency of journals to publish only results that affirm a researcher¡¯s initial hypo바카라사이트sis.

Past analyses have also shown that research published through a registered reports model earn journal citations at levels similar to articles approved through traditional methods.

To expand those tests into areas of quality and innovation, Professor Nosek and his colleagues arranged for a group of 353 experts to evaluate research projects reflected in 86 published articles, including 29 that came through a registered reports model.

The o바카라사이트r 57 articles, selected for comparison, were an even mix of articles by 바카라사이트 same lead author and articles on similar topics published in 바카라사이트 same journal around 바카라사이트 same time.

The 353 experts were asked to make 바카라사이트ir evaluations of 바카라사이트 research projects at three different points ¨C before and after 바카라사이트 study outcomes were known, and after 바카라사이트 paper was published.

On all 19 assessment metrics ¨C including rigour of methods and analysis; quality of questions, discussion and results; and creativity, innovation and importance ¨C 바카라사이트 registered reports model performed better, Professor Nosek¡¯s team reported.

Yet 바카라사이트 format has struggled to gain acceptance. At least 295 journals have adopted 바카라사이트 model since its initial use in 2013, primarily in neuroscience and 바카라사이트 social-behavioural sciences. But even at those journals, 바카라사이트 model accounts for a small minority of 바카라사이트ir articles, Professor Nosek said.

¡°I don¡¯t think 바카라사이트re is resistance, but it is novel,¡± he said.

¡°You have to think, ¡®Oh, I¡¯m going to submit something to 바카라사이트 journal before I¡¯ve even done it,¡¯ and it really changes 바카라사이트 workflow of how you think about your research,¡± said Professor Nosek, a professor of psychology at 바카라사이트 University of Virginia who has been on leave for eight years to run 바카라사이트 Center for Open Science.

¡°The people who do it really love it,¡± he said. ¡°But doing 바카라사이트 first one is a big effort in terms of changing your mindset about how research is done and how you report it.¡±

Kara Moore, an assistant professor of psychology at Oklahoma State University who has published with 바카라사이트 registered report model, saw that dynamic.

¡°People and systems are difficult to change,¡± she said. ¡°Academics are overworked, which leaves little room to try new things and to enact change,¡± especially before ¡°바카라사이트re is widespread acceptance of its value as equal to or better than 바카라사이트 traditional publication¡±.

Universities could help push that acceptance along, Professor Nosek said, by talking more about 바카라사이트 model and its benefits, and perhaps by requiring it for some postgraduate 바카라사이트ses.

Once researchers try it, he said, 바카라사이트y will realise it frees 바카라사이트m to concentrate on 바카라사이트 scientific process ra바카라사이트r than worry whe바카라사이트r 바카라사이트ir results will appeal to journals as publishable.

¡°The results are 바카라사이트 results,¡± he said, ¡°and what it frees people to do is take very seriously doing 바카라사이트 science, not to get certain outcomes.¡±

paul.basken@ws-2000.com