{"id":1374,"date":"2021-07-26T08:05:00","date_gmt":"2021-07-26T08:05:00","guid":{"rendered":"https:\/\/blogs.sussex.ac.uk\/psychology\/?p=1374"},"modified":"2021-07-26T11:11:11","modified_gmt":"2021-07-26T11:11:11","slug":"registered-reports-free-for-authors-and-readers","status":"publish","type":"post","link":"https:\/\/blogs.sussex.ac.uk\/psychology\/2021\/07\/26\/registered-reports-free-for-authors-and-readers\/","title":{"rendered":"Registered Reports free for authors and readers"},"content":{"rendered":"\n

By Prof Zoltan Dienes<\/p>\n\n\n\n

\"\"<\/a><\/figure>\n\n\n\n

In April we launched Peer Community In Registered Reports<\/a> (PCI RR), where a Registered Report in any discipline can be submitted (by linking to a preprint), and refereed, editorially evaluated and (potentially) eventually accepted  \u2013 \u201crecommended\u201d in PCI speak. The process and outcome are free to authors and free to readers. No institution need to pay a fee for these freedoms; freedoms we take to reflect the openness that is the sine qua non<\/em> of science. See here for a talk<\/a> by Corina Logan about PCI RR.<\/p>\n\n\n\n

Because PCI RR links to pre-prints, the recommended manuscript is not published by PCI RR (though you will have a citable PCI RR recommendation with a DOI). That means an author may (if they wish, though they may not) have the same manuscript published in a mainstream journal. Indeed, we have 19 PCI RR-friendly journals<\/a>, which guarantee acceptance of our recommended manuscripts without further peer or editorial review (given certain technical conditions are met, such as being in the right discipline and payment of any APCs that the journal would normally charge). Notice it is the author that has the choice of journal, reversing typical power arrangements.<\/p>\n\n\n\n

A Registered Report is an article type where in-principle acceptance (or rejection) of a manuscript occurs before results are known. This ordering of acceptance relative to results is aimed at dealing with various biases that can corrupt the scientific process<\/a>. When the chain of reasoning from theory to predictions and from data to predictions is constructed in light of the data, distortions can occur: for example, arbitrary predictions that do not actually follow from a theory can be stated (because they happen to match the data); or p-hacking or B-hacking (Bayes factor hacking) can be used to create pseudo-evidence for a preferred outcome. How many papers have you read where the \u201cpredictions\u201d at the end of the introduction seemed somewhat arbitrary with respect to theory and yet were strangely confirmed? How many correlations with small N were just significant? A further bias is avoided by Registered Reports: that of editors or reviewers rejecting a paper because they did not like the results. As Chris Chambers often puts it: what part of the scientific process should we never have control over? Yet what part of the scientific process often determines publication – and hence can make or break careers? The results.<\/p>\n\n\n\n

One advantage of the Registered Report is that reviewers and editors are collaboratively involved in designing the study \u2013 at a point in time when their expert advice can still be seriously considered and acted on if useful. Relatedly, once the procedure and analyses have been in principle accepted, a publication is virtually guaranteed. One does not have to chase various journals for months or years because of some aspect of the study that is regarded as weak by those asked to review. In my experience, the fact that advice from reviewers and the editors can inform all aspects of design and analysis (in the absence of knowledge of results), really does change the dynamics of the relation between authors, editor and reviewers.<\/p>\n\n\n\n

Do Registered Reports actually reduce bias? In a recent pre-registered study<\/a>, Registered Reports confirmed the stated predictions less than 50% of the time \u2013 yet matched non-Registered Reports confirmed predictions over 90% of the time. Further, Registered Reports are associated with a higher reproducibility<\/a> of main results from the original data than regular articles; and methodological rigour<\/a> and quality of Registered Reports are rated substantially higher than non-Registered Reports. I take all this to be preliminary evidence that Registered Reports do in practice reduce biases in the scientific process.<\/p>\n\n\n\n

PCI RR overcomes some weaknesses in the current way Registered Reports are managed in journals. As previously mentioned, Registered Reports are completely open and free in PCI RR. Notice this addresses some concerns about equity: financial resources arising from social status (because of race, gender, or institution) are not necessary for having one\u2019s research publicly recommended by the same Registered Reports editors who work for leading journals. (How easy is it for you to pay the APCs for prestigious journals?) PCI RR introduces some other unique key innovations.<\/p>\n\n\n\n

With a programmatic Registered Report<\/a>, a series of related studies can be accepted in principle before the results are in. Each of these studies can then be conducted without further ado, each potentially leading to its own paper. This considerably speeds the process by which a programme of research can be published as a series of Registered Reports.<\/p>\n\n\n\n

With a scheduled review<\/a>, the authors submit a short one-page template-based \u201csnapshot\u201d of their proposed study. The recommender then sends the snapshot to potential reviewers and organises the review process for a fixed future date nominated by the authors. During the intervening time the authors prepare the full manuscript. The aim is to substantially reduce the initial review time.<\/p>\n\n\n\n

We operate a graded system of bias control<\/a>. That means that while the full level of bias control applies to cases where the data does not yet exist, many of the benefits of the Registered Reports process may be still applicable even when the data exist \u2013 but for example, cannot be accessed yet; or can be accessed in principle but has not in fact yet been accessed by the researchers, and so on. In each case, we try to control bias as much as possible, while explicitly recognizing there are different risks in different situations.<\/p>\n\n\n\n

People interested in becoming a PCI RR Recommender<\/a> take a two-hour test after reading the extensive guidelines<\/a> for Recommenders. As far as we know, formal training of Recommenders (editors) is a unique feature of PCI RR.<\/p>\n\n\n\n

So far we have had 10 submissions, which I think is a considerably higher rate than for Registered Reports at any journal. If you have a good idea for a Registered Report<\/a>, or would like to become involved as a Recommender<\/a>, you know who to call<\/a>!<\/p>\n\n\n\n

<\/p>\n\n\n\n

Zoltan Dienes<\/a>\u00a0is a Professor of Experimental Psychology at the University of Sussex. He is the author of the influential book\u00a0“Understanding Psychology as a Science,” and\u00a0is regularly invited to provide Bayes and Registered Report workshops all over the world.\u00a0He produced the first online\u00a0Bayes factor calculator<\/a>\u00a0in 2008, and has published extensively on Bayes factors including\u00a0how to get the most out of non-significant results<\/a>.<\/em><\/p>\n\n\n\n

Find out more about the School’s Psychological Methods Strategic Focus Area<\/a> and our commitment to Open Science.<\/p>\n","protected":false},"excerpt":{"rendered":"

By Prof Zoltan Dienes In April we launched Peer Community In Registered Reports (PCI RR), where a Registered Report in any discipline can be submitted (by linking to a preprint), and refereed, editorially evaluated and (potentially) eventually accepted  \u2013 \u201crecommended\u201d…<\/span><\/p>\n

Read more ›<\/a><\/div>\n

<\/p>\n","protected":false},"author":156,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"spay_email":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false},"categories":[177890],"tags":[177891,177895,177893,177896,177894,141591],"jetpack_featured_media_url":"","jetpack_publicize_connections":[],"jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/pafdEV-ma","jetpack-related-posts":[{"id":1439,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2021\/11\/25\/its-2021-and-we-are-still-dealing-with-misogyny-in-the-name-of-open-science\/","url_meta":{"origin":1374,"position":0},"title":"It\u2019s 2021\u2026 and we are still dealing with misogyny in the name of open science","date":"November 25, 2021","format":false,"excerpt":"By Anonymous A few of you might have followed a very recent pile-on on Twitter. For those that have not, here is some context: a recent paper by Felig et al. (2021) investigated the notion of whether women that dress lightly in the evening when going out, feel \u201chot\u201d despite\u2026","rel":"","context":"With 1 comment","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":881,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2020\/01\/09\/ten-things-i-learned-from-being-editor-of-the-british-journal-of-social-psychology\/","url_meta":{"origin":1374,"position":1},"title":"Ten things I learned from being editor of the British Journal of Social Psychology","date":"January 9, 2020","format":false,"excerpt":"By Prof John Drury On 31st December 2019) I stepped down from being editor of the British Journal of Social Psychology (BJSP), a post I occupied for three years, shared with Hanna Zagefka (Royal Holloway University of London). The occasion has prompted me to review some of the things I\u2026","rel":"","context":"In "Faculty research"","img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":97,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2015\/11\/09\/experience-with-the-jra-scheme\/","url_meta":{"origin":1374,"position":2},"title":"Experience with the JRA scheme","date":"November 9, 2015","format":false,"excerpt":"By Ruihan Wu In the spring term of the second year of my undergraduate degree, I applied to the Junior Research Associate (JRA) scheme, with Nicola Yuill of the Children and Technology Lab (insert link) as my supervisor. This scheme, funded by the doctoral school in the University with support\u2026","rel":"","context":"In \"Child development\"","img":{"alt_text":"Figure 2. The place where the experiment be conducted ","src":"https:\/\/i0.wp.com\/blogs.sussex.ac.uk\/psychology\/files\/2015\/10\/Ruihan2-300x225.png?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":1593,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2022\/07\/05\/a-phd-public-engagement-event-and-me\/","url_meta":{"origin":1374,"position":3},"title":"A PhD, public engagement event, and me","date":"July 5, 2022","format":false,"excerpt":"By Psychology PhD student, Louise Davidson The Science of Teamwork Teamwork is something that most of us engage in every day \u2013 for example, within a work team or a sports team. We know the members of our teams\u2026 their names, their strengths, their weaknesses, and their role within the\u2026","rel":"","context":"Similar post","img":{"alt_text":"photo of Louise Davidson in a white coat presenting to a group of people people on Brighton seafront","src":"https:\/\/i0.wp.com\/blogs.sussex.ac.uk\/psychology\/files\/2022\/07\/Picture1.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]},{"id":230,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2016\/06\/27\/reflections-on-the-first-2-years-of-studying-psychology\/","url_meta":{"origin":1374,"position":4},"title":"Reflections on the first 2 years of studying psychology","date":"June 27, 2016","format":false,"excerpt":"By Judi Luxmoore I have just finished the second year of my degree and it is overwhelming to think about how much knowledge I have gained, and how much I have grown as a person. I have worked hard, partied hard and also had time to be lazy, as us\u2026","rel":"","context":"In \"Second Year\"","img":{"alt_text":"Judi","src":"https:\/\/i0.wp.com\/blogs.sussex.ac.uk\/psychology\/files\/2016\/06\/Judi-300x201.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":1879,"url":"https:\/\/blogs.sussex.ac.uk\/psychology\/2023\/03\/14\/being-a-neurodivergent-researcher-imposter-thoughts-doom-boxes-and-the-academic-monolith\/","url_meta":{"origin":1374,"position":5},"title":"Being a neurodivergent researcher: imposter thoughts, doom-boxes and the academic monolith","date":"March 14, 2023","format":false,"excerpt":"By Josh Francis In recognition of Neurodiversity Celebration Week, Psychology PhD student and neurodivergent researcher, Josh Francis has written about his experiences and personal journey through university which led him to his ADHD diagnosis. In this blog, Josh expresses his determination to raise awareness for neurodiversity by suggesting tools and\u2026","rel":"","context":"Similar post","img":{"alt_text":"","src":"https:\/\/i1.wp.com\/blogs.sussex.ac.uk\/psychology\/files\/2023\/03\/ADHD-picture-scaled.jpg?resize=350%2C200&ssl=1","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/posts\/1374"}],"collection":[{"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/users\/156"}],"replies":[{"embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/comments?post=1374"}],"version-history":[{"count":7,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/posts\/1374\/revisions"}],"predecessor-version":[{"id":1386,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/posts\/1374\/revisions\/1386"}],"wp:attachment":[{"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/media?parent=1374"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/categories?post=1374"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/blogs.sussex.ac.uk\/psychology\/wp-json\/wp\/v2\/tags?post=1374"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}