I recently learned about Peer Community In (PCI), a new system for reviewing and recommending preprints. I’m really intrigued. It’s true that I’m an old fuddy-duddy who’s on record as saying that we often exaggerate the problems with the status quo, and as not liking to think outside the box. And yet there are good reasons to think it might be good to have other ways beyond traditional journals to disseminate science. We should experiment with a variety of new systems, and PCI seems like one well worth exploring. Read on to learn more!
What follows is a guest post by Denis Bourguet (firstname.lastname@example.org), Benoit Facon (email@example.com), Thomas Guillemaud (firstname.lastname@example.org), and Ruth Hufbauer (email@example.com). DB, BF, and TG are the founders of PCI, and RH is a colleague and member of the board of PCI Evol Biol.
We believe that the current system of publishing with academic journals suffers from four crucial problems. First, it is incredibly costly for research institutions. For example, in France, the cumulative cost of subscriptions and page charges exceeds 145 million euros/year (sum for universities, CNRS and INRA). These funds are unavailable to further research or teaching/training efforts. Second, for-profit publishing companies rely upon the work of researchers as authors, editors, and reviewers, who are not paid, and are not doing research or teaching while they work for journals. Third, the system is not transparent enough: editorial correspondence and reviewers’ critiques of accepted articles are rarely published and those reviewers’ critiques are often far too succinct to ensure scientific quality. Fourth, the shift towards the economic model of open access means that almost anything can get published, whether it is of high quality or not. The open access movement is laudable in many respects – research findings should be a greater good, accessible by anyone. But the system is intrinsically corruptible: for-profit publishing companies have an economic interest in accepting as many articles as possible, regardless of their worth.
A new development makes changing this system more feasible than ever before. Manuscripts, called preprints, are increasingly commonly deposited by researchers in open archives such as bioRxiv.org or preprints.org, making research results available more quickly than when submitted to a journal, as well as free of charge. This immediate availability also allows the use of social networks to comment on the results, thus promoting contact between science and the public. However, preprints are not formally evaluated by the scientific community, making it difficult to discern whether the studies are valid. This is a problem.
We propose a completely free solution for authors and readers, called Peer Community In (PCI).
This project aims to establish communities of researchers (Peer Communities) in different fields of science to evaluate articles. If the research is deemed to be sound and worthy, it is then validated with a public recommendation to the broader field.
The process for a new manuscript is as follows (there is also a short video available here).
- The authors of manuscript deposit it into an open archive such as bioRxiv.
- The authors then submit a request that the manuscript be reviewed by a relevant Peer Community. As evolutionary biologists ourselves, we have started with the creation of a Peer Community in Evolutionary Biology.
- The only condition for requesting review by a Peer Community is that the preprint is not already published or submitted for review to a journal.
- A researcher within the relevant Peer Community (called a “recommender”) handles the preprint and obtains at least two reviews of the manuscript (e.g. their own, and one other), and the standard revision and re-review occurs.
- If the recommender deems the work to be valid, as well as interesting to the field, they will publish a recommendation of the manuscript. Recommendations are short essays that highlight the merits of the manuscript (here’s an example). Along with the recommendation, the reviews (anonymous or signed, as the reviewer prefers) and response to reviews are also published. The recommendations themselves have a DOI and can be cited.
- Importantly, evaluation and recommendation of a preprint by a Peer Community will not prevent subsequent submission of the article for publication in a journal.
This new system has some similarity with conventional academic journals. However Peer Communities do not publish scientific articles. They do publish recommendations, reviews and commentaries on preprints posted in open archives. As a way to engage in the broader academic research process, they also publish evaluations of already published articles (in this case, the authors do not request an evaluation – a recommender simply highlights a particularly interesting paper that is already published, similarly to F1000 recommendation).
Because recommendation of a preprint by a Peer Community does not prevent it being submitted for publication in an academic journal, the Peer Community In project can coexist with the current journal system. Indeed, most journals today accept submission of articles whose preprints have been deposited in open archives (to check your favorite journal, use sherpa/romeo’s handy service). Furthermore, reviews and recommendations by Peer Community in can be used by journals, avoiding duplicate review efforts.
We launched the first Peer Community in January 2017: The Peer Community in Evolutionary Biology (PCI Evol Biol). PCI Evol Biol currently brings together more than 300 evolutionary biologists to handle pre-prints. This Peer Community has already posted recommendations of 20 postprints and 3 preprints, and 16 preprints are currently in evaluation. The editor-in-chief of Ecology Letters (Tim Coulson) has indicated interest in using PCI reviews and recommendations to streamline their review processes. It seems likely that other journals will follow suit.
In summary, the idea behind the Peer Community In project is to establish a free and public review system to evaluate preprints and to validate and highlight preprints of good quality. The ultimate goal is that the Peer Community In recommendations will be recognized by the scientific community, including research institutions and funding agencies, as a high-quality label, thus rendering submissions to conventional journals optional.
While the project is in its infancy, it has the support of several French research institutes (including INRA) and the American Society for the Study of Evolution.
We encourage evolutionary biologists to submit their work for evaluation by PCI Evol Biol, and we encourage others to consider forming Peer Communities of their own. Discussions about the launch of a PCI Ecology, a PCI Paleontology and a PCI Applied Statistics have already started. Contact one of us if you’re interested in exploring how to initiate a Peer Community in your field or sub-field.
A few thoughts from Steve – and please leave your own in the Replies. I’m much less pessimistic about the flaws in the journal-publication model, but I think we should be experimenting with other possibilities. I’m especially intrigued with PCI because I think it has the potential to fix one major shortcoming of the preprint-server system: its lack of an attention-leveling mechanism. Journals are one system for assigning review for, and garnering reader attention to, papers without regard to the pre-existing fame of their authors. (Yes, I know they aren’t a perfect system for that.) PCI seems like it could do the same, as long as all requests for review are honoured. I also like the fact that PCI neither requires nor prevents later submission of a paper to a conventional journal; this solves the bootstrapping problem of how we shift to a new publication medium before we have assessment systems (like tenure committees) that value that medium. Will PCI need some tuning as it grows? Probably, like anything else. I wonder, for example, how it will keep up if the volume of authors requesting review grows very large. But since that’s a problem that comes with success, having to solve it might be a good sign.
What do you think?