Category Archives: peer review

I refuse all review requests with deadlines < 3 weeks. Here’s why, and how.

Warning: another grumpy one

I’m seeing it more and more: requests to review manuscripts with ludicrously short deadlines.  Sometimes 10 days, sometimes 7, sometimes one week (5 business days).  And I see editors on Twitter bragging about a paper they’ve shepherd through the entire review process in 5 days, or a week, or two weeks.  I want all this to stop. Continue reading

Advertisements

The efficiency of the lazy scientist

Photo: Lazy red panda CC 0 via pxhere.com

I’ve just published a paper that had some trouble getting through peer review.  Nothing terribly unusual about that, of course, and the paper is better for its birthing pains.  But one reviewer comment (made independently, actually, by several different reviewers) really bugged me.  It revealed some fuzzy thinking that’s all too common amongst ecologists, having to do with the value of quick-and-dirty methods.  Quick-and-dirty methods deserve more respect.  I’ll explain using my particular paper as an example, first, and then provide a general analysis. Continue reading

Negative-news bias and “the disaster that is peer review”

Peer review is a dumpster fire, right?  At least, that’s what I hear – and there’s a reason for that.

Last month, I got reviews back on my latest paper.  Opening that particular email always makes me both excited and depressed, and this one ran true to form: a nicely complimentary opening from the editor and Reviewer 1 – followed by several pages of detailed critiques from Reviewer 2 – and Reviewer 3 – and, believe it or not, Reviewer 4.  Continue reading

Can we stop saying reviewers are unpaid?

Image: Coins by KMR Photography CC BY 2.0

Reviewers, we all tell each other to remember, are unpaid. Sometimes we’re being scandalized about it, as in “Megapublisher X is making unconscionable profits on the back of unpaid reviewers”.  Other times we’re being laudatory, as in “We should be grateful to reviewers for all the help they give us, since they’re working for us without pay”.  I’ve said versions of the latter many times: for example, in The Scientist’s Guide to Writing, in this older post, and more recently and more explicitly in this post.  But the thing is, it (mostly) isn’t true.  We should probably stop saying it. Continue reading

“Peer Community In”: Beyond the traditional publishing model (guest post)

I recently learned about Peer Community In (PCI), a new system for reviewing and recommending preprints. I’m really intrigued.  It’s true that I’m an old fuddy-duddy who’s on record as saying that we often exaggerate the problems with the status quo, and as not liking to think outside the box.  And yet there are good reasons to think it might be good to have other ways beyond traditional journals to disseminate science.  We should experiment with a variety of new systems, and PCI seems like one well worth exploring.  Read on to learn more!

What follows is a guest post by Denis Bourguet (denis.bourguet@inra.fr), Benoit Facon (benoit.facon@inra.fr), Thomas Guillemaud (thomas.guillemaud@inra.fr), and Ruth Hufbauer (hufbauer@colostate.edu).  DB, BF, and TG are the founders of PCI, and RH is a colleague and member of the board of PCI Evol Biol.

We believe that the current system of publishing with academic journals suffers from four crucial problems. First, Continue reading

Reviewing with imposter syndrome

Like most people, I often feel a little impostery. I’m convinced that sooner or later, people will notice that my work isn’t actually all that important, that my papers are somehow flawed, that I don’t really know what I’m talking about when I teach.  (People may even figure out that Scientist Sees Squirrel is seldom original, mostly wrong, and only occasionally interesting.)

I was part of some discussion on Twitter recently about imposter syndrome in the particular context of peer reviewing.  Some folks worry that they really aren’t qualified to review.  They worry that they may make the wrong recommendation: either miss a critical flaw or (conversely) see something as a critical flaw that really isn’t.  As an editor, I’ve had people whose judgement I respect decline to review on the grounds that they didn’t feel confident in their reviewing abilities.  Ironically, these are often the early career scientists who tend to be absolutely terrific reviewers.

For a variety of reasons, I think this fear is generally misplaced.  Continue reading

Things that are more important to me than reviewing your manuscript

Warning: I’m grumpy today.

Last week I got a review request from a major open-access journal.  It specified a 10 day deadline.  I thought that seemed a little quick – but the manuscript looked right up my alley, and I could see the beguiling glint of some available time coming up.  So I agreed.  But it turns out 10 days meant 10 calendar days, not 10 business days as I’d assumed, and now I’m late* and getting rather testy autogenerated messages from the editorial office about it.  This makes me rather testy in return. Continue reading