Like most people, I often feel a little impostery. I’m convinced that sooner or later, people will notice that my work isn’t actually all that important, that my papers are somehow flawed, that I don’t really know what I’m talking about when I teach. (People may even figure out that Scientist Sees Squirrel is seldom original, mostly wrong, and only occasionally interesting.)
I was part of some discussion on Twitter recently about imposter syndrome in the particular context of peer reviewing. Some folks worry that they really aren’t qualified to review. They worry that they may make the wrong recommendation: either miss a critical flaw or (conversely) see something as a critical flaw that really isn’t. As an editor, I’ve had people whose judgement I respect decline to review on the grounds that they didn’t feel confident in their reviewing abilities. Ironically, these are often the early career scientists who tend to be absolutely terrific reviewers.
For a variety of reasons, I think this fear is generally misplaced. Sure, it’s probably unwise to review something you know absolutely nothing about; but requests to do that are pretty rare. When an editor asks you for a review, they usually have a reason: they see you as knowledgeable, or have respected your previous work (as an author or reviewer), or think you’re representative of the readers the manuscript hopes to reach. They are not counting on you to be infallibly brilliant, though – just careful and thoughtful.
I think the biggest reason people worry about making the wrong call as peer reviewers is that they think of it as “making a call” in the first place. But they really shouldn’t. It’s easy to think about peer review as a gatekeeping exercise, in which a manuscript is judged either worthy or unworthy of publication. That is one function of peer review, but it isn’t the most interesting or the most important one. After all, nearly all papers are eventually published somewhere. If it were true that each manuscript were either correct or incorrect, and that editors were relying on reviewers to classify each manuscript on that basis without error, then sure, you could get your recommendation wrong. But manuscripts aren’t binary like that*. Some manuscripts really are obviously flawed; if you get one of those, you’re unlikely to miss it. Some manuscripts are obviously brilliant**. But if a manuscript seems to you like it’s pretty good, but not perfect, that’s probably because it is. Most manuscripts are worthwhile, but can be improved. Helping authors make those improvements is the more interesting and more important function of peer review, and it’s not an exercise in which you can be “wrong”.
It’s also important to realize that a review isn’t a list of line-in-the-sand requirements for changes that the authors must make – no matter how misguided the review might be. If a reviewer messes up, and makes a comment that isn’t well founded, there are lots of ways that harm is avoided. The editor may suggest that they don’t agree. The other reviewer may assess the matter differently. The authors may rebut the comment in their Response to Reviews. The authors can even ask the editor, or the reviewer (if they sign) for clarification or discussion. Of course, authors should never simply ignore reviewer comments – karma will get you if you try this – but one misstatement by a reviewer shouldn’t doom a manuscript, at least not if editors are doing their jobs. (By the way, there’s a whole chapter on how authors should respond to reviewer comments in The Scientist’s Guide to Writing.)
Another important point is that even a reviewer comment that’s “wrong” can be quite useful. If you’re reviewing a paper, misunderstand something, and make a comment that doesn’t quite make sense, your mistake may actually be quite helpful. After all, if you misunderstood something, other readers are likely to misunderstand it too – are perhaps even more likely to misunderstand it, since the average reader is likely to read less carefully than a reviewer. An author who knows their business will take advantage of reviewer misunderstanding to make the revised manuscript clearer.
So, might you get something wrong when you review a paper? Sure, you might. I’m sure I sometimes do. But the risk of real harm is minimal, and your wrongness might even make your review better. I usually try to phrase my reviews with this in mind: not “This analysis is wrong” but “I don’t understand why this analysis is appropriate; and if I’m missing the reason that it is, other readers will too”. A reviewer needn’t be an expert and perfect arbiter to be useful – they can also stand in for the audience the author hopes to reach.
One thing that helps with reviewer-imposter syndrome in the long run is that many journals send copies of all the reviews, and the decision letter, to each of the reviewers. I agree with Jeremy Fox – I love this. I’m always curious to see what the other reviewers thought of the manuscript, and how the editor came down after reading the reviews. My review is never quite the same as the other(s), but reassuringly, it’s rarely very far out of line. Normally, the reviews will agree on a bunch of things; I’ll have missed something the other reviewer caught; and I’ll have caught something the other reviewer missed. This isn’t evidence that either of us has been a bad reviewer; it’s just evidence that two or three heads are better than one. This is an important lesson to learn, and as a reviewer it’s given me the confidence to say – politely and constructively – what I think.
So: imposter syndrome is normal, and nearly all of us have it. But it shouldn’t stop us from reviewing. We’re not singlehandedly giving a gladiator’s life thumbs-up or thumbs-down. We’re part of a team (with the editor, and the authors) working to make a published paper better. That’s something any of us can do, even if we’re occasionally not perfect.
© Stephen Heard (email@example.com) April 25, 2017
By the way, if you’re newish at reviewing, Terry McGlynn has some excellent pointers here. Actually, if you’re oldish at reviewing, like me, Terry’s pointers are just as good.
*^This is especially true at the glam journals, which try the hardest to pretend it isn’t.
**^Not usually mine.