I’ve been away for a long time. RSI really keeps me away from blogging and I’m not planning to get back to blogging full time, but I really miss it so I hope to get back to writing a bit here and there…
Anyway, there is one thing that’s been on my mind for a while, and I’d like input on it.
Should reviews be open or blind?
I’ve discussed this with colleagues for a while and I see all the points for or against, but really haven’t made up my mind. Ideally I think that reviews are such an important part of the publication process that we cannot ignore it, but I see a lot of good arguments for blind reviews as well.
First some personal background: about five-ten years ago, I decided to accept all papers I was asked to review. I figured that it was 1) important to do my duty for the scientific community to review papers and 2) I would learn a lot from reviewing as many papers as I could get my hands on.
Okay, that was a very bad idea. The more papers I reviewed the more papers I was asked to review, and I ended up reviewing tens of papers a month. That means that my reviews ended up crappy since I simply did not have the time to give the papers any serious thought. I could spend two-three hours on a review max, and that is just not enough.
I felt really bad the first time I started refusing reviews, but I simply had to.
Recently I have limited the number of papers I can handle as an editor as well. I just cannot handle too many papers and give them a fair judgment.
I feel bad about this, but is a question of survival. I cannot handle as many papers as I think I should, so I have to limit it.
This brings me back to the title of this post. Should reviews be blind or not?
When I was overwhelmed by papers I dropped signing my reviews. I didn’t feel comfortable with the quality of my reviews and I am sorry to say that it meant that I could do the reviews but not be honest and stand behind them.
I can’t really live with that. I don’t want to give people criticism that I cannot be man enough to stand behind, so I have seriously limited the number of papers I accept to review and now I sign my reviews again.
This now leads me to a serious question: how does me signing the reviews affect my reviews?
I would like to say that my reviews have always been of high quality, but obviously they haven’t been of equal quality since I now handle fewer manuscripts when I sign them. I obviously feel more reason to write better reviews when I sign them.
Having to sign my reviews clearly, for me at least, means that I am much more careful about the report I write.
Now I never write a report unless I’ve been thinking about the paper for a couple of days. And I think my reviews are much better for it.
That sounds like I am all in favour for open reviews (and generally I am) but I also see the problems with this.
At the pub in Cambridge my last visit there we discussed this. It is easy to sign a positive review but you can get in trouble when you sign negative reports, so why bother?
If open reviews means anything it means that you always sign reviews even if they are negative, and that can be a problem since you will make enemies when you are giving negative reviews.
I really don’t know.
I know that my reviews are better now that I sign them, but I am also much more selective on the papers I want to review, so that puts a limit on what I will review. I still spend about a day a week on reviewing but I am much more selective on what papers I accept and I only accept papers I am likely to be positive about.
Even if we don’t require reviews to be open, would we make better reviews if reviews were published together with papers, perhaps as supplemental material? I don’t know
I would love your thoughts.