Just Stuff

Just another WordPress.com weblog

Peer Rejected

leave a comment »

It seems that some problems with abuse of peer review have been highlighted by the stem cell community [1].

My own experience with this was a paper that I wrote for SIAM Review [2] essentially criticising something they had published (on the speed of the domino effect). The criticism was that [3] presented a mathematical model of the domino effect the results of which were counter-intuitive and no attempt had been made to compare the model predictions with any experimental data despite there being a number of data sets in the literature. In fact the principle references in [3] did contain experimental data (slightly flawed in my opinion but that is not relevant here) which if used would have invalidated the model.

The problem with my paper might in the eyes of the editors (and possibly the referees, if the same referees were used as for the original paper) be that not only was I critical of the original paper but of the reviewers in not picking up that no attempt at validation had been made. This might also be construed as a criticism of the who refereeing and editorial policy at SIAM Review.

It took SIAM Review a year to decide that they would not publish this paper. IIRC the reason for rejection was that they did not accept papers that were critical of stuff they had already published. I am not able to recover the email to quote the exact wording as my work email system seems to have deleted all emails older than a few months. Why it took them a year to tell me that they were not going to publish  I don’t know. They could have determined that it did not satisfy their policy in about 5 minutes.

Peer review is not some panacea that guarantees that what is published is correct, methodologically sound and/or important. It is influenced by the the foibles of the editorial staff, policy and any number of other things. The need of researchers to publish guarantees that a large proportion of papers published are trivial (assuming they have no other defects).

It is also the case that a paper or report has not been published in a peer reviewed journal is not necessarily worthless. There has been a piece in the news recently about the IPCC using a report from mountaineers in the Alps about the state of glaciers. This is not a controlled experimental result nor has it been published in a peer reviewed journal (IIRC it was published in some mountaineering journal) but it is expert testimony and has some value in the absence of other data.

Of course I might have broken an academic taboo in sending [2] to SIAM Review without first informing the authors of [3], but in this case I consider that an irrelevance, they had published and there is nothing they can say that would retrospectively introduce validation into their paper also the criticism was not just of what they wrote but of the refereeing process itself. I’m afraid that I am not a very courteous person and I an not going to tell you that I think what you write is a heap of crap before doing so, which is why the internet is such a wonderful (virtual) place I can write what I want without asking anyone’s permission.

References

1. “Journal stem cell work ‘blocked'”, BBC News, http://news.bbc.co.uk/1/hi/sci/tech/8490291.stm

2. “Validation of a Model of the Domino Effect?”, Ron Larham arXiv.org paper: arXiv:0803.2898, http://arxiv.org/abs/0803.2898

3. “Domino Waves”, C.J Efthimiou, M.D. Johnson,  SIAM Review 49 (2007) 111

Advertisements

Written by CaptainBlack

February 3, 2010 at 08:30

Posted in Maths and Stuff

Tagged with

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: