Skip to main content

End of the peer show

I am currently reading for review the latest book by James Lovelock, and a strange and sometimes wonderful thing it is too. I was fascinated to read fairly early on an impassioned attack on something most of us take for granted as part of the mechanism of modern science - peer review.

The idea of peer review is that before a paper is published or an experiment etc. is funded a group of other scientists (the peers in question) with appropriate knowledge assess the value of the paper/experiment and act as gatekeepers, only allowing through work they feel is worthwhile. But Lovelock points out that this process tends to support the status quo, rather than radical new thinking, and is heavily biassed in the way it is operated towards the 'throw large teams at it' approach that emerged largely in the Second World War and is strongly weighted against individual scientists working on their own, which, he suggests, is a problem.

Lovelock points out, correctly, that only individuals can come up with an idea. You can't have an idea by committee. (It's interesting, we use 'team' when we want to make the concept of throwing a group of people at a problem to sound good, and 'committee' when we want it  to sound bad.) It's not that he's against teams, but he sees them as largely responsible for the grunt work to support the ideas from the individuals. And this is fine and good, but unfortunately the peer review process has come to assume a certain way of working, and will tend to reject without consideration input from individuals who don't fall within the classic academic institution model.

One of the examples used to support this is an experience Lovelock had in the early days of the CFC/ozone hole debacle. Lovelock had applied for a small grant from the Natural Environment Research Council as part of a plan to travel on a ship to Antarctica and back, using a device he had invented that enabled him to measure the levels of CFCs in the atmosphere down to parts per trillion. The peer review included this wonderful piece of text:
Every schoolboy knows that the CFCs are among the most inert of chemicals, it would be difficult to measure their abundance in the air, or in sea water, as low as a part per million; the proposer claims to be able to measure their abundance at parts per trillion. The claim is bogus and the time of our committee should not be wasted by frivolous applications of this kind.
Lovelock made the journey and took the readings unfunded, providing the primary evidence that would result in the eventual banning of CFCs. The more common form of peer review, deciding on whether or not a paper should be published in journals, he suggests, is equally biassed against anything new/outside current received wisdom/from individual scientists working alone - it's just rare that the negative comments get seen.

There is no doubt that Lovelock is right, but unfortunately what he doesn't do (unless it comes later in the book - I am only part way through) is come up with a solution to the problem. Because the fact is that there are far more people who really will be making bogus claims and coming up with silly papers than happen to be effective individual scientists like him. But at the very least, the processes should allow for an individual who, like Lovelock, has the appropriate qualifications and experience to be published or funded just as much as those who are part of academic institutions. (Admittedly there aren't many such people, but there are still a few.) At the moment this just doesn't happen.

What's more, I do think Lovelock has a point when he suggests that the vast majority of new thinking and new inventions come from such individuals, rather than from big teams. The way we go about science now is very conservative (with a small c). Which is fine where things can continue in 'more of the same' mode, but when we need a radical idea to overthrow current thinking - or for a really impressive new invention (Lovelock stresses most of the great scientists have also been inventors, something big team science doesn't seem capable of matching) - then we are likely to be moribund if we don't find a way to support these maverick individuals. Science will, frankly, be a poor cousin of what it could be otherwise.

Comments

Popular posts from this blog

Why I hate opera

If I'm honest, the title of this post is an exaggeration to make a point. I don't really hate opera. There are a couple of operas - notably Monteverdi's Incoranazione di Poppea and Purcell's Dido & Aeneas - that I quite like. But what I do find truly sickening is the reverence with which opera is treated, as if it were some particularly great art form. Nowhere was this more obvious than in ITV's 2010 gut-wrenchingly awful series Pop Star to Opera Star , where the likes of Alan Tichmarsh treated the real opera singers as if they were fragile pieces on Antiques Roadshow, and the music as if it were a gift of the gods. In my opinion - and I know not everyone agrees - opera is: Mediocre music Melodramatic plots Amateurishly hammy acting A forced and unpleasant singing style Ridiculously over-supported by public funds I won't even bother to go into any detail on the plots and the acting - this is just self-evident. But the other aspects need some exp...

Is 5x3 the same as 3x5?

The Internet has gone mildly bonkers over a child in America who was marked down in a test because when asked to work out 5x3 by repeated addition he/she used 5+5+5 instead of 3+3+3+3+3. Those who support the teacher say that 5x3 means 'five lots of 3' where the complainants say that 'times' is commutative (reversible) so the distinction is meaningless as 5x3 and 3x5 are indistinguishable. It's certainly true that not all mathematical operations are commutative. I think we are all comfortable that 5-3 is not the same as 3-5.  However. This not true of multiplication (of numbers). And so if there is to be any distinction, it has to be in the use of English to interpret the 'x' sign. Unfortunately, even here there is no logical way of coming up with a definitive answer. I suspect most primary school teachers would expands 'times' as 'lots of' as mentioned above. So we get 5 x 3 as '5 lots of 3'. Unfortunately that only wor...

Why backgammon is a better game than chess

I freely admit that chess, for those who enjoy it, is a wonderful game, but I honestly believe that as a game , backgammon is better (and this isn't just because I'm a lot better at playing backgammon than chess). Having relatively recently written a book on game theory, I have given quite a lot of thought to the nature of games, and from that I'd say that chess has two significant weaknesses compared with backgammon. One is the lack of randomness. Because backgammon includes the roll of the dice, it introduces a random factor into the play. Of course, a game that is totally random provides very little enjoyment. Tossing a coin isn't at all entertaining. But the clever thing about backgammon is that the randomness is contributory without dominating - there is still plenty of room for skill (apart from very flukey dice throws, I can always be beaten by a really good backgammon player), but the introduction of a random factor makes it more life-like, with more of a sense...