Skip to main content

End of the peer show

I am currently reading for review the latest book by James Lovelock, and a strange and sometimes wonderful thing it is too. I was fascinated to read fairly early on an impassioned attack on something most of us take for granted as part of the mechanism of modern science - peer review.

The idea of peer review is that before a paper is published or an experiment etc. is funded a group of other scientists (the peers in question) with appropriate knowledge assess the value of the paper/experiment and act as gatekeepers, only allowing through work they feel is worthwhile. But Lovelock points out that this process tends to support the status quo, rather than radical new thinking, and is heavily biassed in the way it is operated towards the 'throw large teams at it' approach that emerged largely in the Second World War and is strongly weighted against individual scientists working on their own, which, he suggests, is a problem.

Lovelock points out, correctly, that only individuals can come up with an idea. You can't have an idea by committee. (It's interesting, we use 'team' when we want to make the concept of throwing a group of people at a problem to sound good, and 'committee' when we want it  to sound bad.) It's not that he's against teams, but he sees them as largely responsible for the grunt work to support the ideas from the individuals. And this is fine and good, but unfortunately the peer review process has come to assume a certain way of working, and will tend to reject without consideration input from individuals who don't fall within the classic academic institution model.

One of the examples used to support this is an experience Lovelock had in the early days of the CFC/ozone hole debacle. Lovelock had applied for a small grant from the Natural Environment Research Council as part of a plan to travel on a ship to Antarctica and back, using a device he had invented that enabled him to measure the levels of CFCs in the atmosphere down to parts per trillion. The peer review included this wonderful piece of text:
Every schoolboy knows that the CFCs are among the most inert of chemicals, it would be difficult to measure their abundance in the air, or in sea water, as low as a part per million; the proposer claims to be able to measure their abundance at parts per trillion. The claim is bogus and the time of our committee should not be wasted by frivolous applications of this kind.
Lovelock made the journey and took the readings unfunded, providing the primary evidence that would result in the eventual banning of CFCs. The more common form of peer review, deciding on whether or not a paper should be published in journals, he suggests, is equally biassed against anything new/outside current received wisdom/from individual scientists working alone - it's just rare that the negative comments get seen.

There is no doubt that Lovelock is right, but unfortunately what he doesn't do (unless it comes later in the book - I am only part way through) is come up with a solution to the problem. Because the fact is that there are far more people who really will be making bogus claims and coming up with silly papers than happen to be effective individual scientists like him. But at the very least, the processes should allow for an individual who, like Lovelock, has the appropriate qualifications and experience to be published or funded just as much as those who are part of academic institutions. (Admittedly there aren't many such people, but there are still a few.) At the moment this just doesn't happen.

What's more, I do think Lovelock has a point when he suggests that the vast majority of new thinking and new inventions come from such individuals, rather than from big teams. The way we go about science now is very conservative (with a small c). Which is fine where things can continue in 'more of the same' mode, but when we need a radical idea to overthrow current thinking - or for a really impressive new invention (Lovelock stresses most of the great scientists have also been inventors, something big team science doesn't seem capable of matching) - then we are likely to be moribund if we don't find a way to support these maverick individuals. Science will, frankly, be a poor cousin of what it could be otherwise.

Comments

Popular posts from this blog

Why I hate opera

If I'm honest, the title of this post is an exaggeration to make a point. I don't really hate opera. There are a couple of operas - notably Monteverdi's Incoranazione di Poppea and Purcell's Dido & Aeneas - that I quite like. But what I do find truly sickening is the reverence with which opera is treated, as if it were some particularly great art form. Nowhere was this more obvious than in ITV's 2010 gut-wrenchingly awful series Pop Star to Opera Star , where the likes of Alan Tichmarsh treated the real opera singers as if they were fragile pieces on Antiques Roadshow, and the music as if it were a gift of the gods. In my opinion - and I know not everyone agrees - opera is: Mediocre music Melodramatic plots Amateurishly hammy acting A forced and unpleasant singing style Ridiculously over-supported by public funds I won't even bother to go into any detail on the plots and the acting - this is just self-evident. But the other aspects need some exp...

Murder by Candlelight - Ed. Cecily Gayford ***

Nothing seems to suit Christmas reading better than either ghost stories or Christmas-set novels. For some this means a fluffy romance in the snow, but for those of us with darker preferences, it's hard to beat a good Christmas murder. An annual event for me over the last few years has been getting the excellent series of classic murderous Christmas short stories pulled together by Cecily Gayford, starting with the 2016 Murder under the Christmas Tree . This featured seasonal output from the likes of Margery Allingham, Arthur Conan Doyle, Ellis Peters and Dorothy L. Sayers, laced with a few more modern authors such as Ian Rankin and Val McDermid, in some shiny Christmassy twisty tales. I actually thought while purchasing this year's addition 'Surely she is going to run out of classic stories soon' - and sadly, to a degree, Gayford has. The first half of Murder by Candlelight is up to the usual standard with some good seasonal tales from the likes of Catherine Aird, Car...

Why backgammon is a better game than chess

I freely admit that chess, for those who enjoy it, is a wonderful game, but I honestly believe that as a game , backgammon is better (and this isn't just because I'm a lot better at playing backgammon than chess). Having relatively recently written a book on game theory, I have given quite a lot of thought to the nature of games, and from that I'd say that chess has two significant weaknesses compared with backgammon. One is the lack of randomness. Because backgammon includes the roll of the dice, it introduces a random factor into the play. Of course, a game that is totally random provides very little enjoyment. Tossing a coin isn't at all entertaining. But the clever thing about backgammon is that the randomness is contributory without dominating - there is still plenty of room for skill (apart from very flukey dice throws, I can always be beaten by a really good backgammon player), but the introduction of a random factor makes it more life-like, with more of a sense...