Skip to main content

I am not a number

I've just read The End of Average for review, and I couldn't help letting out a little whoop of joy when it totally trashed psychometric testing.

I am talking about mechanisms like the Myers Briggs type profile, along with a whole host of rivals, all used by businesses in recruiting and team building to analyse a personality and assess how an individual will work with others. 

The problems I have always had with the approach are several-fold. It's based primarily on Jungian theory which has little scientific basis. Your personality type is self-determined, so, while it's not surprising it often feels right, that doesn't make it accurate. And I was always doubtful about the cultural norms of the mostly US-devised tests being applied worldwide. Infamously there used to be a question about whether you preferred a gun or something constructive (I can't remember what) - which clearly would have different resonance in the US and Europe. 

Now, though, there are much stronger grounds for concern. The End of Average points out that personality profiles don't reflect the behaviour of individuals, but rather they predict the average behaviour of a group of people, which isn't the same thing. If you are an ENTP like me, it doesn't say how you will behave, but how, on average, people with the same profile will behave. As the book says 'In fact, correlations between personality traits and behaviours that should be related - such as aggression and getting into fights, or extroversion and going to parties - are rarely stronger than 0.3.' The same applies to academic achievement and professional accomplishments. This means your personality traits, as identified by the test should reflect around 9 per cent of your actual behaviour, while getting over 90 per cent wrong.

Underlying this is the relatively recent (if entirely obvious) discovery that we don't have one personality/behaviour but it varies depending on the situation. A teenager, for instance, behaves very differently with a group of peers and with his or her grandmother. That's obvious. So why do we expect a single score on a handful of dimensions to reflect how we will behave in all circumstances? It's bizarre.

I don't expect companies to stop using these tests any time soon. Come on - some still use 'graphology', expecting handwriting to give insights into personality. But employers and academics should at least be thinking twice about what they are testing and why.

Comments

  1. If you think science can help organisations make better evidence based decisions, it would be wiser to use the latest research in psychometrics to inform best practice. On the other hand, if you don't want to base decisions on statistically significant correlations of 0.3-0.5, then you had better be prepared to abandon ibuprofen (r=.14 with pain relief, n=8,488) and ... WAIT FOR IT .... abandon VIAGRA (r=.38, with improved sexual functioning, n=779). STEWART DESSON.

    ReplyDelete
    Replies
    1. You need to take up the stats with the author. But it's hard to deny his point that personality is not fixed but varies with context. Also I think the comparison with drugs is a little spurious. You can tell if taking viagra has an impact (I'm told). You can't tell if a personality test is valid in the same way

      Delete
  2. Brian Clegg .... the TED talk by Todd Rose is fantastic. It is relevant to the risk of boxing and using “averages” for personality.

    https://www.goodreads.com/videos/95437-the-myth-of-average-todd-rose-at-tedx-sonoma-county

    The talk looks at cockpit size and the myth of the “average pilot”. Very relevant to what we do in the realm of personality.

    ReplyDelete
    Replies
    1. Stewart - the book I am quoting is by Todd Rose - all that stuff is in it. (See review.)

      Delete

Post a Comment

Popular posts from this blog

Why I hate opera

If I'm honest, the title of this post is an exaggeration to make a point. I don't really hate opera. There are a couple of operas - notably Monteverdi's Incoranazione di Poppea and Purcell's Dido & Aeneas - that I quite like. But what I do find truly sickening is the reverence with which opera is treated, as if it were some particularly great art form. Nowhere was this more obvious than in ITV's recent gut-wrenchingly awful series Pop Star to Opera Star , where the likes of Alan Tichmarsh treated the real opera singers as if they were fragile pieces on Antiques Roadshow, and the music as if it were a gift of the gods. In my opinion - and I know not everyone agrees - opera is: Mediocre music Melodramatic plots Amateurishly hammy acting A forced and unpleasant singing style Ridiculously over-supported by public funds I won't even bother to go into any detail on the plots and the acting - this is just self-evident. But the other aspects need some ex

Is 5x3 the same as 3x5?

The Internet has gone mildly bonkers over a child in America who was marked down in a test because when asked to work out 5x3 by repeated addition he/she used 5+5+5 instead of 3+3+3+3+3. Those who support the teacher say that 5x3 means 'five lots of 3' where the complainants say that 'times' is commutative (reversible) so the distinction is meaningless as 5x3 and 3x5 are indistinguishable. It's certainly true that not all mathematical operations are commutative. I think we are all comfortable that 5-3 is not the same as 3-5.  However. This not true of multiplication (of numbers). And so if there is to be any distinction, it has to be in the use of English to interpret the 'x' sign. Unfortunately, even here there is no logical way of coming up with a definitive answer. I suspect most primary school teachers would expands 'times' as 'lots of' as mentioned above. So we get 5 x 3 as '5 lots of 3'. Unfortunately that only wor

Which idiot came up with percentage-based gradient signs

Rant warning: the contents of this post could sound like something produced by UKIP. I wish to make it clear that I do not in any way support or endorse that political party. In fact it gives me the creeps. Once upon a time, the signs for a steep hill on British roads displayed the gradient in a simple, easy-to-understand form. If the hill went up, say, one yard for every three yards forward it said '1 in 3'. Then some bureaucrat came along and decided that it would be a good idea to state the slope as a percentage. So now the sign for (say) a 1 in 10 slope says 10% (I think). That 'I think' is because the percentage-based slope is so unnatural. There are two ways we conventionally measure slopes. Either on X/Y coordiates (as in 1 in 4) or using degrees - say at a 15° angle. We don't measure them in percentages. It's easy to visualize a 1 in 3 slope, or a 30 degree angle. Much less obvious what a 33.333 recurring percent slope is. And what's a 100% slope