Skip to main content

The amazing appearing station - big data needs checking

One lesson anyone who has played with AI and big data should learn is that you can't trust it without having some checks in place. The technology can do the grunt work wonderfully - but then it needs verifying. This came to light when ChatGPT was caught making up references - but it can happen in a more subtle way too that is reminiscent to me of a flaw most of us never thought of when we saw Apple's 1987 Knowledge Navigator video.

For those of us not ancient enough to remember it, Knowledge Navigator was a 'view of the future' video from Apple that predated iPads, folding screens and AI. In it, a distinctly smug academic uses a combination of AI, big data and a touch interface to link information about different events in the world to get the big picture. What said smug academic never does is actually check that what he is being shown is correct.

Of course Knowledge Navigator was fantasy - and for those of us who saw it when it came out, it was a genuinely wonderful peek into the future. (Bear in mind that Windows 3, the first really useable version of Windows didn't come out until 1990.) But these days it's easy to duplicate some of what it did using data tools such as 'Google My Maps' and a collection of locations to produce an impressive looking map. This is what was done using a list of UK stations published by the Daily Mirror, where ticket offices are scheduled to close.

When I came across the map online, I thought, out of interest, 'I wonder if my local station (Swindon) is losing its ticket office. I admit I never use the ticket office, but it's a big station and it seemed unfortunate if it were the case. Sure enough, as I zoomed in I saw an indicator by Swindon. But as I zoomed in further (see image at top), I noticed that it was actually to the east of Swindon. When I clicked on it, I was told that it was Wanborough station was closing.

As it happens, I used to live in the village of Wanborough. It has never had a station. The railway line doesn't go particularly near it. But, like many villages, its name is not unique. There is also a village called Wanborough in Surrey between Aldershot and Guildford - and that does have a station. Whoever combined the list of places with a map didn't bother to check for names that could be ambiguous.

I have no doubt that data tools and big data and AI will play bigger and bigger parts in our lives - but like ChatGPT's dodgy references, the mystery of the amazing appearing station underlines that it's likely there will always be a need for a degree of human checking to keep the algorithms and data tools on the right track.

See all of Brian's online articles or subscribe to a weekly digest for free here


Labels:

Comments

Post a Comment

Popular posts from this blog

Why I hate opera

If I'm honest, the title of this post is an exaggeration to make a point. I don't really hate opera. There are a couple of operas - notably Monteverdi's Incoranazione di Poppea and Purcell's Dido & Aeneas - that I quite like. But what I do find truly sickening is the reverence with which opera is treated, as if it were some particularly great art form. Nowhere was this more obvious than in ITV's recent gut-wrenchingly awful series Pop Star to Opera Star , where the likes of Alan Tichmarsh treated the real opera singers as if they were fragile pieces on Antiques Roadshow, and the music as if it were a gift of the gods. In my opinion - and I know not everyone agrees - opera is: Mediocre music Melodramatic plots Amateurishly hammy acting A forced and unpleasant singing style Ridiculously over-supported by public funds I won't even bother to go into any detail on the plots and the acting - this is just self-evident. But the other aspects need some ex
116 comments
Read more

Is 5x3 the same as 3x5?

The Internet has gone mildly bonkers over a child in America who was marked down in a test because when asked to work out 5x3 by repeated addition he/she used 5+5+5 instead of 3+3+3+3+3. Those who support the teacher say that 5x3 means 'five lots of 3' where the complainants say that 'times' is commutative (reversible) so the distinction is meaningless as 5x3 and 3x5 are indistinguishable. It's certainly true that not all mathematical operations are commutative. I think we are all comfortable that 5-3 is not the same as 3-5.  However. This not true of multiplication (of numbers). And so if there is to be any distinction, it has to be in the use of English to interpret the 'x' sign. Unfortunately, even here there is no logical way of coming up with a definitive answer. I suspect most primary school teachers would expands 'times' as 'lots of' as mentioned above. So we get 5 x 3 as '5 lots of 3'. Unfortunately that only wor
24 comments
Read more

Which idiot came up with percentage-based gradient signs

Rant warning: the contents of this post could sound like something produced by UKIP. I wish to make it clear that I do not in any way support or endorse that political party. In fact it gives me the creeps. Once upon a time, the signs for a steep hill on British roads displayed the gradient in a simple, easy-to-understand form. If the hill went up, say, one yard for every three yards forward it said '1 in 3'. Then some bureaucrat came along and decided that it would be a good idea to state the slope as a percentage. So now the sign for (say) a 1 in 10 slope says 10% (I think). That 'I think' is because the percentage-based slope is so unnatural. There are two ways we conventionally measure slopes. Either on X/Y coordiates (as in 1 in 4) or using degrees - say at a 15° angle. We don't measure them in percentages. It's easy to visualize a 1 in 3 slope, or a 30 degree angle. Much less obvious what a 33.333 recurring percent slope is. And what's a 100% slope
23 comments
Read more