IBM’s double jeopardy
A few weeks ago, Colby Cosh—a friend of a friend of sorts who ordinarily writes reasonable things for a chap who still thinks the Edmonton Oilers are a real sports team—penned an article in his Maclean’s blog about Watson, IBM’s Jeopardy!-playing machine (“I’ll take ‘Cheap Publicity Stunts’ for $1000, Alex”, 16 January 2011), that I found to be dreadfully uninformed. The thrust of his argument is that Watson is a corporate “gimmick”—a fancy plea for media coverage by the faceless villains at IBM, with nothing of scientific interest going on underneath. Keep in mind that by the standards of this article, nothing in the “perpetually disappointing history of AI” will ever be interesting until we’ve graduated from tightly delimited objectives to Big Problems like the Turing Test:
Every article about Watson, IBM’s Jeopardy!-playing device, should really lead off with the sentence “It’s the year 2011, for God’s sake.†In the wondrous science-fiction future we occupy, even human brains have instant broadband access to a staggeringly comprehensive library of general knowledge. But the horrible natural-language skills of a computer, even one with an essentially unlimited store of facts, still compromise its function to the point of near-parity in a trivia competition against unassisted humans.
This isn’t far off from saying that particle physics will be perpetually disappointing until we’ve observed the Higgs boson, or that manned spaceflight is merely an expensive publicity stunt that will never be scientifically interesting until we’ve colonized the Moon: it leans heavily on popular culture as the ultimate barometer of scientific achievement, and it requires both ignorance of methodology and apathy towards specifics.
Colby and I had a five-minute skirmish about the article on Twitter, which as a format for debate is unwieldy as piss. I promised a proper response as soon as I cleared some other priorities off my plate. Those other priorities are still, to my annoyance, on my plate; but having finally paid good money to register my copy of MarsEdit, I’m thirsting for a scrap.
This topic will do as well as any. Reluctant as I am to swing the pretentious hammer of “I know what I’m talking about,” this really is (as the idiom goes) a chance for Faramir, Captain of Gondor, to show his quality. Computational linguistics happens to be my onetime research area, popular misunderstanding of science happens to be one of my favourite bugbears, and Kasparov’s anticomputer strategies against Deep Blue happened to make a cameo appearance in the meandering slop of my master’s dissertation. None of this matters a great deal, mind you. One should never be dismissive of journalists from a position of relative expertise; they’re the ones people actually read, and it’s vital to engage with what they say.
(It is a little game we play: they put it on the bill, I tear up the bill.)