I don’t get it — there are news reports everywhere credulously claiming that the Turing Test has been successfully passed, and they are all saying exactly the same thing: that over 30% of the judges couldn’t tell that a program called Eugene Goostman wasn’t a 13 year old boy from Odessa with limited language skills. We’re not hearing much about the judges, though: the most common thing to report is that one of them was
actor Robert Llewellyn, who played robot Kryten in the sci-fi comedy TV series Red Dwarf.
Instead of parroting press releases, it seems to me that the actual result should be reported as a minority of poorly qualified judges in a single media-driven event were trivially fooled by a clumsy chatbot with a background story to excuse its bad grammar and flighty behavior into thinking they were talking to a real person. It’s not so much a validation of the capabilities of an AI as it is an indictment of the superficiality of this test, as implemented.
Or, if an editor really wanted a short, punchy, sensationalist title, they have permission to steal mine.
We don’t yet have transcripts of the conversation, but the text of a 2012 test of the same program are available. They are painfully unimpressive.