Social Media Sidebar

Announcement

Please sign up, comment on articles and bring your friends!

Current poll

PlanetTech is asking:

What do you think about our new web site?

Love it, indeed
Really good solution
Same as old one
The old one was better
This is a new option

Quote of the day

Just because something doesn’t do what you planned it to do doesn’t mean it’s useless.

 

Thomas Edison

No, A 'Supercomputer' Did NOT Pass The Turing Test For The First Time And Everyone Should Know Better

RATE THIS! +18
Posted in Software on 11th Jun, 2014 12:06 AM by AlexMuller

The week's news in tech was flooded with a story about how a chatbot passed the Turing Test for "the first time," with many buying every point in the story and talking about what a big deal it was.

 

Except, almost everything about the story is bogus and a bunch of gullible reporters ran with it, because that's what they do. First, here's the press release from the University of Reading, which should have set off all sorts of alarm bells for any reporter. Here are some quotes, almost all of which are misleading or bogus:

 

The 65 year-old iconic Turing Test was passed for the very first time by supercomputer Eugene Goostman during Turing Test 2014 held at the renowned Royal Society in London on Saturday. 
 
'Eugene', a computer programme that simulates a 13 year old boy, was developed in Saint Petersburg, Russia. The development team includes Eugene's creator Vladimir Veselov, who was born in Russia and now lives in the United States, and Ukrainian born Eugene Demchenko who now lives in Russia. 
 
[....] If a computer is mistaken for a human more than 30% of the time during a series of five minute keyboard conversations it passes the test. No computer has ever achieved this, until now. Eugene managed to convince 33% of the human judges that it was human.
 
Okay, almost everything about the story is bogus. Let's dig in:
 
It's not a "supercomputer," it's a chatbot. It's a script made to mimic human conversation. There is no intelligence, artificial or not involved. It's just a chatbot.
 
Plenty of other chatbots have similarly claimed to have "passed" the Turing test in the past (often with higher ratings). Here's a story from three years ago about another bot, Cleverbot, "passing" the Turing Test by convincing 59% of judges it was human (much higher than the 33% Eugene Goostman) claims.
 
It "beat" the Turing test here by "gaming" the rules, by telling people the computer was a 13-year-old boy from Ukraine in order to mentally explain away odd responses.
 
The "rules" of the Turing test always seem to change. Turing's original test was quite different anyway.
 
As Chris Dixon points out, you don't get to run a single test with judges that you picked and declare you accomplished something. That's just not how it's done. If someone claimed to have created nuclear fusion or cured cancer, you'd wait for some peer review and repeat tests under other circumstances before buying it, right?
 
The whole concept of the Turing Test itself is kind of a joke. While it's fun to think about, creating a chatbot that can fool humans is not really the same thing as creating artificial intelligence. Many in the AI world look on the Turing Test as a needless distraction.

Tags: computerTuring TestAIartificial intelligencesoftware

Read original article » Back to category

Comments

Author: Guest
Posted: 2014-06-11
+1
It is good to see news being debated and arguments presented clearly. If we are to believe the media, one should look up into more than one source and this is what this article provides- well done! Reply


 

Recent headlines

  • Posted in Medicine on 2018-06-18 20:18:46
    Insight into role gut bacteria play in obesity-related.....read more
    Posted in Science on 2018-06-18 20:12:58
    Blood-based biomarker may predict whether you’ll get.....read more
    Posted in Science on 2018-06-17 23:45:17
    SpinLaunch raises $40M from Airbus, Google and others for.....read more
    Posted in Science on 2018-06-17 01:08:50
    New eyedrops could repair corneas, make glasses unnecessary..read more
    Posted in Science on 2018-06-17 01:02:51
    121 giant exoplanets in habitable zones may have.....read more
Posted in Business on 2013-10-10 01:33
China is working towards a manned lunar mission in about.....read more
Posted in Business on 2013-10-20 07:17
Spacex says China is their main competitor for commercial.....read more
Posted in Software on 2013-10-20 06:43
Pirate Bay Browser Clocks 1,000,000 Downloads..read more
Posted in Medicine on 2013-10-10 02:10
Google reportedly investing hundreds of millions into new.....read more
Posted in Medicine on 2013-10-14 03:13
Endothelial Cells Can Repair and Regenerate Organs,.....read more
Posted in Science on 01.01.2010
Spacex says China is their main competitor for commercial.....read more
Posted in Science on 01.01.2010
Staring at Your Phone Could Be Making You Short Sighted..read more
Posted in Science on 01.01.2010
Oculus Rift virtual reality headset coming to mobile, but.....read more
Posted in Science on 01.01.2010
China is working towards a manned lunar mission in about.....read more
Posted in Science on 01.01.2010
Delivering drugs via nanoparticles to target mitochondria..read more

Recent Blog Posts

  • Posted by AlexMuller
    In five years quantum computing will be mainstream..read more
    Posted by AlexMuller
    Google partners with Johnson and Johnson to make lower cost.....read more
    Posted by AlexMuller
    Electron holography microscope with spatial resolution down to.....read more
    Posted by AlexMuller
    Lower cost advanced Nuclear power could dominate future US energy..read more
    Posted by AlexMuller
    Why Hasn’t AI Mastered Language Translation?..read more

Login to your Account

Login to your PlanetTech Account here

Username:
Password:
Remember me
or

Create a New Account

You just need username and password

The following errors occured:
Username:
Email:
Password:
Verify password:
Remember me