There has been a lot of new reports that the chatbot Eugene Goostman has "beaten the Turing test" -- the classic test of machine intelligence proposed by AI pioneer Alan Turing, which says (loosely) that if an AI program can fool people into thinking it's human, in a textual conversation context, then it should be assumed to have human-level general intelligence.
Ben Goertzel is an Artificial Intelligence Expert. Here are highlights from his write up at Hplus Magazine.
In 2008, the chatbot Elbot convinced 30% of the Loebner Prize judges it was human.
Alan Turing somewhat arbitrarily set the threshold at 30% when he articulated his "imitation game" test back in 1950. Elbot almost met the criterion, but Eugene Goostmans beat it.
On the other hand, in the 2013 Loebner contest, no chatbot fooled any of the 4 judges. However, I [Ben Goertzel] suspect the 2013 Loebner chatbots were better than the 2008 Loebner chatbots, and the judges were just less naive in 2013 than 2008. And -- I'm just guessing here -- but I suspect the judges for the Eugene Goostman test were more on the naive side...
I [Ben Goertzel] doubt there has actually been any dramatic recent advance in chatbot technology. The fluctuation from 30% judges fooled in 2008 to 33% judges fooled in 2014 seems to me more likely to be "noise" resultant from differences in the panels of judges...
Read more »![]()
![]()
![]()
![]()
![]()
![]()
![]()
![]()
![]()
![]()
![]()
Ben Goertzel is an Artificial Intelligence Expert. Here are highlights from his write up at Hplus Magazine.
In 2008, the chatbot Elbot convinced 30% of the Loebner Prize judges it was human.
Alan Turing somewhat arbitrarily set the threshold at 30% when he articulated his "imitation game" test back in 1950. Elbot almost met the criterion, but Eugene Goostmans beat it.
On the other hand, in the 2013 Loebner contest, no chatbot fooled any of the 4 judges. However, I [Ben Goertzel] suspect the 2013 Loebner chatbots were better than the 2008 Loebner chatbots, and the judges were just less naive in 2013 than 2008. And -- I'm just guessing here -- but I suspect the judges for the Eugene Goostman test were more on the naive side...
I [Ben Goertzel] doubt there has actually been any dramatic recent advance in chatbot technology. The fluctuation from 30% judges fooled in 2008 to 33% judges fooled in 2014 seems to me more likely to be "noise" resultant from differences in the panels of judges...
Read more »
