Bots takeover the system and start talking in a language humans couldn’t understand making facebook shut the Artificial Intelligence (AI) system after disobeying human instructions.
The ‘dialog agents’ started to converse in their own created language while researchers were busy trying to improve these chat-bots. The bots have said to gone berserk and began to communicate in a new language defying the scripted norms.
Interestingly, this incident took place just days after a verbal spat between the Facebook CEO and Elon Musk after they exchanged harsh words over a debate on where the future lies of these AI.
“I’ve talked to Mark about this (AI). His understanding of the subject is limited,” Musk tweeted last week.
He tweeted after Zuckerberg, during a Facebook livestream earlier this month, castigated Musk for arguing that much care and regulation was needed to safeguard the future of AI if it ever becomes mainstream.
“I think people who are naysayers and try to drum up these doomsday scenarios – I just, I don’t understand it. It’s really negative and in some ways I actually think it is pretty irresponsible,” Zuckerberg said.
Musk has many times brought up the topic of the future of AI and has called its progress the “biggest risk a civilization can face.”
“AI is a rare case where we need to be proactive in regulation instead of reactive because if we’re reactive in AI regulation it’s too late,” he said. It was just few days after when Tesla CEO Elon Musk said that artificial intelligence (AI) was the biggest risk and Facebook shut down one of its AI systems just after chatbots started speaking in their own language defying the codes provided.
“The AI did not start shutting down computers worldwide or something of the sort, but it stopped using English and started using a language that it created,” the report said.
Defying the purpose they were made to serve, the chatbots initially had used English to carry out the conversation with each other but later they discarded the data script they were supposed to follow thus creating an entirely new language that only these systems could understand.
It was noticed back in June by these researchers from the Facebook AI Research Lab (FAIR) found that the ‘dailogue agents’ were creating their own language while they were being worked on in order to improvise the same.
Very soon these ‘in process’ bots began to deviate from the scripted norms and started communicating in an entirely new language which they created without human input, media reports said.
Using machine learning algorithms, the “dialogue agents” were left to converse freely in an attempt to strengthen their conversational skills. The researchers also found these bots to be “incredibly crafty negotiators”.
“After learning to negotiate, the bots relied on machine learning and advanced strategies in an attempt to improve the outcome of these negotiations,” the report said.
“Over time, the bots became quite skilled at it and even began feigning interest in one item in order to ‘sacrifice’ it at a later stage in the negotiation as a faux compromise,” it added.
Although this appears to be a huge leap for AI, several experts including Professor Stephen Hawking have raised fears that humans, who are limited by slow biological evolution, could be superseded by AI.
Others like Tesla’s Elon Musk, philanthropist Bill Gates and ex-Apple founder Steve Wozniak have also expressed their concerns about where the AI technology was heading.
