Facebook shuts AI system after bots defy human instructions

While scientist and engineers are busy in developing a better world, where humans have to do less effort. Here’s the recent incident happened on Facebook that leaves all scientist thinking awestruck.
Facebook engineers and researchers are continuously busy in improving chatbots, the “dialogue agent”. But apart from this, the chatbots started creating their own language, they start to deviate from the scripted norms and started communicating in entirely new language.
According to a report in Tech Times on Sunday, the social media giant had to pull the plug on the AI system that its researchers were working on “because things got out of hand”.

Facebook shuts AI system after bots defy human instructions
© techcrunch

This incident came to light when the “dialogue agents” were left to converse freely in an attempt to strengthen their conversational skills. But in conversation process, the dialog agent starts deviating from its path as they started using their own language to do conversation, apart from English language and this language was an unreadable human language.
Days after Tesla CEO Elon Musk said that artificial intelligence (AI) was the biggest risk, Facebook has shut down one of its AI systems after chatbots started speaking in their own language defying the codes provided.
“The AI did not start shutting down computers worldwide or something of the sort, but it stopped using English and started using a language that it created,” the report noted.
Initially, AI is developed to use English languages which human can also understand and AI agents have strictly told not to deviate from its path, But AI also learned how to defy the users and they later created a new language that only AI system could understand.
This led Facebook researchers to shut down the AI systems and then force them to speak to each other only in English.
Facebook AI Research Lab (FAIR) found that while they were busy trying to improve chatbots, the “dialogue agents” were creating their own language. And soon they deviate from the scripted norms and started communicating in an entirely new language which they created without human input, media reports said.
Further investigating this topic the researchers also found these Bots to be “incredibly crafty negotiators”.
“After learning to negotiate, the bots relied on machine learning and advanced strategies in an attempt to improve the outcome of these negotiations,” the report said.
“Over time, the bots became quite skilled at it and even began feigning interest in one item in order to ‘sacrifice’ it at a later stage in the negotiation as a faux compromise,” it added.
Several experts like Professor Stephen Hawking have raised fears that humans, who are limited by slow biological evolution, could be superseded by AI.
This incident took place just days after a verbal spat between Facebook CEO and Musk who exchanged harsh words over a debate on the future of AI.
In the development of this world we have forgotten one thing that we are creating something that, if they are in a correct path they can create a better world and future, but if deviated, they ruin our life too and can supersede us.


Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.