Date:06/06/16
Google’s DeepMind team has been working with scientists to create a way in which humans can kill artificial intelligence agents before they can turn on us.
It’s a concern many have as the AI systems being developed by tech giants become more intelligent and more capable — but Google has us covered.
Google acquired DeepMind for around $400 million back in 2014, and since then, the company has done some incredible things with it. Its most recent achievement was beating one of the highest-ranked Go players, Lee Sedol, 4-1 in a five-game match.
What’s great about technologies like DeepMind is that they are always learning and becoming greater at what they do. Now even their creators are worried about what might happen should the AI decide that it no longer wants to be controlled by a human.
In a paper titled “Safely Interruptible Agents,” scientists at DeepMind and Oxford University reveal their plan for that scenario.
“If such an agent is operating in real-time under human supervision, now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions — harmful either for the agent or for the environment — and lead the agent into a safer situation,” the paper explains.
The paper also confirms that there is a “framework” in place that allows a human to safely intervene with an AI, while at the same time ensuring that the AI cannot learn how to prevent those interruptions.
“Safe interruptibility can be useful to take control of a robot that is misbehaving and may lead to irreversible consequences, or to take it out of a delicate situation,” the paper continues.
So, basically, we have to just trust that these systems will work. The researchers say they do with some algorithms, but others have to be adapted. And it’s not clear if all “can be easily made safely interruptible.”
Google DeepMind develops ‘big red button’ to stop AIs from causing harm
Google’s DeepMind team has been working with scientists to create a way in which humans can kill artificial intelligence agents before they can turn on us.It’s a concern many have as the AI systems being developed by tech giants become more intelligent and more capable — but Google has us covered.
Google acquired DeepMind for around $400 million back in 2014, and since then, the company has done some incredible things with it. Its most recent achievement was beating one of the highest-ranked Go players, Lee Sedol, 4-1 in a five-game match.
What’s great about technologies like DeepMind is that they are always learning and becoming greater at what they do. Now even their creators are worried about what might happen should the AI decide that it no longer wants to be controlled by a human.
In a paper titled “Safely Interruptible Agents,” scientists at DeepMind and Oxford University reveal their plan for that scenario.
“If such an agent is operating in real-time under human supervision, now and then it may be necessary for a human operator to press the big red button to prevent the agent from continuing a harmful sequence of actions — harmful either for the agent or for the environment — and lead the agent into a safer situation,” the paper explains.
The paper also confirms that there is a “framework” in place that allows a human to safely intervene with an AI, while at the same time ensuring that the AI cannot learn how to prevent those interruptions.
“Safe interruptibility can be useful to take control of a robot that is misbehaving and may lead to irreversible consequences, or to take it out of a delicate situation,” the paper continues.
So, basically, we have to just trust that these systems will work. The researchers say they do with some algorithms, but others have to be adapted. And it’s not clear if all “can be easily made safely interruptible.”
Views: 601
©ictnews.az. All rights reserved.
Similar news
- Azerbaijani project to monitor disease via mobile phones
- Innovative educational system to be improved under presidential decree
- NTRC prolongs license of two TV and radio organizations for 6 years
- Azerbaijan establishes e-registry for medicines
- Azerbaijani museum introduces e-guide
- Nar Mobile opens “Nar Dunyasi” sales and service center in Siyazan city
- International conference on custom electronic services held in Baku
- OIC secretary general to attend COMSTECH meeting in Baku
- Azerbaijan develops earthquake warning system
- New law to regulate transition to digital broadcasting in Azerbaijan
- Azerbaijani State Social Protection Fund introduces electronic digital signature
- Intellectual traffic management system in Baku to be commissioned in December
- Tax Ministry of Azerbaijan started receiving video-addresses
- World Bank recommends Azerbaijan to speed up e-service introduction in real estate
- Azerbaijan to shift to electronic registration of real estate
