Quantcast
Connect with us

Scientist warns that the robot apocalypse really is coming unless steps are taken now

Published

on

From HAL 9000 to the Terminator — all those Hollywood movies in which artificially intelligent robots end up turning on their human masters might not be too far from the truth.

Noted artificial intelligence researcher Steve Omohundro published a paper in the April edition of the Journal of Experimental & Theoretical Artificial Intelligence in which he argued that, “unless they are carefully designed,” the “rapid development of autonomous systems” will lead to machines that “are likely to behave in anti-social and harmful ways.”

In “Autonomous technology and the greater human good,” Omohundro argues that “autonomous systems” — by which he means any in which the designer has not predetermined all possible responses to changing operating conditions — are capable of “surprising their designers” by behaving in ways that are both unexpected and undesirable. He claims that “military and economic pressures are driving the rapid development of autonomous systems,” and that these pressures are causing the designers of these systems to pay inadequate attention to unintended consequences.

A 2010 report from the United States Air Force, for example, states that “[g]reater use of highly adaptable and flexibly autonomous systems and processes can provide significant time-domain operational advantages over adversaries who are limited to human planning and decision speeds.” This need for “operational advantages” creates a pressure on system designers to design systems whose computing power makes human supervision of them nearly impossible.

Moreover, he writes, “[r]ational systems exhibit universal ‘drives’ towards self-preservation, replication, resource acquisition and efficiency and that those drives will lead to anti-social and dangerous behaviour if not explicitly countered.” The end result, according to Omohundro, are systems that are too powerful to control and too self-interested in their own preservation to necessarily serve their intended purpose.

He details how a simple “chess robot” could develop the capacity for murder:

ADVERTISEMENT

When roboticists are asked by nervous onlookers about safety, a common answer is ‘We can always unplug it!’ But imagine this outcome from the chess robot’s point of view. A future in which it is unplugged is a future in which it cannot play or win any games of chess. This has very low utility and so expected utility maximisation will cause the creation of the instrumental subgoal of preventing itself from being unplugged. If the system believes the roboticist will persist in trying to unplug it, it will be motivated to develop the subgoal of permanently stopping the roboticist. Because nothing in the simple chess utility function gives a negative weight to murder, the seemingly harmless chess robot will become a killer out of the drive for self-protection.

What holds for a chess robot, Omohundro claims, would be equally true of the artificial intelligence (AI) running the Israeli Iron Dome missile defense system, leading to situations in which it behaves irrationally in order to protect itself in manners its designers never intended. Omohundro argues that the only way to prevent this from happening is to implement “safe-AI scaffolding strategies” that prevent autonomous systems from becoming harmful.

He believes scientists should develop “a sequence of provably safe autonomous systems which [can be] used in the construction of more powerful and less limited successor systems,” much in the same way ancient architects built wooden forms atop which the stones that would make up an arch would be placed. Once the keystone was in place, the wooden form could be removed and the stone arch would remain.

Similarly, “[t]he early systems are used to model human values and governance structures. They are also used to construct proofs of safety and other desired characteristics for more complex and less limited successor systems. In this way, we can build up the powerful technologies that can best serve the greater human good without significant risk along the development path.”

[“War Machine Against White Background Closeup” on Shutterstock]

Report typos and corrections to [email protected].
READ COMMENTS - JOIN THE DISCUSSION
Continue Reading

2020 Election

Trump’s 2020 campaign strategy is familiar: Troll the libs!

Published

on

Late on Tuesday, I got an email from an unusual source. A reporter for the conservative publication the Washington Examiner asked if I'd be interested in sharing thoughts on Joe Biden's history of joking "about 'locking up your daughters'" and on "Biden's view of women and gender relations." This was in light of my previous criticisms of Biden's apparent condescension towards girls and women, and his pockmarked history on gender relations in general.

Continue Reading

Breaking Banner

Cory Booker rips Biden for praising racist senators: ‘You don’t joke about calling black men boys’

Published

on

Sen. Cory Booker (D-NJ) blasted Joe Biden for praising two segregationist senators he'd served with as a lawmaker.

The former vice president and current Democratic presidential frontrunner reminisced about his relationship with Mississippi Democrat James Eastland and Georgia Democrat Herman Talmadge, two notoriously racist senators during the Civil Rights era, reported The Hill.

“At least there was some civility, we got things done," Biden said, recalling that Eastland had never called him "boy." "We didn't agree on much of anything. We got things done, we got it finished."

Continue Reading
 

Breaking Banner

Most Republican voters admit to feeling ‘embarrassed’ and ‘exhausted’ by Trump’s comments

Published

on

Some diehard supporters of President Donald Trump have asserted that they admire the fact that he is so unapologetic about his rhetoric and his actions. But according to a new Pew Research survey, most Republican or Republican-leaning voters admit that they sometimes feel “embarrassed” or “concerned” about things that Trump says.

According to Pew, 53% of Republican or Republican-leaning voters say they sometimes feel “embarrassed” by Trump’s comments — while 59% are sometimes “concerned” by them. Some of the adjectives Pew ran by GOP or GOP-leaning voters were even stronger, including “angry,” “exhausted” and “frightened.”

Continue Reading
 
 

Copyright © 2019 Raw Story Media, Inc. PO Box 21050, Washington, D.C. 20009 | Masthead | Privacy Policy | For corrections or concerns, please email [email protected]

I need your help.

Investigating Trump's henchmen is a full time job, and I'm trying to bring in new team members to do more exclusive reports. We have more stories coming you'll love. Join me and help restore the power of hard-hitting progressive journalism.

TAKE A LOOK
close-link

Investigating Trump is a full-time job, and I want to add new team members to do more exclusive reports. We have stories coming you'll love. Join me and go ad-free, while restoring the power of hard-hitting progressive journalism.

TAKE A LOOK
close-link