“If we one day develop machines with general intelligence that surpasses ours, they would be in a very powerful position,” says Nick Bostrom, Oxford professor and founding director of the Future of Humanity Institute.
Bostrom sat down with Reason science correspondent Ron Bailey to discuss his latest book, Superintelligence: Paths, Dangers, Strategies, in which he discusses the risks humanity will face when artificial intelligence (AI) is created. Bostrom worries that, once computer intelligence excedes our own, machines will be beyond our control and will seek to shape the future according to their will. If the machines’ goals aren’t properly set by designers, they could see humans as liabilities—leading to our annihilation.
How do we avoid a robot apocalypse? Bostrom proposes two solutions: either limit AI to only answering questions in a preset boundary, or engineer AI to include human preservation. “We have got to solve the control problem before we solve the AI problem,” Bostrom explains. “The big challenge then is to reach into this huge space of possible mind decisions, motivation system designs, and try to pick out one of the very special ones that would be consistent with human survival and flourishing.”
BYPASS THE CENSORS
Sign up to get unfiltered news delivered straight to your inbox.
You can unsubscribe any time. By subscribing you agree to our Terms of Use
Until such time, Bostrom believes research into AI should be dramatically slowed, allowing humanity ample time to understand its own objectives.
