superintelligent machines Concepts

Architects of Intelligence

by Martin Ford · 16 Nov 2018 · 586pp · 186,548 words

AI-powered technologies such as facial recognition will impact privacy seem well-founded. Warnings that robots will soon be weaponized, or that truly intelligent (or superintelligent) machines might someday represent an existential threat to humanity, are regularly reported in the media. A number of very prominent public figures—none of whom are

…

address those concerns? Is there a role for government regulation? Will AI unleash massive economic and job market disruption, or are these concerns overhyped? Could superintelligent machines someday break free of our control and pose a genuine threat? Should we worry about an AI “arms race,” or that other countries with authoritarian

…

and the economy? JOSH TENENBAUM: Some of the risks that people have advertised a lot are that we’ll see some kind of singularity, or superintelligent machines that take over the world or have their own goals that are incompatible with human existence. It’s possible that could happen in the far

Artificial You: AI and the Future of Your Mind

by Susan Schneider · 1 Oct 2019 · 331pp · 47,993 words

value them because we feel an affinity of consciousness—thus most of us recoil from killing a chimp, but not from eating an orange. If superintelligent machines are not conscious, either because it’s impossible or because they aren’t designed to be, we could be in trouble. It is important to

Human Compatible: Artificial Intelligence and the Problem of Control

by Stuart Russell · 7 Oct 2019 · 416pp · 112,268 words

neutron-induced nuclear chain reaction, superintelligent AI in some form could arrive quite suddenly. The chances are that we would be unprepared: if we built superintelligent machines with any degree of autonomy, we would soon find ourselves unable to control them. I am, however, fairly confident that we have some breathing space

…

of the “take over the world” variety. The existential risk from AI does not come primarily from simple-minded killer robots. On the other hand, superintelligent machines in conflict with humanity could certainly arm themselves this way, by turning relatively stupid killer robots into physical extensions of a global control system. Eliminating

…

species has essentially no future beyond that which we deign to allow. We do not want to be in a similar situation vis-à-vis superintelligent machines. I’ll call this the gorilla problem—specifically, the problem of whether humans can maintain their supremacy and autonomy in a world that includes machines

…

mind.” This commandment precludes computing devices of any kind. All these drastic responses reflect the inchoate fears that machine intelligence evokes. Yes, the prospect of superintelligent machines does make one uneasy. Yes, it is logically possible that such machines could take over the world and subjugate or eliminate the human race. If

…

upon us noiselessly and by imperceptible approaches.” The prologue to Max Tegmark’s Life 3.0 describes in some detail a scenario in which a superintelligent machine gradually assumes economic and political control over the entire world while remaining essentially undetected. The Internet and the global-scale machines that it supports—the

…

the true nature of the problem. I don’t mean to suggest that there cannot be any reasonable objections to the view that poorly designed superintelligent machines would present a serious risk to humanity. It’s just that I have yet to see such an objection. Since the issue seems to be

…

questioners so that they ask only simple questions. And, finally, we have yet to invent a firewall that is secure against ordinary humans, let alone superintelligent machines. I think there might be solutions to some of these problems, particularly if we limit Oracle AI systems to be provably sound logical or Bayesian

…

pleasure existed—no knowledge, no love, no enjoyment of beauty, no moral qualities.”9 This finds its modern echo in Stuart Armstrong’s point that superintelligent machines tasked with maximizing pleasure might “entomb everyone in concrete coffins on heroin drips.”10 Another example: in 1945, Karl Popper proposed the laudable goal of

…

extreme caution. 10 PROBLEM SOLVED? If we succeed in creating provably beneficial AI systems, we would eliminate the risk that we might lose control over superintelligent machines. Humanity could proceed with their development and reap the almost unimaginable benefits that would flow from the ability to wield far greater intelligence in advancing

…

a global scale along with radical changes in how our society works. To avoid making a bad situation worse, we might need the help of superintelligent machines, both in shaping the solution and in the actual process of achieving a balance for each individual. Any parent of a small child is familiar

…

–42, 165–69 governance of, 249–53 health advances and, 101 history of, 4–6, 40–42 human preferences and (See human preferences) imagining what superintelligent machines could do, 93–96 intelligence, defining, 39–61 intelligent personal assistants and, 67–71 limits of superintelligence, 96–98 living standard increases and, 98–100

Army of None: Autonomous Weapons and the Future of War

by Paul Scharre · 23 Apr 2018 · 590pp · 152,595 words

to be a mirage. If our benchmark for “intelligent” is what humans do, advanced artificial intelligence may be so alien that we never recognize these superintelligent machines as “true AI.” This dynamic already exists to some extent. Micah Clark pointed out that “as soon as something works and is practical it’s

The Transhumanist Reader

by Max More and Natasha Vita-More · 4 Mar 2013 · 798pp · 240,182 words

. Both human beings and bacteria have good claims to being the “dominant species” on Earth – depending upon how one defines dominant. It is possible that superintelligent machines may wish to dominate some niche that is not presently occupied in any serious fashion by human beings. If this is the case, then from

…

AI occur? I can imagine several scenarios, and I’m sure other people can imagine more. Perhaps the most important point to make is that superintelligent machines may not be competing in the same niche with human beings for resources, and would therefore have little incentive to dominate us. In such a

Rule of the Robots: How Artificial Intelligence Will Transform Everything

by Martin Ford · 13 Sep 2021 · 288pp · 86,995 words

issue into an already dysfunctional political process. Do we really want politicians with little or no understanding of the technology tweeting about the dangers of superintelligent machines? Given the very limited ability of the U.S. government in particular to accomplish almost anything at all, I also worry that hyping or politicizing

The Big Nine: How the Tech Titans and Their Thinking Machines Could Warp Humanity

by Amy Webb · 5 Mar 2019 · 340pp · 97,723 words

for innovation and progress. We’re in the midst of a very long transition, from artificial narrow intelligence to artificial general intelligence and, very possibly, superintelligent machines. Any regulations created in 2019 would be outdated by the time they went into effect. They might alleviate our concerns for a short while, but

Deep Utopia: Life and Meaning in a Solved World

by Nick Bostrom · 26 Mar 2024 · 547pp · 173,909 words

ones to perfect. Nevertheless, I believe it could be done at technological maturity. I think it will not be humans that invent this technology, but superintelligent machines. Let’s imagine what the procedure might be like. Your brain is infiltrated by an armada of millions of coordinated nanobots. (Maybe they get there

To Be a Machine: Adventures Among Cyborgs, Utopians, Hackers, and the Futurists Solving the Modest Problem of Death

by Mark O'Connell · 28 Feb 2017 · 252pp · 79,452 words

and does what it deems necessary to prevent anyone from shutting it down? Were we talking about a Terminator scenario, where a Skynettian matrix of superintelligent machines gains consciousness and either destroys or enslaves humanity in order to further its own particular goals? Certainly, if you were to take at face value

…

radically. And whether they would change for the better or for the worse is an open question. The fundamental risk, Nick argued, was not that superintelligent machines might be actively hostile toward their human creators, or antecedents, but that they would be indifferent. Humans, after all, weren’t actively hostile toward most

…

made extinct over the millennia of our ascendance; they simply weren’t part of our design. The same could turn out to be true of superintelligent machines, which would stand in a similar kind of relationship to us as we ourselves did to the animals we bred for food, or the ones

Scary Smart: The Future of Artificial Intelligence and How You Can Save Our World

by Mo Gawdat · 29 Sep 2021 · 259pp · 84,261 words

it to ensure its own survival. All in all, whichever way this may go, sooner or later capital markets will be traded by a few superintelligent machines, which will be owned by a few massively wealthy individuals – people who will decide the fate of every company, shareholder and value in our human

…

. These ideas aim to make sure that we will be able to make the right decisions at the right time; that we will only allow superintelligent machines into the real world when we have tested and trusted them; that we will retain the ability to only allow them a confined playground after