by Max More and Natasha Vita-More · 4 Mar 2013 · 798pp · 240,182 words
. Both human beings and bacteria have good claims to being the “dominant species” on Earth – depending upon how one defines dominant. It is possible that superintelligent machines may wish to dominate some niche that is not presently occupied in any serious fashion by human beings. If this is the case, then from
…
AI occur? I can imagine several scenarios, and I’m sure other people can imagine more. Perhaps the most important point to make is that superintelligent machines may not be competing in the same niche with human beings for resources, and would therefore have little incentive to dominate us. In such a
by Martin Ford · 13 Sep 2021 · 288pp · 86,995 words
issue into an already dysfunctional political process. Do we really want politicians with little or no understanding of the technology tweeting about the dangers of superintelligent machines? Given the very limited ability of the U.S. government in particular to accomplish almost anything at all, I also worry that hyping or politicizing
by Amy Webb · 5 Mar 2019 · 340pp · 97,723 words
for innovation and progress. We’re in the midst of a very long transition, from artificial narrow intelligence to artificial general intelligence and, very possibly, superintelligent machines. Any regulations created in 2019 would be outdated by the time they went into effect. They might alleviate our concerns for a short while, but
by Tom Chivers · 12 Jun 2019 · 289pp · 92,714 words
New York Times bestseller list. And it is, once you get your head around it, somewhat terrifying. It compares humanity’s efforts to build a superintelligent machine – and those efforts are ongoing, serious and, possibly, quite close to completion – to a bunch of sparrows trying to find an owl chick to raise
by Eliezer Yudkowsky and Nate Soares · 15 Sep 2025 · 215pp · 64,699 words
ARGUMENT IS STRAIGHTFORWARD: Creating machines that think faster and better than humanity would hit the world harder than anything has ever hit it before. Creating superintelligent machines seems like the sort of project that would be difficult to get right. If you look around at the way corporations and lawmakers are approaching
by John Brockman · 5 Oct 2015 · 481pp · 125,946 words
superhuman intelligence will be expensive and require enormous amounts of electrical power—they’ll need to earn money to survive. The environmental playing field for superintelligent machines is already in place; in fact, the Darwinian game is afoot. The trading machines of investment banks are competing, for serious money, on the world
…
for very little cost and more leisure time available to those who want it. Of course, the first superintelligent machines probably won’t be corporate; they’ll be operated by governments. And this will be much more hazardous. Governments are more flexible in their actions
…
this world is the simulation to torture those who didn’t help it come into existence earlier. Maybe, if you do work on AI, our superintelligent machine overlords will be good to you. OUR MASTERS, SLAVES, OR PARTNERS? JOHN MARKOFF Senior writer, science section, New York Times; author, Machines of Loving Grace
…
the universe (13.8 billion years) and even of our own solar system (4.6 billion years). As per the paradox that Fermi posed, if superintelligent machines arose elsewhere in the galaxy then they should already be here; since we don’t see them, some argue, technologically advanced life must not yet
…
intelligent. Worrying about the dangers of unfriendly AI is a prime example. A preoccupation with the risks of superintelligent machines is the smart person’s Kool-Aid. This is not to say that superintelligent machines pose no danger to humanity. It’s simply that there are many other more pressing and more probable risks
…
tend to argue that the other risks are already the subject of much discussion, and that even if the probability of being wiped out by superintelligent machines is low, it’s surely wise to allocate some brainpower to preventing such an event, given the existential nature of the threat. Not coincidentally, the
…
Theory of Mind. I suspect the closest we can come to knowing this most complex of states is indirectly, by studying the behavior of these superintelligent machines. They will have crossed that threshold when they start replicating and looking for an energy source solely under their control. If this should occur, and
…
and will be more than a tool, more than our servant. What kind of relationship might we expect? We’re hearing a lot about how superintelligent machines may spell the end of the human race—and that the future relationship between humans and AI will be a contest for domination. Another path
…
far so majestic, if it weren’t for the idea that the trajectory of improvement would itself be out of our control, such that these superintelligent machines might gravitate to “goals” (metrics by which they decide what to do) that we dislike. Much work has been done on ways to avoid this
…
horrifying danger—that of the extinction of everything that matters to us. But our reptilian brains also see in them the savior; we hope that superintelligent machines will offer us eternal life and youth. Intimations of these ways of thinking are embedded in our language. While in English the terms robot and
…
; that’s why, even in science fiction, humans usually find unexpected ways to beat the logic of the machines. Therefore the possibility of a flawless superintelligent machine seems like science fiction: We can never condense the entire knowledge of the world, so we can’t teach a machine how to do it
by Kevin Roose · 481pp · 151,124 words
met others who had started “looksmaxxing”—working out, buying new clothes, injecting themselves with gray-market Chinese peptides—because they believed that as soon as superintelligent machines took over, intelligence would no longer be a high-status trait among humans and all that would matter is how hot you were. These were
by Susan Schneider · 1 Oct 2019 · 331pp · 47,993 words
value them because we feel an affinity of consciousness—thus most of us recoil from killing a chimp, but not from eating an orange. If superintelligent machines are not conscious, either because it’s impossible or because they aren’t designed to be, we could be in trouble. It is important to
by Stuart Russell · 7 Oct 2019 · 416pp · 112,268 words
neutron-induced nuclear chain reaction, superintelligent AI in some form could arrive quite suddenly. The chances are that we would be unprepared: if we built superintelligent machines with any degree of autonomy, we would soon find ourselves unable to control them. I am, however, fairly confident that we have some breathing space
…
of the “take over the world” variety. The existential risk from AI does not come primarily from simple-minded killer robots. On the other hand, superintelligent machines in conflict with humanity could certainly arm themselves this way, by turning relatively stupid killer robots into physical extensions of a global control system. Eliminating
…
species has essentially no future beyond that which we deign to allow. We do not want to be in a similar situation vis-à-vis superintelligent machines. I’ll call this the gorilla problem—specifically, the problem of whether humans can maintain their supremacy and autonomy in a world that includes machines
…
mind.” This commandment precludes computing devices of any kind. All these drastic responses reflect the inchoate fears that machine intelligence evokes. Yes, the prospect of superintelligent machines does make one uneasy. Yes, it is logically possible that such machines could take over the world and subjugate or eliminate the human race. If
…
upon us noiselessly and by imperceptible approaches.” The prologue to Max Tegmark’s Life 3.0 describes in some detail a scenario in which a superintelligent machine gradually assumes economic and political control over the entire world while remaining essentially undetected. The Internet and the global-scale machines that it supports—the
…
the true nature of the problem. I don’t mean to suggest that there cannot be any reasonable objections to the view that poorly designed superintelligent machines would present a serious risk to humanity. It’s just that I have yet to see such an objection. Since the issue seems to be
…
questioners so that they ask only simple questions. And, finally, we have yet to invent a firewall that is secure against ordinary humans, let alone superintelligent machines. I think there might be solutions to some of these problems, particularly if we limit Oracle AI systems to be provably sound logical or Bayesian
…
pleasure existed—no knowledge, no love, no enjoyment of beauty, no moral qualities.”9 This finds its modern echo in Stuart Armstrong’s point that superintelligent machines tasked with maximizing pleasure might “entomb everyone in concrete coffins on heroin drips.”10 Another example: in 1945, Karl Popper proposed the laudable goal of
…
extreme caution. 10 PROBLEM SOLVED? If we succeed in creating provably beneficial AI systems, we would eliminate the risk that we might lose control over superintelligent machines. Humanity could proceed with their development and reap the almost unimaginable benefits that would flow from the ability to wield far greater intelligence in advancing
…
a global scale along with radical changes in how our society works. To avoid making a bad situation worse, we might need the help of superintelligent machines, both in shaping the solution and in the actual process of achieving a balance for each individual. Any parent of a small child is familiar
…
–42, 165–69 governance of, 249–53 health advances and, 101 history of, 4–6, 40–42 human preferences and (See human preferences) imagining what superintelligent machines could do, 93–96 intelligence, defining, 39–61 intelligent personal assistants and, 67–71 limits of superintelligence, 96–98 living standard increases and, 98–100
by Erik J. Larson · 5 Apr 2021
philosopher Nick Bostrom, prominent purveyors of the myth, talk not only as if human-level AI were inevitable, but as if, soon after its arrival, superintelligent machines would leave us far behind. This book explains two important aspects of the AI myth, one scientific and one cultural. The scientific part of the
…
usher in greater-than-human intelligence in an escalating process of self-modification. In ominous language, Bostrom echoes Good’s futurism about the arrival of superintelligent machines: Before the prospect of an intelligence explosion, we humans are like small children playing with a bomb. Such is the mismatch between the power of
…
a particularly good System Y candidate for progress on AI toward general intelligence. THE EVOLUTIONARY TECHNOLOGISTS Many AI enthusiasts who hold to an inevitability thesis (superintelligent machines are coming, no matter what we do) hold to this because it plays on evolutionary themes, and thus conveniently absolves individual scientists from the responsibility
…
intelligence error with his much-discussed notion of ultraintelligence, proposing that the arrival of intelligent machines necessarily implied the arrival of superintelligent machines. Once the popular imagination accepted the idea of superintelligent machines, the rewriting of human purpose, meaning, and history could be told within the parameters of computation and technology. But ultraintelligent machines
…
has become, as Wiener worried, sanguinely anti-intellectual and even antihuman. The connection here to the myth is unavoidable, as mythology about the coming of superintelligent machines replacing humans makes concern over anti-intellectual and anti-human bias irrelevant. The very point of the myth is that anti-humanism is the future
…
pulled such fancies even more centrally into culture, with predictably narrow but flashy application successes touted as the future, which (alas) will be dominated by superintelligent machines. The vision of artificial general intelligence here is pure mythology and window dressing. No one is likely to understand even the core problems clearly, let
…
, 74; hierarchical pattern recognition theory of, 264–266; on human intelligence, 251; Law of Accelerating Returns of, 42, 47–48, 67; on singularity, 46; on superintelligent machines, 2; on Turing test, 193–194 ladder of causation, 130, 174 Lakatos, Imre, 48 Laney, Doug, 292n5 language. See natural language Lanier, Jaron, 84, 244
by Mo Gawdat · 29 Sep 2021 · 259pp · 84,261 words
by Nate Silver · 12 Aug 2024 · 848pp · 227,015 words
by Mark O'Connell · 28 Feb 2017 · 252pp · 79,452 words
by Nick Bostrom · 3 Jun 2014 · 574pp · 164,509 words
by Nick Bostrom · 26 Mar 2024 · 547pp · 173,909 words
by Ray Kurzweil · 25 Jun 2024
by Jill Lepore · 24 Aug 2026 · 363pp · 122,400 words
by Martin Ford · 16 Nov 2018 · 586pp · 186,548 words
by James Barrat · 30 Sep 2013 · 294pp · 81,292 words
by John Brockman · 19 Feb 2019 · 339pp · 94,769 words
by Adam Becker · 14 Jun 2025 · 381pp · 119,533 words
by Melanie Mitchell · 14 Oct 2019 · 350pp · 98,077 words
by Yuval Noah Harari · 9 Sep 2024 · 566pp · 169,013 words
by Peter H. Diamandis and Steven Kotler · 13 Apr 2026 · 225pp · 76,418 words
by Keach Hagey · 19 May 2025 · 439pp · 125,379 words
by Paul Scharre · 23 Apr 2018 · 590pp · 152,595 words
by Nick Bostrom and Milan M. Cirkovic · 2 Jul 2008
by Parmy Olson · 284pp · 96,087 words
by Ray Kurzweil · 14 Jul 2005 · 761pp · 231,902 words
by Richard Yonck · 7 Mar 2017 · 360pp · 100,991 words
by Christopher Summerfield · 11 Mar 2025 · 412pp · 122,298 words
by Sebastian Mallaby; · 30 Mar 2026 · 607pp · 161,998 words
by Luke Dormehl · 10 Aug 2016 · 252pp · 74,167 words
by Michael Kearns and Aaron Roth · 3 Oct 2019
by Jeanette Winterson · 15 Mar 2021 · 256pp · 73,068 words
by Jeff Hawkins · 15 Nov 2021 · 253pp · 84,238 words
by Stuart Russell and Peter Norvig · 14 Jul 2019 · 2,466pp · 668,761 words
by Joshua Cooper Ramo · 16 May 2016 · 326pp · 103,170 words
by Anthony Berglas, William Black, Samantha Thalind, Max Scratchmann and Michelle Estes · 28 Feb 2015
by Thomas H. Davenport and Julia Kirby · 23 May 2016 · 347pp · 97,721 words
by Samuel Arbesman · 18 Jul 2016 · 222pp · 53,317 words
by Timothy Ferriss · 6 Dec 2016 · 669pp · 210,153 words
by John Markoff · 24 Aug 2015 · 413pp · 119,587 words
by David Goodhart · 7 Sep 2020 · 463pp · 115,103 words
by Pedro Domingos · 21 Sep 2015 · 396pp · 117,149 words
by Rob Reich, Mehran Sahami and Jeremy M. Weinstein · 6 Sep 2021
by Jeff Hawkins and Sandra Blakeslee · 1 Jan 2004 · 246pp · 81,625 words
by Jevin D. West and Carl T. Bergstrom · 3 Aug 2020