by Terrence J. Sejnowski · 27 Sep 2018
. Printed and bound in the United States of America. Library of Congress Cataloging-in-Publication Data Names: Sejnowski, Terrence J. (Terrence Joseph), author. Title: The deep learning revolution / Terrence J. Sejnowski. Description: Cambridge, MA : The MIT Press, 2018. | Includes bibliographical references and index. Identifiers: LCCN 2017044863 | ISBN 9780262038034 (hardcover : alk. paper)
…
If you use voice recognition on an Android phone or Google Translate on the Internet, you have communicated with neural networks1 trained by deep learning. In the last few years, deep learning has generated enough profit for Google to cover the costs of all its futuristic projects at Google X, including self-driving cars
…
and Functional Architecture in the Cat’s Visual Cortex,” which reported for the first time the response properties of single neurons recorded with a microelectrode. Deep learning networks have an architecture similar to the hierarchy of areas in the visual cortex. 1969—Marvin Minsky and Seymour Papert published Perceptrons, which pointed
…
data; information can be used to create knowledge; knowledge leads to understanding; and understanding leads to wisdom. Welcome to the brave new world of deep learning.1 Deep learning is a branch of machine learning that has its roots in mathematics, computer science, and neuroscience. Deep networks learn from data the way that babies
…
s tensor processing unit (TPU) is now deployed on servers around the world, delivering an order-of-magnitude improvement in performance for deep learning applications. An example of how quickly deep learning can change the landscape is the impact it has had on language translation—a holy grail for artificial intelligence since it depends
…
on the ability to understand a sentence. The recently unveiled new version of Google Translate based on deep learning represents a quantum leap improvement in the quality of translation between natural languages. Almost overnight, language translation went from a fragmented hit-and-miss
…
jumble of phrases to seamless sentences (figure 1.3). Previous computer methods searched for combinations of words that could be translated together, but deep learning looks for dependencies across whole sentences. Alerted about the sudden improvement of Google Translate, on November 18, 2016, Jun Rekimoto at the University of
…
leopard. No one has ever explained what leopard wanted at that altitude.10 (Hemingway is #1.) The next step will be to train larger deep learning networks on paragraphs to improve continuity across sentences. Words have long cultural histories. Vladimir Nabokov, the Russian writer and English-language novelist who wrote Lolita
…
on slides is done by experts who make mistakes, mistakes that have deadly consequences. This is a pattern recognition problem for which deep learning should excel. And indeed, a deep learning network trained on a large dataset of slides for which ground truth was known reached an accuracy of 0.925, good but not
…
review, or discovery, will be taken over by artificial intelligence, which can sort through thousands of documents for legal evidence without getting tired. Automated deep learning systems will also help law firms comply with the increasing complexity of governmental regulations. They will make legal advice available for the average person who
…
given to the winner at the end of a sequence of moves, which paradoxically can improve decisions made much earlier. When coupled with many powerful deep learning networks, this leads to many domain-dependent bits of intelligence. And, indeed, cases have been made for different domaindependent kinds of intelligence: social, emotional,
…
steadily increasing since the advent of computer programs that play at championship levels, and so has the machine augmented intelligence of the human players.40 Deep learning will boost the intelligence not just of scientific investigators but of workers in all professions. Scientific instruments are generating data at prodigious rate. Elementary particle
…
than almost anyone else in the world and will not forget anything, becoming, in effect, your virtual doppelganger. By pressing both Internet tracking and deep learning into service, the educational opportunities for the children of today’s children will be better than the best available today to wealthy families. These grandchildren
…
beginning to benefit. Alexa, a wildly popular digital assistant operating in tandem with the Amazon Echo smart speaker, responds to natural language requests based on deep learning. Amazon Web Services (AWS) has introduced toolboxes called “Lex,” “Poly” and “Comprehend” that make it easy to develop the same natural language interfaces based
…
networks in the 1980s and as the president of the Neural Information Processing Systems (NIPS) Foundation, which has overseen discoveries in machine learning and deep learning over the last thirty years. My colleagues and I in the neural network community were for many years the underdogs, but our persistence and patience
…
earlier level. The decision demon weighs the degree of excitement and importance of its informants. This form of evidence evaluation is a metaphor for current deep learning networks, which have many more levels. From Peter H. Lindsay and Donald A. Norman, Human Information Processing: An Introduction to Psychology, 2nd ed. (New
…
based on the architecture of the visual system that used convolutional filters and a simple form of Hebbian plasticity and was a direct precursor of deep learning networks. And, for a third, Teuvo Kohonen, an electrical engineer at Helsinki University, developed a self-organizing network that could learn to cluster similar
…
networks was possible. 1986—David Rumelhart and Geoffrey Hinton publish “Learning Internal Representations by Error-Propagation,” which introduced the “backprop” learning algorithm now used for deep learning. 1988—Richard Sutton publishes “Learning to Predict by the Methods of Temporal Differences” in Machine Learning. Temporal difference learning is now believed to be the
…
2012 paper “ImageNet Classification with Deep Convolutional Neural Networks” reduces the error rate for correctly classifying objects in images by 18 percent. 2017—AlphaGo, a deep learning network program, beats Ke Jie, the world champion at Go. 6 The Cocktail Party Problem Chapter The Cocktail Party 6 Problem © Massachusetts Institute of
…
open. Recent experiments on neural network learning of language support the gradual acquisition of inflectional morphology, consistent with human learning.12 The success of deep learning with Google Translate and other natural language applications in capturing the nuances of language further supports the possibility that brains do not need to use
…
many networks yield the same behavior, the key to understanding them is the learning algorithms used by brains, which should be easier to discover. Understanding Deep Learning Whereas, in convex optimization problems, there are no local minima and convergence is guaranteed to the global minimum, in nonconvex optimization problems, this is
…
a network than those we receive from humans? Recall that consciousness does not have access to the inner workings of 124 Chapter 8 brains. Deep learning networks typically provide not one but several leading predictions in rank order, which gives us some information about the confidence of a conclusion. Supervised neural
…
zip codes on letters, using the Modified National Institute of Standards and Technology (MNIST) Figure 9.1 Geoffrey Hinton and Yann LeCun have mastered deep learning. This photo was taken at a meeting of the Neural Computation and Adaptive Perception Program of the Canadian Institute for Advanced Research around 2000, a
…
what the distributed representations at the top of the hierarchy were meant to accomplish. This illustrates the potential for fruitful symbiotic relationships between biology and deep learning. Deep Learning Meets the Visual Hierarchy A philosopher of the mind, Patricia Churchland specializes in neurophilosophy at UC, San Diego.13 That knowledge ultimately depends on how
…
following their intuitions; the theory of thermodynamics that explained how the engines worked came later, along with improvements in their efficiency. The analysis of deep learning networks by physicists and mathematicians is well under way. 134 Chapter 9 Working Memory and Persistence of Activity Neuroscience has come a long way since
…
-range dependencies are preserved selectively. This version of working memory in neural networks lay dormant for twenty years until it was awakened and implemented in deep learning networks, where it has been spectacularly successful in many domains that depend on learning sequences of inputs and outputs, such as movies, music, movements,
…
at Amherst, on difficult problems in reinforcement learning, a branch of machine learning inspired by associative learning in animal experiments (figure 10.2). Unlike a deep learning network, whose only job is to transform inputs into outputs, a reinforcement network interacts in a closed loop with the environment, receiving sensory input,
…
championship Go translate to solving other complex problems? Much of human learning is based on observation and mimicry, and we need far fewer examples than deep learning to learn to recognize a new object. Unlabeled sensory data are abundant, and powerful unsupervised learning algorithms might use these data to advantage before
…
any supervision takes place. In chapter 7, an unsupervised version of the Boltzmann learning algorithm was used to initialize deep learning networks, and in chapter 6, independent component analysis (ICA), an unsupervised learning algorithm, extracted sparse population codes from natural images and in chapter 9,
…
at Figure 11.1 Logo of the Neural Information Processing Systems conferences. Founded thirty years ago, NIPS conferences are the premier conferences on machine and deep learning. Courtesy of the NIPS Foundation. Neural Information Processing Systems 163 Figure 11.2 Edward “Ed” Posner at Caltech, who founded the NIPS conferences, which
…
new Halıcıoğlu Data Science Institute. Master’s in Data Science degrees (MDSs) are becoming as popular as MBAs. Neural Information Processing Systems 165 Deep Learning at the Gaming Table Deep learning came of age at the 2012 NIPS Conference at Lake Tahoe (figure 11.3). Geoffrey Hinton, an early pioneer in neural networks, and
…
temporal segmentation to video,19 a performance good Figure 12.6 Marian Stewart-Bartlett demonstrating facial expression analysis. The time lines are the output of deep learning networks that are recognizing facial expression for happiness, sadness, surprise, fear, anger, and disgust. Courtesy of Marian StewartBartlett. Robert Wright/LDV Vision Summit 2015.
…
a company called “Emotient” to commercialize the automatic analysis of facial expressions. Paul Ekman and I served on its Scientific Advisory Board. Emotient developed deep learning networks that had an accuracy of 96 percent in real time and with natural behavior, under a broad range of lighting conditions, and with nonfrontal
…
accomplish.19 But who could have predicted how well neural networks would scale in their performance? The Wolfram language that supports Mathematica now also supports deep learning applications, one of which was the first to provide online object recognition in images.20 Stephen introduced me to Beatrice Golomb, who was working
…
world. But now there are openly available alternatives to TensorFlow: CNTK from Microsoft, MVNet, backed by Amazon and other major Internet companies, and other viable deep learning programs, such as Caffe, Theano, and PyTorch. Hot Chips In 2011, I organized “Growing High Performance Computing in a Green Environment,” a symposium sponsored
…
need to move forward, not look backward. At every step along the way, adding a new feature from brain architecture has boosted the functionality of deep learning networks: the hierarchy of cortical areas; the brain’s coupling of deep with reinforcement learning; working memory in recurrent cortical networks; and long-term
…
after Minsky’s death, Alex Graves, Greg Wayne, and colleagues, researchers at DeepMind, achieved the next step toward a general artificial intelligence based on deep learning by adding a dynamic external memory.25 Activity patterns can only be stored temporarily in a deep recurrent neural network, which makes it difficult to
…
systems across spatial and temporal scales: gene networks, metabolic networks, immune networks, neural networks, and social networks—it’s networks all the way down. Deep learning depends on optimizing a cost function. What are the cost functions in nature? The inverse of cost in evolution is called fitness, but that is
…
1992; and many other foundational books on machine learning, including Richard Sutton and Andrew Barto’s Reinforcement Learning: An Introduction, and the leading textbook Deep Learning by Ian Goodfellow, Yoshua Bengio, and Aaron Courville. The Press’s Robert Prior helped guide the present volume around many an unexpected bend in its
…
I did not know this at the time. Recommended Reading Recommended Recommended Reading Reading © Massachusetts Institute of TechnologyAll Rights Reserved An Introduction to Neuroscience The Deep Learning Revolution only briefly touches on neuroscience, which is itself a vast field with a rapidly advancing scientific frontier. The part of neuroscience most relevant to
…
deep neural networks, 35 depends on optimizing a cost function, 267 meets the visual hierarchy, 132–133 origin and roots of, 3 understanding, 119–122 Deep learning systems, 159. See also specific topics DeepLensing, 21 DeepMind, 17, 20, 154. See also AlphaGo Deepstack, 15, 24 Index Defense Advanced Research Projects Agency
…
Goldilocks problem in, 112 Language acquisition, 184. See also Chomsky, Noam Language disorders, 190 Language translation. See Translation 331 Larochelle, Hugo, 302n4 Law firms, automated deep learning systems and, 15 Lawrence, David T., 44f, 291n9 Learning, 258. See also specific topics Chomsky and, 248f, 249f, 250, 251 forms of, 154–159
…
201, 267. See also Multilayer learning algorithms; Unsupervised learning algorithms; specific algorithms building a new generation of chips to run, 205 complex systems and, 196 deep learning and, 133, 140–141, 201 explored through simulations of small networks, 258 explosion of, 110 in historical context, 137, 172–173 unifying concepts and,
…
Minsky, Marvin Lee Petascale computing, 206, 208 Peterson, Roger Torey, 30f, 290n3 Phonemes, 113, 114f, 115, 116, 158 Piantoni, Giovanni, 227, 228f Picture captioning with deep learning, 135, 136f Pinker, Steven, 300n11 Pitts, Walter H., 106, 200, 298n21, 312n11 Planning Workshop on Facial Expression Understanding, 180–181 Plasticity critical period of, in
by Carissa Véliz · 21 Apr 2026 · 503pp · 129,255 words
rise of the internet and cloud computing, further increasing data availability and processing power. The 2010s marked a turning point with the practical application of deep learning, fueled by big data and improved hardware like GPUs. Advances in algorithms paved the way for machine learning—prediction machines. With prediction come all the
…
desired outcome is; then they feed it input in the form of data, but they don’t tell it how to get to the outcome. Deep learning, a subfield of machine learning that is focused on neural networks with many layers, starts with a model—a mathematical representation of the problem—and
…
, 26, 63, 64–86, 91, 186, 210, 211, 246, 277, 284–86 chatbots. See chatbots conservative nature of, 234 and correlation versus causation, 103–8 deep learning, 66, 68 difference between humans and, 61 ethics of, 289–91 existential risk from, 110–11, 181–83, 198, 208 general, 190 generative, as fortune
…
, 269, 272, 278 by algorithms, 59 expected utility theory and, 203 managerial, 165 mathematization of, 23, 24–63 political, 13–15, 56 Dee, John, 74 deep learning, 66, 68 Defense Department, 10, 80 defiance, 122, 145, 149, 225, 238, 268, 284–85 defying the odds, 229–57 communities and, 248–51 creativity
by Michael Easter · 25 Sep 2023 · 318pp · 95,383 words
choice. Instead, it’s a summation of repeated choices that make a different choice harder to make for environmental, biological, and historical reasons. It’s deep learning. Much like gaining weight. Few people set out to become obese. But over time, the weight accumulates, and we find ourselves obese. It happens through
by Peter H. Diamandis and Steven Kotler · 13 Apr 2026 · 225pp · 76,418 words
for the twenty-first century, when that drunken sailor’s loopy squiggle would start to resemble a hockey stick—the hallmark of exponential explosion. The Deep Learning Breakthrough: 2006–2012 It didn’t look like the start of the next AI revolution. It looked like a four-page paper in Science with
…
the error rate from the previous world record of 26.2 percent to 15.3—a leap so dramatic it stunned the AI community. Overnight, deep learning went from academic curiosity to industry obsession. “This was the big moment,” Nvidia CEO Jensen Huang (whose company makes the GPU powering today’s AI
…
revolution) told Business Insider. “The big bang of deep learning. A pivotal moment that marked the beginning of the AI revolution.” The victory was particularly sweet for Hinton, who had spent decades being told that
…
months, Google hired Hinton and his entire lab, and every major tech company began racing to build their own deep learning teams. The paradigm had shifted, and the world was paying attention. The deep learning uprising was no longer theoretical. What began as an obscure development had become a mainstream explosion. The six years
…
Neural Networks.” “This was the big moment”: Lloyd Lee, “Nvidia CEO Jensen Huang Shouts Out OpenAI Cofounder Ilya Sutskever for Sparking ‘the Big Bang of Deep Learning,’ ” Business Insider, June 22, 2024, https://www.businessinsider.com/nvidia-ceo-jensen-huang-openai-ilya-sutskever-ai-revolution-2024-6. The six years from 2006
…
to 2012: Giuliano Giacaglia, “A Brief Overview of Deep Learning,” Holloway, November 2, 2022, https://www.holloway.com/g/making-things-think/sections/a-brief-overview-of-deep-learning. In recognition of this work: “Fathers of Deep Learning Revolution Receive ACM A. M. Turing Award,” Association for Computing Machinery, 2018 ACM
by Sebastian Mallaby; · 30 Mar 2026 · 607pp · 161,998 words
Alex Krizhevsky showed up at a conference in Italy and announced something astonishing. Working from his bedroom at his parents’ home, Krizhevsky had trained a deep-learning system that smashed all previous records in computer vision: In a competition called ImageNet, devised by the pioneering Stanford computer scientist Fei-Fei Li, his
…
components would have to be integrated. The progress in image recognition was therefore just one piece of the puzzle. The larger challenge was to combine deep learning, which would solve challenges such as computer vision, with reinforcement learning, which would deliver other facets of intelligence, including the ability to hatch plans
…
and think strategically. To deliver on this premise, the business plan promised a “Deep Learning Agent” that would master games without being told what the rules were. This sort of model would experiment with millions of possible actions, observe their
…
she wants, she learns the value of good manners. Reinforcement learning equips machines to do the same: to act, and to learn by acting. Unlike deep learning, which involved layered neural networks, reinforcement learning was a conceptual framework rather than a computational architecture. RL researchers described their systems in general terms. Like
…
. In order to tame infinity, in other words, an infinity machine has to develop algorithms that narrow the search for the best action. Relative to deep learning, with its mind-boggling nonlinearities and impressive practical results, reinforcement learning seemed theoretical and primitive. But to Mnih and other believers in RL, the promise
…
of agents that could learn from experience remained thrilling. Whereas deep learning depended on the availability of training data—human-labeled cat photos, for example—reinforcement learning held out the hope that an AI could collect its
…
Wierstra had done their PhDs, combining the two approaches was actually encouraged. Besides, neuroscience strongly suggested that reinforcement learning would be a necessary complement to deep learning. After all, the reward signals in reinforcement learning resembled the dopamine signals in the human brain. If the brain was the template for artificial general
…
’s commitment to intellectual diversity.[11] Two recruits worked on statistical methods for quantifying uncertainty and incorporating probabilities into models.[12] Two had worked on deep learning at New York University under Yann LeCun.[13] Others, including Wierstra, were focused on the intersection between artificial intelligence and human intelligence. A computational psychologist
…
Mnih arrived in London, DeepMind’s eclecticism seemed somewhat contrarian. The excitement about neural networks had intensified further: Without drawing from other branches of AI, deep learning seemed poised to deliver progress on tasks ranging from medical diagnostics to translation.[14] But DeepMind stuck to its interdisciplinary vision. Whatever the progress in
…
in New York who would later become DeepMind’s research director. Later, David Silver joined, adding advice on reinforcement learning. Mnih set about training a deep-learning system to interpret the raw pixels on the Atari video screen, providing the agent with a perceptual input. Then he bolted on an established reinforcement
…
fill out the Q-table was dramatically shortened. Mnih also confronted a challenge that hearkened back to Hinton’s reservations about combining reinforcement learning and deep learning. A basic RL agent will often gather similar experiences as it explores one part of its environment: Think of a game-playing agent experiencing one
…
of the hippocampus. To Mnih and Kavukcuoglu, the goal was to turn correlated game-playing experiences into the sort of randomized teaching materials required for deep learning.[23] Memory replay soon boosted the performance of Mnih’s systems, and whichever way you looked at it, the success marked an inflection point.
…
them. Then, once the team had assembled, Hassabis had shown exquisite judgment. In choosing the Atari challenge, he had understood that the moment to fuse deep learning and reinforcement learning had arrived. The result was another ImageNet moment—not just for vision, but for agents. Chapter 7 Thiel Trouble On October 8
…
million.[8] His fundraising negotiations with Nosek and Founders Fund had already started. Nosek understood the case for an audacious fundraising target. The excitement about deep learning was pushing up AI salaries. The harnessing of powerful GPU chips was pushing up the cost of hardware. The mission of building AGI was of
…
ever. Besides, DeepMind was more than just a team. As the Atari success demonstrated, the company embodied a way of surpassing the deep-learning paradigm for which Hinton was famous. Deep-learning systems matched this onto that—images onto words, and so forth. The Atari agent had taught itself multiple games. It was capable
…
day!”[10] In spring 2014, Silver suggested to Hassabis that Go’s day was approaching. The success of the Atari project, combining reinforcement learning with deep learning, provided just the sort of springboard that Silver had been waiting for.[11] It was this suggestion, the culmination of conversations begun at Cambridge, that
…
of victory.[28] “Impossible,” Huang muttered. Guez set to work, repeating the by now familiar process of organizing data into a form that would support deep learning. He isolated the inputs (board positions taken from the database of games played by human experts) and labeled them with outputs (whether those board positions
…
. Both could be described as System One networks, mimicking the fast-thinking parts of human intelligence. But what was really powerful was how the intuitive deep-learning models worked with the introspective reinforcement learning, the tree search—the deeper, slower, System Two side of intelligence. Thanks to Maddison’s policy net,
…
all available records of expert human games. There were no more left. Progress stalled again. To get around this bottleneck, Silver drew from reinforcement learning. Deep-learning systems depended on human-created data. But reinforcement-learning agents created their own data through trial and error. By playing millions of games against itself
…
Agent Zero would stand as a triumph for Silver’s scientific specialty, reinforcement learning; it would also mark a leap toward machine autonomy. Yesterday’s deep-learning systems had ingested data that represented human knowledge, curated by human programmers. Tomorrow’s reinforcement-learning agents would rely on data that they generated themselves
…
things, it was new types of neural networks, not RL, that were going to change everything. To understand this continuing tension between reinforcement learning and deep learning, start with a peek under the hood of AlphaZero. In one sense, DeepMind’s triumph was exactly as the company described: a fantastic demonstration of
…
however, AlphaZero demonstrated the progress that LeCun and Sutskever stressed—the progress in the design of neural networks. Ever since the 2000s, the pioneers of deep learning had grappled with a conundrum. In theory, the more layers of neurons they added to a network, the more sophisticated it would become: A larger
…
agentic trial and error could deliver impressive versatility. At the same time, however, both systems achieved their advances in reinforcement learning thanks to progress in deep learning. Back in 2013, the Atari system had leveraged a particular kind of network, known as a convolutional neural net, which was built to excel at
…
for this moment. If Microsoft’s residual architecture had made it possible to build larger networks, the transformer architecture addressed another long-standing conundrum in deep learning. Many kinds of information—speech, text, videos, stock-price charts—cannot be understood by examining each unit of information in isolation. Rather, each item must
…
2015, a flash of algorithmic genius duly appeared, courtesy of three researchers at the University of Montreal, led by Yoshua Bengio, a celebrated pioneer of deep learning. Their paper’s key proposal came to be known as “attention.”[16] The idea addressed a weakness in the Seq2Seq framework. When humans understand linguistic
…
this research that was done back then, that really matters!”[9] To realize this lofty goal, Silver teamed up with Oriol Vinyals, a highly cited deep-learning expert. (Before joining DeepMind in 2016, Vinyals had coauthored the Seq2Seq paper with Sutskever.[10]) Together they assembled a large team of researchers, numbering more
…
previously worked on sequential data, so sequences of amino acids looked like a familiar problem; naturally, his instinct was to experiment with the type of deep-learning architecture that understood sequences best, a recurrent neural network. But when DeepMind tested an early version of its system on the amino acid sequences used
…
protein might fold, rendering prediction of the final shape at least half tractable. But DeepMind chose a better trick. Blessed with a superior feel for deep learning, and equipped with more powerful hardware, it trained its convolutional network to predict the distances between each amino acid.[12] Instead of a binary question
…
the leaders of the AI industry, there were three possible responses to the scientists’ apocalyptic warnings. The first was embodied by Yann LeCun, the combative deep-learning pioneer who headed Meta’s AI effort. LeCun flatly denied that AGI was getting close. Therefore, he dismissed the talk of existential threats as noxious
…
. The old computer science, based purely on deduction, had been limited, for sure. But the AI revolution had equipped machines to think inductively. Thanks to deep learning and reinforcement learning, classical computers could confront uncertainty and intuit what to do next. Penrose’s quantum speculations about human and machine intelligence had been
…
/1777581/video/33633966. BACK TO NOTE REFERENCE 6 Shane Legg recalls that groups like Jürgen Schmidhuber’s in Switzerland bridged RL and deep learning. Wierstra adds that he had combined deep learning and RL for his PhD. Mnih, author interview; Shane Legg, author interview, November 22, 2023; Daan Wierstra, author interview, December 5, 2023
…
British pounds, saying he was worth £100 million. Geoffrey Hinton, author interview, September 6, 2023. BACK TO NOTE REFERENCE 21 The potential upside from fusing deep learning and reinforcement learning influenced Google’s attitude to the pricing. Harrison recalled that DeepMind’s formula “was fairly remarkable and an evolution on what Geoff
…
, 2021), 170–71. BACK TO NOTE REFERENCE 12 Huang, author interview. BACK TO NOTE REFERENCE 13 In 2008 Sutskever and a coauthor had built a deep-learning network that selected the correct move 36.9 percent of the time. Ilya Sutskever and Vinod Nair, “Mimicking Go Experts with Convolutional Neural Networks,” Department
…
572, no. 7767 (2019): 116–19, nature.com/articles/s41586-019-1390-1. BACK TO NOTE REFERENCE 33 Jeffrey De Fauw et al., “Clinically Applicable Deep Learning for Diagnosis and Referral in Retinal Disease,” Nature Medicine 24, no. 9 (2018): 1342–50, pubmed.ncbi.nlm.nih.gov/30104768. BACK TO NOTE REFERENCE
…
. BACK TO NOTE REFERENCE 17 On the crucial contribution of the distogram, see Andrew W. Senior et al., “Improved Protein Structure Prediction Using Potentials from Deep Learning,” Nature 577, no. 7792 (2020): 706–10, doi.org/10.1038/s41586-019-1923-7. BACK TO NOTE REFERENCE 18 Mohammed AlQuraishi, “AlphaFold @ CASP13: ‘What
…
–14 transformers for, 274–75 AlphaGeometry, 278 AlphaGo AlphaZero compared with, 198 challenges of, 141–42 Crazy Stone tests of, 147–48 creativity of, 159 deep-learning strategy for, 145–46 Facebook competition for, 154, 156 Fan Hui defeated by, 153–55, 158 Graepel defeated by, 151–52 Guez’s network added
…
, Peter, 51 Dean, Jeff, 135–36, 138, 157, 231, 247, 312–13, 334 deduction, 26, 28–29 Deep Blue, 10, 63, 73, 143, 156, 194 deep learning, 51 AlphaGo strategy with, 145–46 in Atari challenge, 101 Krizhevsky’s system and, 91–94 Q-learning and, 101–2, 106 RL combined with
…
in CASP contest, 262, 269–73, 276–77 Chau and Li Ka-shing investing in, 124, 126 Chinchilla and, 296–97 culture of, 89–90 deep-learning plan of, 92 DQN of, 108–9 eclectic approach of, 99 Elixir experience aiding, 109 envisioning, 62–63 equity shares in, 83, 85–86, 414nn20
…
–53, 361, 363 Large Hadron Collider, CERN, 387–89 Leavitt, Karoline, 370 LeCun, Yann, 99, 132 on AGI, 86, 88, 320–21, 324, 410n32 on deep learning compared with RL, 196–97 Kavukcuoglu recruited by, 135 one-sentence letter signed by, 326–27 Zuckerberg recruiting, 133–34 Lee Sedol, 156, 158–61
…
AlphaGo trained with, 152 AlphaProof and, 378 AlphaStar and, 226–27 AlphaZero and, 195–200 in Atari challenge, 101 concept of, 44, 95 deep learning combined with, 102–3 deep learning compared with, 93, 95–96, 196–97 future of, 377–78 Gaia and, 223–24 Gemini experiments with, 357–60 language models with
…
, 99 supervised learning, 205 Sutskever, Ilya, 91, 98, 145, 186, 416n15 on AlphaGo scaling up, 149 on AlphaZero, 357 on consciousness and AI, 439n19 on deep learning and RL, 196–97 DeepMind recruiting, 86 Go experiment of, 146, 147, 417n22, 417n26 GPT and, 210–11 on GPT-3, 285 GPT-Zero and
by Gavin Hackeling · 31 Oct 2014
use either hand-engineered feature extraction methods that are applicable to many different problems, or automatically learn features without supervision problem using techniques such as deep learning. We will focus on the former in the next section. [ 64 ] www.it-ebooks.info Chapter 3 Extracting points of interest as features The feature
by Douglas Rushkoff · 1 Mar 2016 · 366pp · 94,209 words
the Bay Area, is the sort of business for which the flex corp structure works well. Vicarious operates in the field of artificial intelligence and deep learning; its most celebrated project to date is an attempt to crack CAPTCHAs (those annoying tests of whether a user is human) using AI. Vicarious claims
by Thomas W. Malone · 14 May 2018 · 344pp · 104,077 words
20,000 categories of objects, including human faces, human bodies, and… cat faces.19 This system used a particularly promising approach to machine learning called deep learning, which loosely simulates the way the different layers of neurons in a brain are connected to one another. Neuromorphic Computing Still another intriguing approach to
by Vivek Wadhwa and Alex Salkever · 2 Apr 2017 · 181pp · 52,147 words
kill switch on its A.I. systems.12 Other researchers are developing tools to visualize the otherwise impenetrable code in machine-generated algorithms built using Deep Learning systems. So the question that we must always be able to answer in the affirmative is whether we can stop it. With both A.I
by Sebastien Donadio · 7 Nov 2019
index with SPX options for studying VIX-based strategies Perform regression-based and classification-based machine learning tasks for prediction Use TensorFlow and Keras in deep learning neural network architecture Hands-On Machine Learning for Algorithmic Trading Stefan Jansen ISBN: 9781789346411 Implement machine learning techniques to solve investment and trading problems Leverage
by Susanne Foitzik and Olaf Fritsche · 5 Apr 2021 · 335pp · 86,900 words
by David G. W. Birch and Victoria Richardson · 28 Apr 2024 · 249pp · 74,201 words
by Douglas B. Laney · 4 Sep 2017 · 374pp · 94,508 words
by Paris Marx · 4 Jul 2022 · 295pp · 81,861 words
by David Spiegelhalter · 2 Sep 2019 · 404pp · 92,713 words
by Tom Standage · 27 Nov 2018 · 215pp · 59,188 words
by Mary L. Gray and Siddharth Suri · 6 May 2019 · 346pp · 97,330 words
by Ruth Kinna · 31 Jul 2019 · 405pp · 103,723 words
by Jacob Silverman · 17 Mar 2015 · 527pp · 147,690 words
by Brett King · 5 May 2016 · 385pp · 111,113 words
by David Spiegelhalter · 14 Oct 2019 · 442pp · 94,734 words
by Richard A. Clarke and Robert K. Knake · 15 Jul 2019 · 409pp · 112,055 words
by Seth Stephens-Davidowitz · 9 May 2022 · 287pp · 69,655 words
by David Eagleman and Anthony Brandt · 30 Sep 2017 · 345pp · 84,847 words
by Aurelien Geron · 14 Aug 2019
by Denise Hearn and Vass Bednar · 14 Oct 2024 · 175pp · 46,192 words
by Gareth Dennis · 12 Nov 2024 · 261pp · 76,645 words
by Tarleton Gillespie · 25 Jun 2018 · 390pp · 109,519 words
by Kariappa Bheemaiah · 26 Feb 2017 · 492pp · 118,882 words
by Sara Wachter-Boettcher · 9 Oct 2017 · 223pp · 60,909 words
by Scott E. Page · 27 Nov 2018 · 543pp · 153,550 words
by Jessica Bruder and Dale Maharidge · 29 Mar 2020 · 159pp · 42,401 words
by Alec Ross · 13 Sep 2021 · 363pp · 109,077 words
by Corey Pein · 23 Apr 2018 · 282pp · 81,873 words
by David Kerrigan · 18 Jun 2017 · 472pp · 80,835 words
by Susan Fowler · 18 Feb 2020 · 205pp · 71,872 words
by Anders Lisdorf
by Susan Schneider · 1 Oct 2019 · 331pp · 47,993 words
by Matthew Syed · 9 Sep 2019 · 280pp · 76,638 words
by Dariusz Jemielniak and Aleksandra Przegalinska · 18 Feb 2020 · 187pp · 50,083 words
by Nick Srnicek and Alex Williams · 1 Oct 2015 · 357pp · 95,986 words
by Andrew Steele · 24 Dec 2020 · 399pp · 118,576 words
by Martin Kleppmann · 17 Apr 2017
by Eric Posner and E. Weyl · 14 May 2018 · 463pp · 105,197 words
by Michael Kearns and Aaron Roth · 3 Oct 2019
by Simon Winchester · 1 Jan 2003 · 200pp · 71,482 words
by Martin Kleppmann · 16 Mar 2017 · 1,237pp · 227,370 words
by Ryan Dezember · 13 Jul 2020 · 279pp · 87,875 words
by Michal Zalewski · 11 Jan 2022 · 337pp · 96,666 words
by Amanda Kirby and Theo Smith · 2 Aug 2021 · 424pp · 114,820 words
by Adrian Hon · 14 Sep 2022 · 371pp · 107,141 words
by Michael Barber · 12 Mar 2015 · 350pp · 109,379 words
by Jamie Bartlett · 4 Apr 2018 · 170pp · 49,193 words
by Tom Standage · 16 Aug 2021 · 290pp · 85,847 words
by Julie Battilana and Tiziana Casciaro · 30 Aug 2021 · 345pp · 92,063 words
by Matthew Hindman · 24 Sep 2018
by Franklin Foer · 31 Aug 2017 · 281pp · 71,242 words
by Robin Hanson · 31 Mar 2016 · 589pp · 147,053 words
by Marc Lewis Phd · 13 Jul 2015 · 288pp · 73,297 words
by David Robson · 7 Mar 2019 · 417pp · 103,458 words
by Eric O'Neill · 1 Mar 2019 · 299pp · 88,375 words
by Ash Fontana · 4 May 2021 · 296pp · 66,815 words
by Eben Kirksey · 10 Nov 2020 · 599pp · 98,564 words
by Natalie Berg and Miya Knights · 28 Jan 2019 · 404pp · 95,163 words
by Andreas Herrmann, Walter Brenner and Rupert Stadler · 25 Mar 2018
by Dipanjan Sarkar · 1 Dec 2016
by Ariel Ezrachi and Maurice E. Stucke · 30 Nov 2016
by Michael A. Cusumano, Annabelle Gawer and David B. Yoffie · 6 May 2019 · 328pp · 84,682 words
by Jan Kunigk, Ian Buss, Paul Wilkinson and Lars George · 8 Jan 2019 · 1,409pp · 205,237 words
by Sabine Hossenfelder · 11 Jun 2018 · 340pp · 91,416 words
by Ron Jeffries · 14 Aug 2015 · 444pp · 118,393 words
by Camilla Pang · 12 Mar 2020 · 256pp · 67,563 words
by Mike Maples and Peter Ziebelman · 8 Jul 2024 · 207pp · 65,156 words
by James Lovelock · 27 Aug 2019 · 94pp · 33,179 words
by Henry A Kissinger, Eric Schmidt and Daniel Huttenlocher · 2 Nov 2021 · 194pp · 57,434 words
by Joshua Cooper Ramo · 16 May 2016 · 326pp · 103,170 words
by Jacob Helberg · 11 Oct 2021 · 521pp · 118,183 words
by Matthew Brennan · 9 Oct 2020 · 282pp · 63,385 words
by Nick Couldry and Ulises A. Mejias · 19 Aug 2019 · 458pp · 116,832 words
by Gary Marcus and Jeremy Freeman · 1 Nov 2014 · 336pp · 93,672 words
by Joel Grus · 13 Apr 2015 · 579pp · 76,657 words
by Alasdair Gilchrist · 27 Jun 2016
by Joi Ito and Jeff Howe · 6 Dec 2016 · 254pp · 76,064 words
by Brad Smith and Carol Ann Browne · 9 Sep 2019 · 482pp · 121,173 words
by Kenneth Cukier, Viktor Mayer-Schönberger and Francis de Véricourt · 10 May 2021 · 291pp · 80,068 words
by William Davidow and Michael Malone · 18 Feb 2020 · 304pp · 80,143 words
by Charles Conn and Robert McLean · 6 Mar 2019
by Sinan Aral · 14 Sep 2020 · 475pp · 134,707 words
by William MacAskill · 31 Aug 2022 · 451pp · 125,201 words
by Daniel Susskind · 16 Apr 2024 · 358pp · 109,930 words
by Stephen M Fleming · 27 Apr 2021
by Madhumita Murgia · 20 Mar 2024 · 336pp · 91,806 words
by Thomas H. Davenport and Julia Kirby · 23 May 2016 · 347pp · 97,721 words
by Jevin D. West and Carl T. Bergstrom · 3 Aug 2020
by Azeem Azhar · 6 Sep 2021 · 447pp · 111,991 words
by Mo Gawdat · 29 Sep 2021 · 259pp · 84,261 words
by Christopher Mims · 13 Sep 2021 · 385pp · 112,842 words
by Roger Bootle · 4 Sep 2019 · 374pp · 111,284 words
by Jeff Hawkins · 15 Nov 2021 · 253pp · 84,238 words
by Jeff Lawson · 12 Jan 2021 · 282pp · 85,658 words
by Eric Topol · 6 Jan 2015 · 588pp · 131,025 words
by Steven Levy · 25 Feb 2020 · 706pp · 202,591 words
by Lynda Gratton and Andrew Scott · 1 Jun 2016 · 344pp · 94,332 words
by Paul R. Daugherty and H. James Wilson · 15 Jan 2018 · 523pp · 61,179 words
by Meredith Broussard · 19 Apr 2018 · 245pp · 83,272 words
by Lane Greene · 15 Dec 2018 · 284pp · 84,169 words
by Merlin Sheldrake · 11 May 2020
by Jordan Ellenberg · 14 May 2021 · 665pp · 159,350 words
by Brad Stone · 10 May 2021 · 569pp · 156,139 words
by Michael Lewis · 3 May 2021 · 285pp · 98,832 words
by Steven Strogatz · 31 Mar 2019 · 407pp · 116,726 words
by Po Bronson · 14 Jul 2020 · 320pp · 95,629 words
by Robert Skidelsky Nan Craig · 15 Mar 2020
by Lauren Turner Claire, Laure Claire Reillier and Benoit Reillier · 14 Oct 2017 · 240pp · 78,436 words
by Brent Donnelly · 11 May 2021
by Adrienne Mayor · 27 Nov 2018
by Jacob Ward · 25 Jan 2022 · 292pp · 94,660 words
by Jeanette Winterson · 15 Mar 2021 · 256pp · 73,068 words
by Kashmir Hill · 19 Sep 2023 · 487pp · 124,008 words
by Ben Tarnoff · 13 Jun 2022 · 234pp · 67,589 words
by Arthur Turrell · 2 Aug 2021 · 297pp · 84,447 words
by Joshua Paul Dale · 15 Dec 2023 · 209pp · 81,560 words
by Vauhini Vara · 8 Apr 2025 · 301pp · 105,209 words
by David de Cremer · 25 May 2020 · 241pp · 70,307 words
by Brian Merchant · 19 Jun 2017 · 416pp · 129,308 words
by Kevin Kelly · 6 Jun 2016 · 371pp · 108,317 words
by Thomas L. Friedman · 22 Nov 2016 · 602pp · 177,874 words
by Kevin Roose · 9 Mar 2021 · 208pp · 57,602 words
by Jeff Booth · 14 Jan 2020 · 180pp · 55,805 words
by Stanley McChrystal and Anna Butrico · 4 Oct 2021 · 489pp · 106,008 words
by Holly Glenn Whitaker · 9 Jan 2020 · 334pp · 109,882 words
by Carl Benedikt Frey · 17 Jun 2019 · 626pp · 167,836 words
by Igor Tulchinsky · 30 Sep 2019 · 321pp
by Steve Sammartino · 25 Jun 2014 · 247pp · 81,135 words
by Nicholas Carr · 28 Sep 2014 · 308pp · 84,713 words
by Daniel J. Levitin · 18 Aug 2014 · 685pp · 203,949 words
by Salim Ismail and Yuri van Geest · 17 Oct 2014 · 292pp · 85,151 words
by Peter H. Diamandis and Steven Kotler · 3 Feb 2015 · 368pp · 96,825 words
by Robert Elliott Smith · 26 Jun 2019 · 370pp · 107,983 words
by Tim Fernholz · 20 Mar 2018 · 328pp · 96,141 words
by Richard Baldwin · 10 Jan 2019 · 301pp · 89,076 words
by Jacob Turner · 29 Oct 2018 · 688pp · 147,571 words
by Kurt Andersen · 14 Sep 2020 · 486pp · 150,849 words
by Martin Goodman · 25 Oct 2017 · 768pp · 252,874 words
by Peter H. Diamandis and Steven Kotler · 28 Jan 2020 · 501pp · 114,888 words
by Ronald J. Deibert · 14 Aug 2020
by Fareed Zakaria · 5 Oct 2020 · 289pp · 86,165 words
by Geoffrey Cain · 28 Jun 2021 · 340pp · 90,674 words
by Nouriel Roubini · 17 Oct 2022 · 328pp · 96,678 words
by Nicole Kobie · 3 Jul 2024 · 348pp · 119,358 words
by Eliezer Yudkowsky and Nate Soares · 15 Sep 2025 · 215pp · 64,699 words
by David Sax · 15 Jan 2022 · 282pp · 93,783 words
by Yuval Noah Harari · 9 Sep 2024 · 566pp · 169,013 words
by Daron Acemoglu and Simon Johnson · 15 May 2023 · 619pp · 177,548 words
by George Zarkadakis · 7 Mar 2016 · 405pp · 117,219 words
by Jaron Lanier · 21 Nov 2017 · 480pp · 123,979 words
by Calum Chace · 17 Jul 2016 · 477pp · 75,408 words
by Jeremy Rifkin · 27 Sep 2011 · 443pp · 112,800 words
by James Ashton · 11 May 2023 · 401pp · 113,586 words
by Frank Pasquale · 14 May 2020 · 1,172pp · 114,305 words
by Robert Wachter · 7 Apr 2015 · 309pp · 114,984 words
by Michael Bhaskar · 2 Nov 2021
by Matthew Williams · 23 Mar 2021 · 592pp · 125,186 words
by Rob Reich, Mehran Sahami and Jeremy M. Weinstein · 6 Sep 2021
by Tim Wu · 4 Nov 2025 · 246pp · 65,143 words
by Steven Pinker · 14 Oct 2021 · 533pp · 125,495 words
by Valliappa Lakshmanan, Sara Robinson and Michael Munn · 31 Oct 2020
by Pedro Domingos · 21 Sep 2015 · 396pp · 117,149 words
by Tim O'Reilly · 9 Oct 2017 · 561pp · 157,589 words
by Calum Chace · 28 Jul 2015 · 144pp · 43,356 words
by Kim Stanley Robinson · 22 Oct 2018 · 492pp · 141,544 words
by Shoshana Zuboff · 15 Jan 2019 · 918pp · 257,605 words
by Andrew Marr · 16 May 2007 · 618pp · 180,430 words
by James Vlahos · 1 Mar 2019 · 392pp · 108,745 words
by Jamie Susskind · 3 Sep 2018 · 533pp
by Daniel C. Dennett · 7 Feb 2017 · 573pp · 157,767 words
by Gautam Baid · 1 Jun 2020 · 1,239pp · 163,625 words
by Mariya Yao, Adelyn Zhou and Marlene Jia · 1 Jun 2018 · 161pp · 39,526 words
by Amy B. Zegart · 6 Nov 2021
by Ajay Agrawal, Joshua Gans and Avi Goldfarb · 16 Apr 2018 · 345pp · 75,660 words
by Brian Dumaine · 11 May 2020 · 411pp · 98,128 words
by Christopher Wylie · 8 Oct 2019
by Rebecca Fannin · 2 Sep 2019 · 269pp · 70,543 words
by Yarden Katz
by Sergey Young · 23 Aug 2021 · 326pp · 88,968 words
by Don Hanlon Johnson · 10 Sep 2018 · 358pp · 106,951 words
by Nate Silver · 12 Aug 2024 · 848pp · 227,015 words
by Parmy Olson · 284pp · 96,087 words
by Hawon Jung · 21 Mar 2023 · 401pp · 112,589 words
by Walter Isaacson · 11 Sep 2023 · 562pp · 201,502 words
by Richard Rumelt · 27 Apr 2022 · 363pp · 109,834 words
by Sonja Thiel and Johannes C. Bernhardt · 31 Dec 2023 · 321pp · 113,564 words
by Orly Lobel · 17 Oct 2022 · 370pp · 112,809 words
by Max Fisher · 5 Sep 2022 · 439pp · 131,081 words
by Adam Greenfield · 29 May 2017 · 410pp · 119,823 words
by Andrew McAfee and Erik Brynjolfsson · 26 Jun 2017 · 472pp · 117,093 words
by Xiaowei Wang · 12 Oct 2020 · 196pp · 61,981 words
by Kai-Fu Lee and Qiufan Chen · 13 Sep 2021
by Maximilian Kasy · 15 Jan 2025 · 209pp · 63,332 words
by Kenneth Payne · 16 Jun 2021 · 339pp · 92,785 words
by Martin Ford · 4 May 2015 · 484pp · 104,873 words
by Yves Hilpisch · 8 Dec 2020 · 1,082pp · 87,792 words
by Marc Goodman · 24 Feb 2015 · 677pp · 206,548 words
by John Markoff · 24 Aug 2015 · 413pp · 119,587 words
by Luke Dormehl · 10 Aug 2016 · 252pp · 74,167 words
by Fabio Nelli · 27 Sep 2018 · 688pp · 107,867 words
by Richard A. Clarke · 10 Apr 2017 · 428pp · 121,717 words
by Nick Polson and James Scott · 14 May 2018 · 301pp · 85,126 words
by Richard Yonck · 7 Mar 2017 · 360pp · 100,991 words
by Marcus Du Sautoy · 7 Mar 2019 · 337pp · 103,522 words
by Judea Pearl and Dana Mackenzie · 1 Mar 2018
by Nicholas A. Christakis · 26 Mar 2019
by Veljko Krunic · 29 Mar 2020
by Michael Wooldridge · 2 Nov 2018 · 346pp · 97,890 words
by John Brockman · 19 Feb 2019 · 339pp · 94,769 words
by David Epstein · 1 Mar 2019 · 406pp · 109,794 words
by Daniel Yergin · 14 Sep 2020
by David N. Blank-Edelman · 16 Sep 2018
by Erik J. Larson · 5 Apr 2021
by Brian Christian · 5 Oct 2020 · 625pp · 167,349 words
by Rowan Hooper · 15 Jan 2020 · 285pp · 86,858 words
by Nicole Aschoff
by Ray Kurzweil · 25 Jun 2024
by Peter Warren Singer and Emerson T. Brooking · 15 Mar 2018
by Keach Hagey · 19 May 2025 · 439pp · 125,379 words
by Naomi Klein · 11 Sep 2023
by Stephen Witt · 8 Apr 2025 · 260pp · 82,629 words
by Walter Isaacson · 26 Sep 2005 · 1,330pp · 372,940 words
by Mustafa Suleyman · 4 Sep 2023 · 444pp · 117,770 words
by Guillaume Pitron · 14 Jun 2023 · 271pp · 79,355 words
by John Brockman · 5 Oct 2015 · 481pp · 125,946 words
by George Gilder · 16 Jul 2018 · 332pp · 93,672 words
by Melanie Mitchell · 14 Oct 2019 · 350pp · 98,077 words
by Cade Metz · 15 Mar 2021 · 414pp · 109,622 words
by Otto Scharmer and Katrin Kaufer · 14 Apr 2013 · 351pp · 93,982 words
by Aurélien Géron · 13 Mar 2017 · 1,331pp · 163,200 words
by Thierry Poibeau · 14 Sep 2017 · 174pp · 56,405 words
by Martin Ford · 16 Nov 2018 · 586pp · 186,548 words
by Nick Chater · 28 Mar 2018 · 263pp · 81,527 words
by Kai-Fu Lee · 14 Sep 2018 · 307pp · 88,180 words
by Hannah Fry · 17 Sep 2018 · 296pp · 78,631 words
by Bruno Macaes · 25 Jan 2018 · 287pp · 95,152 words
by Amy Webb · 5 Mar 2019 · 340pp · 97,723 words
by Toby Ord · 24 Mar 2020 · 513pp · 152,381 words
by Anil Seth · 29 Aug 2021 · 418pp · 102,597 words
by Stuart Russell and Peter Norvig · 14 Jul 2019 · 2,466pp · 668,761 words
by William Davies · 26 Feb 2019 · 349pp · 98,868 words
by Stuart Russell · 7 Oct 2019 · 416pp · 112,268 words
by Daniel Susskind · 14 Jan 2020 · 419pp · 109,241 words
by Anil Ananthaswamy · 15 Jul 2024 · 416pp · 118,522 words
by Martin Ford · 13 Sep 2021 · 288pp · 86,995 words
by Anu Bradford · 25 Sep 2023 · 898pp · 236,779 words
by Anthony M. Townsend · 15 Jun 2020 · 362pp · 97,288 words
by Paul Scharre · 23 Apr 2018 · 590pp · 152,595 words
by Bill McKibben · 15 Apr 2019
by Aaron Bastani · 10 Jun 2019 · 280pp · 74,559 words
by Clive Thompson · 26 Mar 2019 · 499pp · 144,278 words
by Hod Lipson and Melba Kurman · 22 Sep 2016
by Paul Scharre · 18 Jan 2023
by Karen Hao · 19 May 2025 · 660pp · 179,531 words
by Christopher Summerfield · 11 Mar 2025 · 412pp · 122,298 words
by Eric Topol · 1 Jan 2019 · 424pp · 114,905 words
by Varun Sivaram · 2 Mar 2018 · 469pp · 132,438 words
by David Ariosto · 24 Mar 2026 · 433pp · 116,344 words
by Hannu Rajaniemi · 1 Jan 2010 · 324pp · 91,653 words