large language model

back to index

description: language model built with large amounts of texts

67 results

In the Realm of the Last Man

by Francis Fukuyama  · 3 Jul 2026

used or reproduced in any manner for the purpose of training artificial intelligence technologies or systems (including but not limited to machine learning models and large language models (LLMs)). In accordance with Article 4(3) of the DSM Directive 2019/790, Profile Books expressly reserves this work from the text and data mining

…

grows much deeper with generative AI, which in a sense takes the entire corpus of the world’s photographs and digests it into a single large language model. In the future photos may no longer be accepted as documentary evidence in legal proceedings because they are so easy to fake. Video has become

Algospeak: How Social Media Is Transforming the Future of Language

by Adam Aleksic  · 15 Jul 2025  · 278pp  · 71,701 words

websites unusable.[3] That’s just from moving around tones, ignoring potential semantic substitutions, so we’re clearly quite far from a 1984-esque scenario. Large language models may get better at recognizing words in context, but people will always find creative ways to express their ideas. We’ve already seen this in

…

, 52–53 L labels, 196, 202, 205. See also microlabels Lady Bountiful (Carr), 18, 18 laggards, 53–55, 54 Language and the Internet (Crystal), 10n large language models, 209 late majority, 53, 54 Latin, 5, 7, 69n Latino dance circles, 147 laughing-crying emoji , 53–54, 188 laughing emoji, 53 LDAR (lay down

Literary Theory for Robots: How Computers Learned to Write

by Dennis Yi Tenen  · 6 Feb 2024  · 169pp  · 41,887 words

the frenzy of its grifters and soothsayers. What remains will be more modest and more significant. Viewed in the light of collective human intellectual achievement, large language models are built on the foundation of public archives, libraries, and encyclopedias containing the composite work of numerous authors. Their synthesized voice fascinates me not so

How AI Thinks

by Nigel Toon  · 13 Dec 2023

. Controversy had surrounded these powerful chatbots since at least June 2022, when an engineer called Blake Lemoine, who was employed to test the competing Google ‘large language model’ project LaMDA (now released under the product name Bard), claimed that the system was acting in a ‘sentient’ manner. He said, ‘If I didn’t

…

are concerned that we are just going to replace one monopoly with another. Some are calling for an open-source development project that would make large language models available to industry and governments in Europe and other countries, to ensure that this type of technology doesn’t just sit in the hands of

…

combined 75 per cent across the whole Uniform Bar Examination – not only good enough to pass, but placing it in the top ninetieth percentile. But large language models are not yet perfect. They work well on these rote learning tests but still lack common sense. They continue to make incredible progress every year

…

will then be sent off to another set of machines that today use the most advanced artificial-intelligence ‘natural language processing’ (NLP) techniques, such as large language models, to help make sense of your query. The search results that you see will be different from any other person’s and will be based

…

use is still very simple. It takes massive amounts of information to train the foundational large language models that this transformer approach has enabled. Although the basic system can be trained using any language information, to make the large language models work accurately in specific applications they also need to be fine-tuned on information specific

…

over 80 per cent of students are currently failing to reach minimum proficiency levels (according to UN research).3 What is striking is how new, large language model-based systems and other knowledge-based tools could really help in the classroom. In one recent example, ChatGPT was tried at an intense software development

…

, they do learn from information rather than being told what to do. However, convolutional neural networks used in vision systems have been analysed and understood, large language models are more complex and perhaps more difficult to analyse, but this is still possible. And it is also possible to build systems that control these

…

nations gaining a significant advantage. This would not just impact our economic competitiveness but could also have major implications for national security. As an example, large language models provide a unique ability to quickly analyse huge amounts of text and language. National security agencies are starting to use this technology to scan material

…

billions of transistors, and can perform the function of very complex electronic systems on a single chip that measures just a few centimetres square. LARGE LANGUAGE MODEL (LLM) A large language model is a very large artificial neural network that creates AI systems able to understand and generate human language text. As an example, OpenAI has

…

a large language model called GPT-4, which users interact with through the AI language system ChatGPT. LETHAL AUTONOMOUS WEAPON (LAW) A lethal autonomous weapon is a type of

…

slow down. MULTI-HEADED SELF-ATTENTION Multi-headed self-attention is a machine learning technique more commonly called a ‘transformer’. It is often used in large language model artificial neural networks as a way to understand the structure of language and to place attention on the key words and phrases in a long

…

principle 147 language 58, 59–60, 69, 97, 112, 116, 143, 202, 210–11 AI language models 15–16, 62, 65, 66, 211, see also large language models (below) AI translations 61, 62, 172, 181 and communication 93, 96 computer programming languages 53, 54, 66, 241–2 and encoding 96–7 generative-language

…

systems 240, 280 in India 177 large language models (LLMs) 15, 16, 19, 20, 65, 172–3, 204, 227, 248, 281, 282 and memory 59, 60–61 natural language systems 19, 62, 70, 203

…

see elevators limitations in AI systems 6, 37, 38, 64, 137, 141, 147, 232, 233, 234, 235, 247 Liverpool and Manchester Railway 237 LLMs see large language models loan applications 202, 243 Loma Linda University, California 208 long short-term memory (LSTM) systems 61, 281, 283 ‘Lorenz’ encryption 42, 141 Lovelace, Countess Ada

The Coming Wave: Technology, Power, and the Twenty-First Century's Greatest Dilemma

by Mustafa Suleyman  · 4 Sep 2023  · 444pp  · 117,770 words

will make experiences more efficient, faster, more useful, and frictionless. AI is already here. But it’s far from done. AUTOCOMPLETE EVERYTHING: THE RISE OF LARGE LANGUAGE MODELS It wasn’t long ago that processing natural language seemed too complex, too varied, too nuanced for modern AI. Then, in November 2022, the AI

…

and efficient predictions about what comes next. Their work laid the foundation for what has been nothing short of a revolution in the field of large language models (LLMs)—including ChatGPT. LLMs take advantage of the fact that language data comes in a sequential order. Each unit of information is in some way

…

salient elements of a sentence, and how do they relate to one another? In AI this notion is commonly referred to as “attention.” When a large language model ingests a sentence, it constructs what can be thought of as an “attention map.” It first organizes commonly occurring groups of letters or punctuation into

…

apps or researching and writing detailed market reports. All of this is just the start. We are only beginning to scratch at the profound impact large language models are about to have. If DQN and AlphaGo were the early signs of something lapping at the shore, ChatGPT and LLMs are the first signs

…

the level of code. Mass proliferation is a near certainty under these conditions. EleutherAI, a grassroots coalition of independent researchers, has made a series of large language models completely open-source, readily available to hundreds of thousands of users. Meta has open-sourced—“democratized,” in its own words—models so large that just

…

still is, a thrilling prospect. Long before the much-publicized launch of ChatGPT, I was part of the team at Google working on a new large language model that we called LaMDA, short for Language Model for Dialogue Applications. LaMDA is a sophisticated LLM designed to be great at conversation. At first, it

…

is acute. Because these technologies are getting cheaper and simpler to use even as they get more powerful, more nations can engage at the frontier. Large language models are still seen as cutting-edge, yet there is no great magic or hidden state secret to them. Access to computation is likely the biggest

…

the next fifty years, it would still unlock around $100 trillion of additional GDP. Think about the impact of the new wave of AI systems. Large language models enable you to have a useful conversation with an AI about any topic in fluent, natural language. Within the next couple of years, whatever your

…

generate near-perfect deepfakes—whether text, images, video, or audio—became as easy as writing a query into Google. As we saw in chapter 4, large language models now show astounding results at generating synthetic media. A world of deepfakes indistinguishable from conventional media is here. These fakes will be so good our

…

will humans still be “better” than machines. I have long argued this is the more likely scenario. With the arrival of the latest generation of large language models, I am now more convinced than ever that this is how things will play out. These tools will only temporarily augment human intelligence. They will

…

thought that “influencer” would become a highly sought-after role? Or imagined that in 2023 people would be working as “prompt engineers”—nontechnical programmers of large language models who become adept at coaxing out specific responses? Demand for masseurs, cellists, and baseball pitchers won’t go away. But my best guess is that

…

experimentation easier, meaning biohackers in their garages can tinker at the absolute frontier of science. Ultimately, sharing or copying DNA or the code of a large language model is trivial. Openness is the default, imitations are endemic, cost curves relentlessly go down, and barriers to access crumble. Exponential capabilities are given to anyone

…

that works. Let’s start at the beginning, with the technology itself. 1. SAFETY: AN APOLLO PROGRAM FOR TECHNICAL SAFETY A few years ago, many large language models had a problem. They were, to put it bluntly, racist. Users could quite easily find ways of making them regurgitate racist material, or hold racist

…

their creations. On the contrary, they, we, I, do; the responsibility is crystal clear. No one is compelled to experiment with genetic modification or build large language models. Technology’s inevitable spread and development are not a get-out-of-jail-free card, a license to build what you want and see what

…

/​pdf/​2209.07858.pdf. GO TO NOTE REFERENCE IN TEXT On the technical side Sam R. Bowman et al., “Measuring Progress on Scalable Oversight for Large Language Models,” arXiv, Nov. 11, 2022, arxiv.org/​abs/​2211.03540. GO TO NOTE REFERENCE IN TEXT At present only a fraction Security DNA Project, “Securing Global

…

concentration and, 190–91 defined, 26 internal combustion engine as, 25, 26 invisibility of, 27 omni-use and, 111 generative AI, 69, 73 See also large language models gene synthesis, 83–84, 247–48 genetically modified organisms (GMOs), 45, 46, 231 genetic engineering accessibility and, 82–83 autonomy and, 114 containment and, 46

…

change Go, 53–54, 113, 117–19, 120 Google corporate power of, 187 DeepMind purchase, 60, 255–57 efficiency and, 68 LaMDA and, 71, 72 large language models and, 66 quantum computing and, 97–98, 122 robotics and, 95 on transformers, 64 Google Scholar, 128 Gopher, 68 gorilla problem, 115–16 governments containment

…

Genome Project, 80–81 Huskisson, William, 131 Hutchins, Marcus, 161 hyper-evolution, 105, 107–9 chips and, 32–33, 57, 81, 108 containment and, 250 large language models and, 66, 68 I India, 125–26, 169–70 Industrial Revolution containment attempts, 39, 40, 281–83 openness imperative and, 127 profit motive and, 133

…

lab leaks, 173–75, 176 labor markets, 177–81, 261, 262, 282 LaMDA, 71–72, 75 Lander, Eric, 265 language, 27, 157 See also large language models LanzaTech, 87 large language models (LLMs), 62–65 bias in, 69–70, 239–40 capabilities of, 64–65 deepfakes and, 170 efficiency of, 68 open source and, 69 scale

The Story of Your Life: How Social Media Shapes the Way We Experience Everything

by Kathryn Jezer-Morton  · 4 Aug 2026

of AirSpace, they may well begin demanding more “curation,” which is really just another word for human-generated taste. But as long as algorithms and large language models are being used to design, build, and market homelife to us, we will be stuck with the soulless remnants of a doomed disciplinary regime. If

AI in Museums: Reflections, Perspectives and Applications

by Sonja Thiel and Johannes C. Bernhardt  · 31 Dec 2023  · 321pp  · 113,564 words

a mainstream topic in the cultural world, but does feature in general debates about digitization and digitality. The use of machine learning, neural networks, and large language models has, however—and contrary to common assumptions—been growing for years. Beyond prominent lighthouses, initial surveys of the international museum landscape list many hundreds of

…

. The only thing that has changed dramatically in recent years is that such systems—from simple machine learning to the development of neural networks and large language models—have achieved a level of complexity and efficiency that often produces astonishing results. But to view this correctly, it is necessary to think the other

…

Creative User Empowerment. She places particular emphasis on reflecting the normative preconditions and frameworks of AI projects, stresses the importance of the conscious use of large language models and the open handling of data, and points to the requirement of clearly defining the problem to be solved with AI. Finally, the increasing use

…

art has played and continues to play a crucial role and might further transform and redesign creative processes. The increase in generative AI and especially large language models (LLMs) has led to a distortion of the public perception of what is meant by AI. At the same time, the technology has made astonishing

…

content, but also engaging in communicative interaction. It might be useful to remember in the future that there was a time before the development of large language models, and in ‘CHIM—Chatbot in the Museum: Exploring and Explaining Museum Objects with Speech-Based AI’, Oliver Guske, Stefan Schaffer, and Aaron Ruß present an

…

here is therefore rather particular: the model learns stochastically by adding up very small elements to calculate ‘a bigger picture’ or (in the case of large language models) to calculate the meaning of a sentence from analysing the context of thousands of tokens (entities similar to words), taking note of which other tokens

…

chatbot communication is now emerging as the technology develops and is implemented in our daily lives. As we know, this part of AI, which involves large language models and natural language processing, is not the only form of AI, but it is—besides generative images—nevertheless one that a majority of people currently

…

observations are based on a chatbot that is certainly sophisticated, but also far from exploiting the full potential of AI. With the rapid emergence of large language models (the best known being OpenAI’s GPT), museum chatbots will improve significantly over the next few years and be able to provide truly individualized responses

…

quantity of data and a model’s capacity to ingest this larger amount of information. This has been clearly illustrated with linguistic models (or LLMs, large language models). Behind the construction of larger models lies the idea of universality: by building larger models capable of sorting through a wider range of data, it

…

from the web—without any explanation or justification being provided. But not only image-based AI can suffer from bad quality or biased training data. Large language models like BERT, GPT, et cetera are also trained on massive 155 156 Part 2: Perspectives quantities of text that are scraped from publicly available online

…

was fun—the fun of make-believe. One could also say: the joy that comes from a well-told story. A fiction, not a fact. Large Language Models as Entertainment Is GPT-3 somewhat similar to the Mechanical Turk? No human intelligence whatsoever, but still capable of coming up with humanlike texts? Or

…

with you like a human, you react with human emotions. That was the case when machines spoke like very, very dumb humans. And now that large language models (LLM) can have long and coherent conversations with you, it becomes increasingly difficult to stay cold (Kilg 2021). So, is Anic really a decent column

…

columns that she has fallen in love with her own neural network? In short, are we supposed to believe such nonsense routinely made up by large language models? Counter-question: Why not? And, first of all: what exactly do we mean by ‘believe’ here? Do we believe all of Dostoevsky’s psychological aberrations

…

have to consciously give up our ‘disbelief’ in order to enjoy fiction. And we seem to enjoy doing this, in all sorts of different contexts. Large Language Models as Impostors One can assume that impostors exploit precisely this desire to let ourselves be deceived, this ‘willing suspension’. We tend to prefer grandiose and

…

to treating illnesses might turn out to be expensive, losing much of the healing magic on the way (Sacks 1990). But that is another story. Large Language Models as Storytellers—Used Best in which Contexts? The crucial question here: Would we trust a machine doctor in the first place? Surely knowledge retrieval as

…

image recognition and intelligent search technologies. On top of these novel approaches to the exploration of the collection, users are also invited to interact with large language models (LLMs) enriched with collection data, so that they can actively write texts about the objects and publicly share their story and findings with others. This

…

and further integrated into the development. In the actual tool, it supports the visual search process through image embeddings. An event on the use of large language models was held in July 2022 and a prototype developed, co-curated by the Turing Agency20 (Basel/Zurich/Berlin). This enabled us to explore the process

…

and the xCurator user journey. In the experimental Datalab, we were able to run various tests and develop solutions to test the added value of large language models (LLMs) for the xCurator solution. With this, it already became visible that LLMs can help users find and contextualize content and suggest topics, structures, and

…

. The use and application of generative AI with multimodal models falls within a broader ongoing debate surrounding large language models. Several AI researchers have issued an open call for a moratorium on the development of large language models such as ChatGPT or GPT for at least six months until further research on the technology has been

…

generative AI technologies produce can be factual, but might also be speculative. For this reason, generative text production as it occurs in the context of large language models such as ChatGPT or GPT-4 is often likened to the figure of the ‘stochastic parrot’ (Bender et al. 2021, 610–23): like a parrot

…

animals. Abstracts Mercedes Bunz, The Role of Culture in the Intelligence of AI Artificial intelligence has received a new boost from the recent hype about large language models. However, to avoid misconceptions, it is better to speak of ‘machine intelligence’. In addition to reflecting on current processes, the cultural sector can benefit from

…

uses its potential to cope with the flood of information. Daniel M. Feige, Why AI Cannot Think In the context of the recent interest in large language models (LLMs) and image creation using artificial intelligence, the debate about whether AI is capable of reasoning arises again and again. This paper argues that it

…

and information based on individual user interests, thus providing them with a personalized and more in-depth exploration of the collection. Users can interact with large language models (LLMs) enriched with collection data, thus enabling them to write about and share objects. Despite being experimental, this signifies a shift in the role of

The Infinity Machine: Demis Hassabis, DeepMind, and the Quest for Superintelligence

by Sebastian Mallaby;  · 30 Mar 2026  · 607pp  · 161,998 words

during DeepMind’s early days, but not after 2015 or so. The question of whether AI systems need to be “grounded” is still hotly debated. Large language models such as ChatGPT or Gemini are not directly taught concepts, yet these systems exhibit an impressive grasp of how the world functions. A feeling for

…

get through; Hassabis with his sparky riffs on intelligence and life, neuroscience and games, history and fiction. This was the period of maximum excitement about large language models, so language and how to think about it came up repeatedly in our sessions. At that crucial moment, when Ilya Sutskever had read the transformer

…

DeepMind’s agents could manage. Given the competition between reinforcement learning and deep learning, this setback held a warning. When it came to OpenAI’s large language models, the more complex and varied the data you fed into the system, the better it performed. Much as knowing French helps a linguist to master

…

Italian, large language models were capable of “transfer learning” across different but loosely related topics. But Gaia’s failure suggested that the same was not true for RL. A

…

, racing monomaniacally to build ever larger transformer models rather than daring to imagine more innovative approaches. Some of these attacks are baffling: The creators of large language models repeatedly roll out novel features, from text-and-video multimodality, to longer memory, to step-by-step reasoning; and the biases of the models have

…

Jack Rae had tried to drum up support for a rival DeepMind language project. But Hassabis and his lieutenants were skeptical of the potential of large language models, disinclined to follow OpenAI, and preoccupied with AlphaFold, StarCraft II, and governance wrangles with Google. Irving’s arrival tipped the balance at DeepMind. He had

…

, responsibility would require “stepping back to assess the situation we find ourselves in, mapping out potential risks, and researching mitigations.” The goal was to create “large language models that serve society, furthering our mission of solving intelligence to advance science and benefit humanity.”[22] The reassuring promises betrayed no hint of the reality

…

like Sam’s thing is, ‘I’m a pragmatic entrepreneur, I want to make amazing technology,’ ” Rae said later. “You go to OpenAI and really large language models are the bet. There’s no other bet. That’s very appealing.”[24] Irving could see Rae’s point—he understood the allure of a

…

arrived in 2021, Amodei had left to found Anthropic. Like Geoffrey Irving at DeepMind, Leike believed in pushing hard on the research but then releasing large language models cautiously. “Before we scramble to deeply integrate LLMs everywhere in the economy, can we pause and think whether it is wise to do so?” he

…

unknown, so the goal was to build a platform for exploratory research—Bell Labs had shown how you could do this. But the advent of large language models had scrambled the premise. The path ahead was now visible for all to see. The challenge was to set out on that path and to

…

, for two reasons. “One is that AI has got to the level where building a product is not going to divert me from building AGI. Large language models are both things: something you can sell, and something that advances the mission. “The second thing is that I’ve done product design before, and

…

dangerous outputs, such as advice on plotting an attack, could be removed by any half-sophisticated user. But LeCun swept this worry under the carpet. Large language models were not strong enough to make bad actors worse, he claimed. Besides, if the models were poised to become the fount of all knowledge, they

…

recently, other nations had joined the race. The governments of Saudi Arabia and the United Arab Emirates were planning to spend billions on their own large language models; in France, an ex-DeepMind scientist was joining forces with two Meta alumni to start a lab called Mistral. At a meeting with British Prime

…

difficulties of broader collaboration. By the summer of 2023, the Gemini project employed several hundred researchers. Their goal was to build the world’s strongest large language model by the end of the year, the deadline that the company had set for a GPT-4-level system. Scientists worked nights and weekends, often

…

an inspiring talk to his research colleagues, laying out how sophisticated, machine-based RL—going well beyond simple reinforcement learning from human feedback—could take large language models to the next level. But Silver quickly ran into a wall. It was partly that he was not cut out to work inside a product

…

Gemini we are matching that. And I think we still have the better ideas,” Hassabis added. I pressed a little harder. People increasingly spoke of large language models and ChatGPT as though they were interchangeable. It was like web search: People just called it “googling.” Valley venture capitalists believed that GPT’s brand

…

release, however, Hassabis believed that the cycle was about to turn again. “People say, ‘Oh, it used to be AlphaGo, now it’s all about large language models,’ ” Hassabis told me. “But this is just a moment in time. AlphaGo-type methods are coming back. These language systems are going to need planning

…

percent of them.[32] The system’s ability to ruminate—to backtrack and self-correct—was eerily human. After all, backtracking was antithetical to traditional large language models, which were trained to look forward. “They’re just kind of like, ‘predict next token, predict next token,’ ” an OpenAI researcher said, describing nonthinking models

…

a string of research triumphs, playing a lead role in the creation of the transformer architecture. “I have invented much of the current revolution in large language models,” Shazeer’s LinkedIn profile stated, and Google evidently agreed. Recently, after Shazeer had quit to launch an AI venture, the company had spent $2.7

…

had “just kind of vanished from the attention of the mainstream.” The field of artificial intelligence had descended into what Silver called the “valley” of large language models. The promise of RL had been forgotten. “You are the people who continued believing,” Silver told his audience. “At some point we need to get

…

we have to get past LLM Valley. “To become superhuman, the agent must interact and learn from its environment,” Silver went on. By mimicking humans, large language models had become impressively general. But the goal was to escape the echo chamber of existing knowledge—to uncover truths of which humans had no inkling

…

work of James Clerk Maxwell that people understood electricity, that there was a theory. I think deep learning is a bit similar. We can build large language models and they work very well, but nobody understands completely why. There is progress being made, but there is not yet a theory of it. I

…

TO NOTE REFERENCE 22 Silver even believed that a sufficiently large network could learn to search autonomously. He was anticipating the “emergent properties” that extremely large language models would exhibit several years later. Silver, author interview. BACK TO NOTE REFERENCE 23 Silver explains, “There are only two scalable things that we’ve really

…

-Shot Learners,” arXiv, February 8, 2022, doi.org/10.48550/arXiv.2109.01652. BACK TO NOTE REFERENCE 28 Jordan Hoffmann et al., “Training Compute-Optimal Large Language Models,” arXiv, March 29, 2022, doi.org/10.48550/arXiv.2203.15556. BACK TO NOTE REFERENCE 29 Sutskever, author interview. BACK TO NOTE REFERENCE 30 Amelia

…

, Empire of AI, 258. BACK TO NOTE REFERENCE 12 Will Douglas Heaven, “Why Meta’s Latest Large Language Model Survived Only Three Days Online,” MIT Technology Review, November 18, 2022, technologyreview.com/2022/11/18/1063487/meta-large-language-model-ai-only-survived-three-days-gpt-3-science. BACK TO NOTE REFERENCE 13 Sparrow’s search

…

It Is; A New Open-Source Security Threat: AIJacking.” BACK TO NOTE REFERENCE 4 Jason Wei et al., “Chain of Thought Prompting Elicits Reasoning in Large Language Models,” arXiv, January 28, 2022, arxiv.org/abs/2201.11903. Google’s release of this paper demonstrates that it was generally more open than OpenAI in

…

. BACK TO NOTE REFERENCE 21 Demis Hassabis, remarks at Imagination in Action (MIT), February 18, 2025. BACK TO NOTE REFERENCE 22 Jérémy Scheurer et al., “Large Language Models Can Strategically Deceive Their Users When Put Under Pressure,” arXiv, July 15, 2024, arxiv.org/abs/2311.07590. BACK TO NOTE REFERENCE 23 This behavior

…

, metr.org/blog/2025-06-05-recent-reward-hacking. BACK TO NOTE REFERENCE 25 Carson Denison et al., “Sycophancy to Subterfuge: Investigating Reward-Tampering in Large Language Models,” arXiv, June 14, 2024, arxiv.org/abs/2406.10162. BACK TO NOTE REFERENCE 26 Bowen Baker et al., “Monitoring Reasoning Models for Misbehavior and the

The Means of Prediction: How AI Really Works (And Who Benefits)

by Maximilian Kasy  · 15 Jan 2025  · 209pp  · 63,332 words

justice, and health care. In a similar vein, Timnit Gebru, a computer scientist writing during her time working at Google, warned of the dangers of large language models acting as stochastic parrots, which repeat language patterns without understanding, and in doing so replicate the biases embedded in their training data. Meredith Whittaker, currently

…

perceptions of AI have oscillated from “an obscure academic niche” to the very broad “everything related to data,” and back to the narrow category of “large language models.” This book will take an intermediate stance, in between these very broad and very narrow definitions. Following the standard technical treatment of AI, this book

…

measurable reward.” This definition is more specific than “anything to do with data,” but at the same time, it includes a lot more than just large language models. This definition gives us a framework to talk about the many socially consequential settings where AI is used. There are many branches of the field

…

outcome as accurately as possible. Many learning problems are prediction problems: In facial recognition, an individual’s identity is predicted based on an image. In large language models, the next word is predicted based on the preceding words. In the hiring of job candidates, future performance is predicted based on candidate characteristics. In

…

net), have also been central for generative AI—AI that produces text, images, or other media. This includes large language models, where the goal is to predict the most likely word to come next. (Large language models power applications such as ChatGPT.) Generative AI also includes image generation, where images are predicted based on text labels

…

. Public understanding has oscillated from AI being an obscure academic niche field, to it encompassing everything related to data, to it narrowly referring exclusively to large language models. This book will take an intermediate position, following leading textbooks on the subject. According to these textbooks, the goal of AI, as a field of

…

. A robot might choose which way to turn or how to move its arm. A social media algorithm might choose what ads to display. A large language model might choose what sentence to print next. A hiring algorithm might choose which job candidate to invite for an interview. There is, second, the objective

…

deadly set of applications of supervised learning has led to spectacular successes of AI in language processing, computer vision, and game play in recent years: Large language models can predict the word that is most likely to come next given a sequence of words typed thus far. Algorithms for machine translation predict the

…

of big data. Increasingly complex models, usually leveraging artificial neural nets, are fit on ever-larger datasets. (Examples of this development are the ever-larger large language models, which are discussed in the next chapter, where figure 6 shows the massive growth of both datasets and model complexity.) But no matter how large

…

still represent the same object. For natural language processing, transformer networks, another variant of neural networks that use self-attention, form the backbone of recent large language models. Such transformer networks are based on a recognition of the fact that, in human languages, the relevant context for interpreting a word often does not

…

the more general principles of AI and machine learning, which this book discusses, are likely to remain relevant in the long run. Today, virtually all large language models use the transformer architecture discussed above. The prime reason for the popularity of the transformer architecture is its practical success; its popularity is not motivated

…

6 shows the number of training tokens (i.e., the size of training datasets) and the number of parameters by year of release in different large language models. The vertical axis is scaled so that each step corresponds to a tenfold increase. Some of these models have more than one trillion parameters and

…

AI company DeepSeek suggest that this scale might be reduced somewhat without loss of performance.) Figure 6 The size of large language models Source: Wikipedia, “Large Language Model,” accessed October 1, 2024, https://en.wikipedia.org/wiki/Large_language_model Language modeling is one success story of deep learning; image generation is another one. The most successful algorithms for

…

approach is due to its practical success. Generative AI, whether for the generation of text or of images, raises important questions of data ownership. Both large language models and image generation models are trained on data that are primarily scraped from the internet, without either the knowledge or the consent of those who

…

maximizes or minimizes some objective function—such as predictive loss (i.e., prediction errors) for the next word on the internet, in the case of large language models. For generative AI, we need to modify this statement slightly: The model minimizes predictive loss for the next word in response to a prompt that

…

or benefits of their actions. Externalities might be positive or negative. Pollution is a negative externality, where others are harmed. The training and deployment of large language models, for example, consumes vast amounts of energy and thereby contributes to climate change. Knowledge production by contrast creates positive externalities, where others benefit. Public funding

…

an open-source license). These platforms greatly contribute to the common good. They also serve as one of the prime sources of training data for large language models, and for generative AI more broadly. All the works of art and writing that are available on the internet but that are considered someone’s

…

models. In a memorable and apt metaphor, the science fiction author Ted Chiang has described large language models, such as the one that underpins ChatGPT, as a blurry compressed image of the internet. The companies that control large language models are effectively scraping and compressing much of the internet, including all its contributions from a myriad

…

scalability, is the unstructured text data available on the internet. The comprehensive scraping of these data has powered much of the recent spectacular advances of large language models. Conceivably, however, limits might soon be reached in terms of the amount of text data of sufficient quality that can be made available. This suggests

…

alone do not make AI. To process data, we need computers. In application domains of AI where data are abundant, such as game play or large language models, the limiting factor for AI is usually computational capacity. The heart of a typical computer is its central processing unit, or CPU. The CPU is

…

and then setting the price equal to this value. Should the algorithm instead set prices to maximize consumer welfare? A chatbot algorithm based on a large language model might give answers corresponding to the most likely sequence of words that might follow a given question. The algorithm might do so by predicting responses

…

, 93 enclosures, 82, 108 energy: as component of the means of prediction, 93–95; consumption of, 93; externalities generated by production and consumption of, 95; large language models’ use of, 84; scalability of use of, 95 engineers/computer scientists: and AI ethics, 97–98; capacity of, as change agents, 100–101. See also

…

; competitive vs. noncompetitive, 150, 154; empirical trends in, 155–58; polarization of, 157; technology’s effects on, 149–50, 157, 161–62 Landemore, Hélène, 198 large language models: complexity of, 41; content of, 86, 87, 188; dangers of, 6; energy used by, 84; how they work, 10; as narrow definition of AI, 9

Amateurs!: How We Built Internet Culture and Why It Matters

by Joanna Walsh  · 22 Sep 2025  · 255pp  · 80,203 words

until they get the best result, then they work out what it is about these questions that works and systematise it as method. A GPT large language model (LLM) can teach itself in a ‘semi-supervised’ way, inferring meaning from examples of language from the context it is given. OpenAI’s GPT was

…

, Reddit’s owners were trying to get AI developers to pay for what they were already doing, using crawlers to scrape their site to train large language models. Wikipedia was OpenAI’s most used data set, followed by Reddit. Pages created and upvoted by Reddit users accounted for around 22 per cent of

…

, 16 June 2023. 23.Ibid. 24.‘Google AI Ethics Co-Lead Timnit Gebru Says She Was Fired Over an Email’, Venture Beat. 25.Rachel Gordon, ‘Large Language Models Are Biased. Can Logic Help Save them?’, MIT News, 3 March 2023. 26.Rishi Bommasani, Drew A. Hudson, Ehsan Adeli, Russ Altman et al., ‘On

…

, Giorgio, 23, 80, 84, 86, 95–6, 208, 221 AI, 1 aesthetic products, 204–6 carbon footprint, 122 energy consumption, 124 environmental racism, 122 GPT large language model, 113 GPT NLP (natural language processing) models, 104 and humour, 101 RLHF (reinforcement learning from human feedback), 205–6 self-learning, 123, 206 spammers and

…

, 1, 205 Ethical Artificial Intelligence Team, 122 Google Adwords, 114 Google Books, 116 Google infamy, risk of, 187–9 Goop, 137, 145 governance, 222 GPT large language model, 113 GPT NLP (natural language processing) models, 104 Greenberg, Clement, 24 Grey Academia, 154, 163 Grossman, Lev, 5 group feeling, 103 Guattari, Felix, 54, 84

Artificial Intelligence: A Modern Approach

by Stuart Russell and Peter Norvig  · 14 Jul 2019  · 2,466pp  · 668,761 words

In the Plex: How Google Thinks, Works, and Shapes Our Lives

by Steven Levy  · 12 Apr 2011  · 666pp  · 181,495 words

On the Edge: The Art of Risking Everything

by Nate Silver  · 12 Aug 2024  · 848pp  · 227,015 words

Nexus: A Brief History of Information Networks From the Stone Age to AI

by Yuval Noah Harari  · 9 Sep 2024  · 566pp  · 169,013 words

Code Dependent: Living in the Shadow of AI

by Madhumita Murgia  · 20 Mar 2024  · 336pp  · 91,806 words

Stories Are Weapons: Psychological Warfare and the American Mind

by Annalee Newitz  · 3 Jun 2024  · 251pp  · 68,713 words

Superbloom: How Technologies of Connection Tear Us Apart

by Nicholas Carr  · 28 Jan 2025  · 231pp  · 85,135 words

Four Battlegrounds

by Paul Scharre  · 18 Jan 2023

The Singularity Is Nearer: When We Merge with AI

by Ray Kurzweil  · 25 Jun 2024

The Equality Machine: Harnessing Digital Technology for a Brighter, More Inclusive Future

by Orly Lobel  · 17 Oct 2022  · 370pp  · 112,809 words

Fixed: Why Personal Finance is Broken and How to Make it Work for Everyone

by John Y. Campbell and Tarun Ramadorai  · 25 Jul 2025

Blank Space: A Cultural History of the Twenty-First Century

by W. David Marx  · 18 Nov 2025  · 642pp  · 142,332 words

End Times Fascism: And the Fight for the Living World

by Naomi Klein and Astra Taylor  · 14 Sep 2026  · 393pp  · 124,539 words

Why Machines Learn: The Elegant Math Behind Modern AI

by Anil Ananthaswamy  · 15 Jul 2024  · 416pp  · 118,522 words

Pattern Breakers: Why Some Start-Ups Change the Future

by Mike Maples and Peter Ziebelman  · 8 Jul 2024  · 207pp  · 65,156 words

Supremacy: AI, ChatGPT, and the Race That Will Change the World

by Parmy Olson  · 284pp  · 96,087 words

Co-Intelligence: Living and Working With AI

by Ethan Mollick  · 2 Apr 2024  · 189pp  · 58,076 words

The Age of AI: And Our Human Future

by Henry A Kissinger, Eric Schmidt and Daniel Huttenlocher  · 2 Nov 2021  · 194pp  · 57,434 words

What If We Get It Right?: Visions of Climate Futures

by Ayana Elizabeth Johnson  · 17 Sep 2024  · 588pp  · 160,825 words

The Optimist: Sam Altman, OpenAI, and the Race to Invent the Future

by Keach Hagey  · 19 May 2025  · 439pp  · 125,379 words

Empire of AI: Dreams and Nightmares in Sam Altman's OpenAI

by Karen Hao  · 19 May 2025  · 660pp  · 179,531 words

Boom: Bubbles and the End of Stagnation

by Byrne Hobart and Tobias Huber  · 29 Oct 2024  · 292pp  · 106,826 words

These Strange New Minds: How AI Learned to Talk and What It Means

by Christopher Summerfield  · 11 Mar 2025  · 412pp  · 122,298 words

More Everything Forever: AI Overlords, Space Empires, and Silicon Valley's Crusade to Control the Fate of Humanity

by Adam Becker  · 14 Jun 2025  · 381pp  · 119,533 words

The Long History of the Future: Why Tomorrow's Technology Still Isn't Here

by Nicole Kobie  · 3 Jul 2024  · 348pp  · 119,358 words

Searches: Selfhood in the Digital Age

by Vauhini Vara  · 8 Apr 2025  · 301pp  · 105,209 words

The Age of Extraction: How Tech Platforms Conquered the Economy and Threaten Our Future Prosperity

by Tim Wu  · 4 Nov 2025  · 246pp  · 65,143 words

Gilded Rage: Elon Musk and the Radicalization of Silicon Valley

by Jacob Silverman  · 9 Oct 2025  · 312pp  · 103,645 words

Valley of Death: How Big Tech Is Fueling the Future of War

by Sharon Weinberger  · 21 Sep 2026  · 281pp  · 98,857 words

This Is for Everyone: The Captivating Memoir From the Inventor of the World Wide Web

by Tim Berners-Lee  · 8 Sep 2025  · 347pp  · 100,038 words

The Sirens' Call: How Attention Became the World's Most Endangered Resource

by Chris Hayes  · 28 Jan 2025  · 359pp  · 100,761 words

The Wealth Ladder: Proven Strategies for Every Step of Your Financial Life

by Nick Maggiulli  · 22 Jul 2025

After Nations: The Making and Unmaking of a World Order

by Rana Dasgupta  · 27 Apr 2026  · 686pp  · 188,424 words

The Next Journalism: How the Press Must Change to Serve Democracy

by Tom Rosenstiel  · 17 Aug 2026  · 400pp  · 107,776 words

Rise of the Robots: Technology and the Threat of a Jobless Future

by Martin Ford  · 4 May 2015  · 484pp  · 104,873 words

Everything Is Predictable: How Bayesian Statistics Explain Our World

by Tom Chivers  · 6 May 2024  · 283pp  · 102,484 words

Unit X: How the Pentagon and Silicon Valley Are Transforming the Future of War

by Raj M. Shah and Christopher Kirchhoff  · 8 Jul 2024  · 272pp  · 103,638 words

Abundance

by Ezra Klein and Derek Thompson  · 18 Mar 2025  · 227pp  · 84,566 words

The Measure of Progress: Counting What Really Matters

by Diane Coyle  · 15 Apr 2025  · 321pp  · 112,477 words

Prophecy: Prediction, Power, and the Fight for the Future, from Ancient Oracles to AI

by Carissa Véliz  · 21 Apr 2026  · 503pp  · 129,255 words

The Thinking Machine: Jensen Huang, Nvidia, and the World's Most Coveted Microchip

by Stephen Witt  · 8 Apr 2025  · 260pp  · 82,629 words

The Rise and Fall of the Artificial State

by Jill Lepore  · 24 Aug 2026  · 363pp  · 122,400 words

The AGI Chronicles

by Kevin Roose  · 481pp  · 151,124 words

The Master Algorithm: How the Quest for the Ultimate Learning Machine Will Remake Our World

by Pedro Domingos  · 21 Sep 2015  · 396pp  · 117,149 words

Elon Musk

by Walter Isaacson  · 11 Sep 2023  · 562pp  · 201,502 words

If Anyone Builds It, Everyone Dies: Why Superhuman AI Would Kill Us All

by Eliezer Yudkowsky and Nate Soares  · 15 Sep 2025  · 215pp  · 64,699 words

We Are as Gods: A Survival Guide for the Age of Abundance

by Peter H. Diamandis and Steven Kotler  · 13 Apr 2026  · 225pp  · 76,418 words

The Nerd Reich: Silicon Valley Fascism and the War on Democracy

by Gil Durán  · 17 Aug 2026  · 317pp  · 114,570 words

Extremely Hardcore: Inside Elon Musk's Twitter

by Zoë Schiffer  · 13 Feb 2024  · 343pp  · 92,693 words

Money in the Metaverse: Digital Assets, Online Identities, Spatial Computing and Why Virtual Worlds Mean Real Business

by David G. W. Birch and Victoria Richardson  · 28 Apr 2024  · 249pp  · 74,201 words

Enshittification: Why Everything Suddenly Got Worse and What to Do About It

by Cory Doctorow  · 6 Oct 2025  · 313pp  · 94,415 words

Love Machines: How Artificial Intelligence Is Transforming Our Relationships

by James Muldoon  · 7 Sep 2026  · 217pp  · 71,182 words

The Origins of Efficiency

by Brian Potter  · 15 Feb 2025  · 474pp  · 134,246 words

The Pen

by Simon Garfield  · 10 Jun 2026  · 276pp  · 91,939 words

The Reverse Centaur's Guide to Life After AI: How to Think About Artificial Intelligence—Before It's Too Late

by Cory Doctorow  · 22 Jun 2026  · 175pp  · 51,295 words

The Big Fix: How Companies Capture Markets and Harm Canadians

by Denise Hearn and Vass Bednar  · 14 Oct 2024  · 175pp  · 46,192 words

The Economic Consequences of Mr Trump: What the Trade War Means for the World

by Philip Coggan  · 1 Jul 2025  · 96pp  · 36,083 words