How Modern AI Actually Works

Learning objectives

By the end you can:

1. State, in one sentence and then in mechanism, what a large language model fundamentally does (predict the next token) and explain why that single fact accounts for almost everything else about how it behaves.
2. Trace the whole path from your words to its answer: tokenization (text becomes numbers) → embeddings (meaning becomes position in a space) → attention (which earlier tokens matter) → a probability distribution over the next token → sampling (a choice) → repeat, one token at a time.
3. Explain embeddings and attention in plain language with a concrete example and no equations, and say what each one contributes to the final answer.
4. Distinguish the context window (the model's transient working memory) from its trained weights (its frozen long-term knowledge), and predict exactly what happens when a task overflows the window.
5. Separate training (pattern-learning over a large corpus with a hard knowledge cutoff, plus an instruction-tuning stage) from inference (the frozen model generating one token at a time, learning nothing, remembering nothing, looking nothing up, unless a tool is deliberately attached).
6. State the payoff of the entire module (that the model optimizes for plausible, not true) and use it to explain, from first principles, why fluent, confident, wrong output is not a glitch but the predictable shape of the thing.
7. Dissect a confident wrong answer end to end on both an Indian (₹) and a US ($) example, naming the mechanism that produced it and the primary-source check that catches it.
8. (Productivity objective: R10 duality.) Know which broad category of AI tool to reach for a given job, and, more importantly, the limits of each; and drive a chat assistant to build your own intuition without being misled by it.
9. Apply the Primary-Source Guardrail (five checks: Trace · Match · Recompute · Date-check · Cite) to any AI output, so that no figure ever enters your work until it is traced to a named primary source.

The duality, stated once (R10). This module carries two objectives at once, as every module in this branch does. The understanding objective (items 1–7 and 9) is what the mastery gate rewards; you earn the belt by explaining the mechanism and running the verification by hand. The productivity objective (item 8) is the payoff you keep: knowing which tool to reach for and how far to trust it. Awareness makes you fast; understanding makes you an analyst. A tool can never buy you a pass on the gate.

Prerequisites & connections

Builds on. Almost nothing. This is the first node of the AI-Augmented branch, and like the first Excel node it opens on day one with no prerequisite. You need no coding, no calculus, no prior machine-learning exposure, only ordinary arithmetic, comfort with the idea of a coordinate (that a point can be described by a list of numbers), and, ideally, ten minutes of having actually used a chatbot so the behaviour we explain is behaviour you have seen. If you have ever typed a question into an AI assistant and read the answer, you have enough to start. What this node will do is rewire an instinct: most people who have used these tools have quietly formed a wrong mental model of them, "it looks things up," "it learns from me," "if it's detailed it's probably right", and that model has to go before a correct one can take its place.

Feeds forward. Everything in this branch, and a thread through every other galaxy. AI0.02 (the tool landscape) asks you to categorise and evaluate tools, which is only possible once you know what the tool is doing under the hood, which is this node. AI0.03 (prompting) is the craft of steering a plausibility engine; its every technique makes sense only against the mechanism taught here. AI0.04 (retrieval and RAG) is the direct engineering answer to two problems this node names out loud, the knowledge cutoff and the limited context window, so RAG will feel inevitable rather than arbitrary. AI0.05 (agents) stacks many inference calls into a loop, inheriting every property discussed here and compounding it. And AI0.06, the crown of the branch, is nothing but this module's payoff line, plausible, not true, turned into a reflexive detection discipline: every failure mode it drills is a special case of the root cause named here. The Primary-Source Guardrail introduced in this node governs the verify step of every AI-Augment callout in every galaxy of the program. Learn the mechanism once, here, and the rest of the branch is applied consequence.