AI Foundationspredict · compress · act

concepts → Architecture

Architecture

Language model

timeless5 connectionsdraft

a model that puts a probability on the next piece of text

Where it sits

The prism has six jobs across and eight layers down. Its primary cell isinfer × L1. Hatched cells cannot exist — a GPU does not learn, an institution does not infer.

What must come first — and what it unlocks

Left to right is reading order, derived from the prerequisite_of edges. Nothing here is hand-ordered: the diagram is the graph.

Self-supervised learningNext-token predictionLanguage modelAgentReasoning model

Before it: Self-supervised learning · Next-token prediction

Unlocks: Agent · Reasoning model

Where to read it

The chapter that introduces it, and any chapter that uses it again.

26The Big Readact 6 · The Attention Revolution

Where it comes from

paperLanguage Models are Few-Shot LearnersTom Brown, et al. · 2020

Every connection

All 5 edges touching this node, grouped by relation family — the sections above are highlights from this list. Colours match the relation families inthe atlas.

Order · 4
requiresSelf-supervised learningMechanism
must come beforeAgentSystem
must come beforeReasoning modelArchitecture
Lineage · 1
is improved byReasoning modelArchitecture

This page is a projection of one node in src/data/concepts.ts. It has no prose file of its own — 230 declared edges produce all 236 of these pages. Edit an edge and both endpoints change.