AI Foundationspredict · compress · act

concepts → Format

Format

Information plane

decade2 connections

a plot of what a representation keeps against what it knows — the picture the bottleneck lives on

Where it sits

The prism has six jobs across and eight layers down. Its primary cell is no mode × L0. Hatched cells cannot exist — a GPU does not learn, an institution does not infer.

What must come first — and what it unlocks

Left to right is reading order, derived from the prerequisite_of edges. Nothing here is hand-ordered: the diagram is the graph.

nothing comes first — this is a starting pointInformation planenothing depends on it yet — a leaf in the reading order

What kind of thing it is — and what it is made of

It is part of: Information bottleneck.

Where to read it

The chapter that introduces it, and any chapter that uses it again.

15The Bottleneckact IV · The Learning Floor

Where it comes from

paperThe Information Bottleneck MethodTishby, Pereira, Bialek · 1999
paperOn the Information Bottleneck Theory of Deep LearningSaxe, Bansal, Dapello, Advani, Kolchinsky, Tracey, Cox · 2018

Every connection

All 2 edges touching this node, grouped by relation family — the sections above are highlights from this list. Colours match the relation families inthe atlas.

Structure · 1
is part ofInformation bottleneckObjective
Flow · 1
usesMutual informationQuantity

This page is a projection of one node in src/data/concepts.ts. It has no prose file of its own — 521 declared edges produce all 340 of these pages. Edit an edge and both endpoints change.