AI Foundationspredict · compress · act

concepts → Model

Model

Audio model

frontieras of 2026-095 connections

a model that works on sound directly, once a codec has turned the waveform into tokens

Where it sits

The prism has six jobs across and eight layers down. Its primary cell is no mode × L1. Hatched cells cannot exist — a GPU does not learn, an institution does not infer.

Overlays: Evaluation & methodology.

What must come first — and what it unlocks

Left to right is reading order, derived from the prerequisite_of edges. Nothing here is hand-ordered: the diagram is the graph.

nothing comes first — this is a starting pointAudio modelnothing depends on it yet — a leaf in the reading order

What kind of thing it is — and what it is made of

It is made of: Speech recognition, Text-to-speech, Speech-to-speech, Music generation.

Where to read it

The chapter that introduces it, and any chapter that uses it again.

60Audio Modelsact XIII · Beyond Text

Where it comes from

paperRobust Speech Recognition via Large-Scale Weak SupervisionAlec Radford, Jong Wook Kim, Tao Xu, Greg Brockman, Christine McLeavey, Ilya Sutskever · 2022
paperNeural Codec Language Models Are Zero-Shot Text to Speech SynthesizersChengyi Wang, Sanyuan Chen, Yu Wu, Ziqiang Zhang, Long Zhou, Shujie Liu, Zhuo Chen, Yanqing Liu, Huaming Wang, Jinyu Li, Lei He, Sheng Zhao, Furu Wei · 2023
paperMusicLM: Generating Music From TextAndrea Agostinelli, Timur I. Denk, Zalán Borsos, Danny Kalajdzievski, Marco Tagliasacchi, Mauro Verzetti, Antoine Caillon, Zaharia, Zhe Zhang, Christian Frank, Jesse Engel, Chris Donahue, Neil Zeghidour · 2023

Every connection

All 5 edges touching this node, grouped by relation family — the sections above are highlights from this list. Colours match the relation families inthe atlas.

Structure · 4
has as a partSpeech recognitionTask
has as a partText-to-speechTask
has as a partSpeech-to-speechTask
has as a partMusic generationTask
Flow · 1
usesNative audioProperty

This page is a projection of one node in src/data/concepts.ts. It has no prose file of its own — 521 declared edges produce all 340 of these pages. Edit an edge and both endpoints change.