Turning Images Into Sound, One Pixel at a Time

A visual thought experiment maps each pixel to a frequency and its brightness to volume.

Canal
3Blue1Brown
Publicado
8 dic 2023
Vídeo
0:59
Lectura
1 min
Diapositivas
2
Original
inglés
Abrir en YouTube
Al desplazarte, el vídeo se reduce a la esquina inferior derecha y sigue reproduciéndose. Los subtítulos siguen tu idioma de lectura.
Idioma de lecturaDisponible en 2 idiomas
Este artículo aún no está en español, así que se muestra el original en inglés.
RESUMEN

En 30 segundos

A 3Blue1Brown short introduces one possible way to encode images as sound. The speaker imagines assigning each pixel a unique frequency and playing brighter pixels louder, leaving the listener to interpret the combined signal.

  1. 1Start with a small imageThe example uses a 256-by-256-pixel image.
  2. 2Give each pixel a frequencyA unique tone can represent each position in the image.
  3. 3Brightness becomes volumeBrighter pixels produce louder components in the combined sound.

Conclusiones

  1. An image can be treated as a grid of pixels.
  2. Each pixel can be assigned a distinct frequency whose volume reflects brightness.
  3. The mixed sound contains image information but may initially be difficult to interpret.
TEXTO COMPLETO

Lee el texto editado por capítulos

Solo la transcripción
01

Representing the image

A low-resolution image is represented as a grid of pixels.

Suppose we want software that lets people perceive images through sound. To make an initial experiment simpler, we can start with a low-resolution image, perhaps 256 by 256 pixels, and represent it as a square grid.

02

Mapping pixels to sound

Frequency represents position and volume represents brightness; all tones are played together.

A 256-by-256 image
DIAPOSITIVA 1 / 2A 256-by-256 imageThe image is treated as a grid whose pixels become inputs to the sound encoding.

One approach is to assign a unique sound frequency to each pixel. The position in the image determines which frequency represents it.

Many frequencies played together
DIAPOSITIVA 2 / 2Many frequencies played togetherThe sound combines components representing different pixel positions.

Play the frequency louder when its pixel is bright and more quietly when it is dark. Playing all the frequencies together produces a mixture whose strongest components correspond to brighter regions. At first it may sound like a cacophony; the idea is that a listener could learn to interpret the information within it.

Más de este canal

20 diapositivas40:44EN
3Blue1Brown· 16 oct 2026Grant Sanderson: There's never been a better time to go into mathGrant Sanderson, Constantin Kogler · 3Blue1BrownStudents fear AI has solved mathematics. Grant Sanderson argues the opposite: even if machines prove theorems better than we do, the institution of math stays valuable—and this is a rare moment when newcomers can reshape it.MathematicsAI for scienceHuman-AI Collaboration+2
29 diapositivas51:55EN
3Blue1Brown· 18 sept 2026The last IMO problem AI could not solveGrant Sanderson · 3Blue1BrownGrant Sanderson walks through IMO 2025 Problem 6 — a tiling puzzle that frontier models missed — and the visual patience it takes to prove a construction is optimal.MathematicsAI researchReasoning & test-time compute+2
0:55EN
3Blue1Brown· 24 jul 2026The 64 Sugar Cubes Puzzle: Six Equal DistancesA 4×4×4 block has three colors; prove that six same-colored pairs share a distance.MathematicsEducation
33:51EN
3Blue1Brown· 16 jul 2026What Cross-Entropy Connects: Compression, Language Models and KL DivergenceGrant Sanderson · 3Blue1BrownGrant Sanderson builds cross-entropy from code lengths and uses it to explain next-token training and distillation.MathematicsMachine LearningFoundation Models+1
Diapositivas2:25EN
3Blue1Brown· 12 jun 2026How Shannon Measured the Entropy of EnglishA guessing game helped Claude Shannon estimate how much information English text contains, and why prediction is central to compression.MathematicsAI History
Diapositivas1:02EN
3Blue1Brown· 10 jun 2026A Robot Walk and the Puzzle of Optimal Binary EncodingHow few bits does it take to send directions that occur with unequal frequencies?MathematicsScience Communication