Complete Since March 21, 2026 7 days · 28 min
Understanding the Visual Cortex
After Ramachandran's Phantoms in the Brain, I wanted to know how the brain turns light on the retina into what we see. The visual pathway from eye to cortex, the part of the brain closest to my work in computer vision.
Coverage
7 of 7 strands covered
Syllabus
37 of 37 topics written up
- 1 Retina and LGN 1/1
- 2 Edges in V1 4/4
- 3 Context 6/6
- 4 Two streams 4/4
- 5 Depth 8/8
- Three Types of Depth Neurons
- The Occlusion Problem — Amodal Completion
- Kanizsa Triangles — Seeing Edges That Don't Exist
- Global Correspondence Problem — V1 to V2
- Disparity Capture — Depth Propagates Across Surfaces
- Da Vinci Stereopsis
- Monocular Cues — Depth With One Eye
- Border Ownership — Image Segmentation in V2
- 6 Recognition 10/10
- The High-Level Visual Pipeline
- V4 — Shape, Colour Constancy & the Beginning of Invariance
- Posterior IT — Complete Object Representation (Perception)
- IT Cortical Columns — The Architecture of Object Knowledge
- Population Coding — How IT Actually Recognises Objects
- Damage to Posterior IT — Apperceptive Agnosia
- Anterior IT — Where Percepts Connect to Meaning
- Prosopagnosia — The Face Case
- Category-Specific Agnosias
- Amygdala & Hippocampus — Vision Becomes Cognition
- 7 The whole system 4/4
Index
Everything written, tangents included, A to Z
A
C
D
- Da Vinci Stereopsis 5
- Damage to Posterior IT — Apperceptive Agnosia 6
- Disparity Capture — Depth Propagates Across Surfaces 5
- How do neurons detect and assemble edges? 3
- How do neurons use context from their neighbours? 4
- How does seeing become knowing? 6
- How does the brain begin processing vision? 1
- How does the brain perceive depth? 5
- Dorsal Stream — "Where / How" 2
- Dorsal Stream — Complete Architecture 7
H
M
N
- Next 4
P
Conclusion
Where it ended up
So, how does the brain process what the eye sees?
It splits the work into two parallel streams, right from the retina. The dorsal stream is fast and memoryless: it tracks motion, builds spatial maps, and guides your hands and eyes in real-time. It never "sees" objects. The ventral stream is slow and hierarchical: it detects edges, assembles contours, extracts shapes, builds object representations, and connects them to meaning and memory.
At every stage, the brain uses relative perception (never absolute), fills in gaps it can't see, predicts what should come next, and resolves ambiguity through context. Perception is not passive recording. It is active construction. The brain doesn't see the world as it is. It builds a model of what the world should be, and checks it against incoming data. When the model is good enough, that's what you perceive.
The whole journey, from photon hitting the retina to a fully contextualised, emotionally-tagged memory, takes roughly 150 milliseconds.