What problem are we solving?
A yes/no test for a match, using only geometry
- SIFT gives matched pixels: this spot in photo 1 = that spot in photo 2
- Some of those matches are wrong
- We want a test: is this match possible or impossible, using only geometry
Day 1 ended with matches that had passed the ratio test. That test only asks whether a descriptor looks clearly more like one candidate than any other. It knows nothing about the scene. A white window frame matches the window frame next to it, a patch of leaves matches another patch of leaves, and the ratio test can be fooled by both.
Geometry gives a check that descriptors can't. Both photos were taken of one rigid scene from two places. That puts a hard constraint on where a point from photo 1 is allowed to show up in photo 2. It can't be just anywhere: it has to be on one particular line. A match off that line is impossible, however good its descriptor looks.
Everything below is the derivation of that line. It helps to keep the end in mind: we're building a function that takes a pixel in photo 1 and returns a line in photo 2, and the test is "is the matched pixel on it?"