Orthogonal complements of the four fundamental subspaces
The four fundamental subspaces come in two perpendicular pairs. One pair lives in the input space and the other in the output space. Keeping those two spaces straight helps us understand both the dimensions and the orthogonality.
Pair the row space with the null space
If , each row of has dot product zero with . So the null space is the orthogonal complement of the row space, which is the column space of .
Pair the column space with the left null space
If , each column of has dot product zero with . So the null space of , called the left null space of , is the orthogonal complement of the column space of .
| Perpendicular pair | Ambient dimension | Their dimensions |
|---|---|---|
| Row space and null space | and | |
| Column space and left null space | and |
Work through the dimensions for a four-by-three matrix
Row reduction gives three pivots, so the rank is . The row space has dimension and the null space has dimension . The column space has dimension , and its orthogonal complement has dimension .
A vector spanning that complement is . Its dot product with each column of is zero, which checks that it lies in the left null space.