Orthogonal complements of the four fundamental subspaces

The four fundamental subspaces come in two perpendicular pairs. One pair lives in the input space and the other in the output space. Keeping those two spaces straight helps us understand both the dimensions and the orthogonality.

Pair the row space with the null space

If Ax=0, each row of A has dot product zero with x. So the null space is the orthogonal complement of the row space, which is the column space of AT.

Pair the column space with the left null space

If ATy=0, each column of A has dot product zero with y. So the null space of AT, called the left null space of A, is the orthogonal complement of the column space of A.

For an m-by-n matrix of rank r
Perpendicular pairAmbient dimensionTheir dimensions
Row space and null spacenr and n-r
Column space and left null spacemr and m-r

Work through the dimensions for a four-by-three matrix

A=[1-10-20003-111-2]

Row reduction gives three pivots, so the rank is 3. The row space has dimension 3 and the null space has dimension 0. The column space has dimension 3, and its orthogonal complement has dimension 4-3=1.

A vector spanning that complement is (-5,-2,-2,1). Its dot product with each column of A is zero, which checks that it lies in the left null space.