MATH 133 Linear Algebra and Geometry • McGill University, Montreal

Revision sheet: basis, dimension and the fundamental subspaces (MATH 133)

This sheet is not a summary of sections 5.2 and 5.4 of Nicholson: you already have the course notes. It answers one question only, what makes students lose marks on bases, dimension and the fundamental subspaces in MATH 133 at McGill University, and which precise gesture avoids each loss.

Almost every trap below is the same confusion seen from a different side. Row reduction is a counting machine: it tells you how many pivots there are and where they sit, and those two facts survive every row operation. The vectors themselves do not survive, at least not on the column side, so each fundamental subspace has to take its basis from the right matrix. Get that one reflex right and half of the chapter's final-exam questions become bookkeeping.

The thread of the chapter

Row reduction gives you a COUNT and POSITIONS, never the vectors: the dimension survives row operations and the column space does not, so col(A)\text{col}(A) is copied from the ORIGINAL pivot columns, row(A)\text{row}(A) from the non-zero rows of RR, null(A)\text{null}(A) from the solved system, and once the dimension is known a family of the right size needs one check, not two.

This chapter is part of MATH 133, Linear Algebra and Geometry (McGill)

The essentials

Basis and dimension: the number every basis shares

  • • A basis of a subspace WW is a family of vectors of WW that is independent AND spans WW. Every basis of WW has the same number of vectors: that number is dim⁡W\dim W.
  • • dim⁡Rn=n\dim \mathbb{R}^n = n, a plane through the origin has dimension 22, a line 11, and dim⁡{0}=0\dim\{0\} = 0 (its basis is empty).
  • • In a subspace of dimension mm: more than mm vectors are always dependent, fewer than mm never span, and exactly mm vectors form a basis as soon as they are independent OR as soon as they span.
  • • A subspace of Rn\mathbb{R}^n of dimension nn is Rn\mathbb{R}^n itself. A subspace cut out by homogeneous equations has dimension n−n - (rank of their coefficient matrix).
  • • Coordinates of vv in a basis {b1,…,bm}\{b_1, \dots, b_m\} of WW: the unique cic_i with v=c1b1+⋯+cmbmv = c_1 b_1 + \dots + c_m b_m. There are mm of them, the dimension of WW, not the length of vv.

The dimension is the tool that saves time: once you know it, the rule of mm vectors turns a two-part verification into a one-part one. Say the dimension out loud in the answer, it is what makes the shortcut legal.

One matrix, three subspaces, three different sources

  • • null(A)⊆Rn\text{null}(A) \subseteq \mathbb{R}^n: solve Rx=0Rx = 0, one basis vector per free variable. Row operations do not change the solutions of Ax=0Ax = 0.
  • • row(A)⊆Rn\text{row}(A) \subseteq \mathbb{R}^n: the non-zero rows of RR. Row operations only recombine rows, so the row space does not move.
  • • col(A)⊆Rm\text{col}(A) \subseteq \mathbb{R}^m: the columns of the ORIGINAL AA that sit in pivot positions. Row operations DO change the column space; they keep only the relations between columns.
  • • rank(A)=dim⁡col(A)=dim⁡row(A)=rank(AT)\text{rank}(A) = \dim \text{col}(A) = \dim \text{row}(A) = \text{rank}(A^T), and rank(A)+dim⁡null(A)=n\text{rank}(A) + \dim \text{null}(A) = n, the number of COLUMNS.
A, originalR, reducedrow operationskeep: countscol(A)pivot columns of Arow(A)non-zero rows of Rnull(A)solve Rx = 0
Row operations carry the COUNTS from AA to RR; the column space stays behind, so its vectors are copied from AA, while the rows and the null space are read on RR.

Read the positions on RR, copy the column vectors from AA. The figure is the whole chapter in one picture.

The rules in table form

Each row reads from left to right: the assumptions, then the result. A red cell is not an answer, it is the finding that the form settles nothing and the instruction to rewrite it. Every case is followed by a worked example.

Which matrix gives which basis

Worked on the matrix of the example below, A=(1−1212−254−11−11)A = \begin{pmatrix} 1 & -1 & 2 & 1 \\ 2 & -2 & 5 & 4 \\ -1 & 1 & -1 & 1 \end{pmatrix}, whose reduced form R=(1−10−300120000)R = \begin{pmatrix} 1 & -1 & 0 & -3 \\ 0 & 0 & 1 & 2 \\ 0 & 0 & 0 & 0 \end{pmatrix} has its pivots in columns 11 and 33. The red line is the rule students invent under pressure.

SubspaceLives inBasis taken from
null(A)\text{null}(A) R4\mathbb{R}^4 solutions of Rx=0Rx = 0

Example: x2x_2 and x4x_4 free: {(1,1,0,0),(3,0,−2,1)}\{(1, 1, 0, 0), (3, 0, -2, 1)\}, dimension 4−2=24 - 2 = 2.

row(A)\text{row}(A) R4\mathbb{R}^4 non-zero rows of RR

Example: {(1,−1,0,−3),(0,0,1,2)}\{(1, -1, 0, -3), (0, 0, 1, 2)\}, dimension 22.

col(A)\text{col}(A) R3\mathbb{R}^3 pivot columns of AA

Example: Columns 11 and 33 of AA: {(1,2,−1),(2,5,−1)}\{(1, 2, -1), (2, 5, -1)\}, dimension 22.

col(A)\text{col}(A) R3\mathbb{R}^3 pivot columns of RR rule that does not exist

Example: col(A)\text{col}(A) is the plane 3y1−y2+y3=03y_1 - y_2 + y_3 = 0, and (1,0,0)(1, 0, 0) gives 3≠03 \neq 0, (0,1,0)(0, 1, 0) gives −1≠0-1 \neq 0: neither is even in col(A)\text{col}(A).

What to do: Use RR only to find the pivot positions, then copy those columns from AA.

The three correct lines all have dimension 22, the rank. The red line has the right SIZE too, which is exactly why it survives until the marker checks a vector.

The mistakes that cost marks

These are the errors I correct most often in session. Each one costs marks on a paper, even when the reasoning behind it is right.

1. Copying the pivot columns of the REDUCED matrix as a basis of the column space

the whole basis part, typically 3 to 4 marks

What not to write

“R=(1−200)R = \begin{pmatrix} 1 & -2 \\ 0 & 0 \end{pmatrix}, so a basis of col(A)\text{col}(A) is {(1,0)}\{(1, 0)\}.”

What to write

“The pivot is in column 11, so a basis of col(A)\text{col}(A) is column 11 OF AA: {(1,3)}\{(1, 3)\}.”

-4-3-2-112345-4-3-2-11234column 1 of Acol(A)column 1 of R
The column space of AA is the blue line through (1,3)(1, 3); the pivot column of RR lies on the orange axis, a different line of the same dimension.

Why: Here A=(1−23−6)A = \begin{pmatrix} 1 & -2 \\ 3 & -6 \end{pmatrix} and every column of AA satisfies y2=3y1y_2 = 3y_1; (1,0)(1, 0) does not. Row operations preserve the relations between columns and the dimension, not the column space itself.

2. Subtracting the rank from the number of rows

2 marks, and every later answer built on the nullity

What not to write

“AA is 5×75 \times 7 of rank 33, so dim⁡null(A)=5−3=2\dim \text{null}(A) = 5 - 3 = 2.”

What to write

“Rank plus nullity counts the 77 columns: dim⁡null(A)=7−3=4\dim \text{null}(A) = 7 - 3 = 4.”

Why: The null space lives in R7\mathbb{R}^7, one coordinate per unknown, and each free unknown is a column without a pivot. The number 5−3=25 - 3 = 2 does exist: it is dim⁡null(AT)\dim \text{null}(A^T), the count of zero rows of RR.

3. Counting the zero rows of R as free variables

1 to 2 marks, plus a null space basis with the wrong number of vectors

What not to write

“AA is 3×53 \times 5 and RR has one zero row, so the null space has dimension 11.”

What to write

“RR has 22 pivots among 55 columns, so 33 free variables and dim⁡null(A)=3\dim \text{null}(A) = 3.”

Why: Free variables are COLUMNS without a pivot, zero rows are ROWS without a pivot. The two counts are n−rn - r and m−rm - r and they coincide only for a square matrix.

4. Trusting the rows of A that seem to match the non-zero rows of R

the row space part, 2 to 3 marks

What not to write

“The zero row of RR is row 33, so rows 11 and 22 of AA form a basis of row(A)\text{row}(A).”

What to write

“A basis of row(A)\text{row}(A) is the set of non-zero rows of RR: {(1,2,0,1),(0,0,1,−2)}\{(1, 2, 0, 1), (0, 0, 1, -2)\}.”

Why: With A=(12−1324−261201)A = \begin{pmatrix} 1 & 2 & -1 & 3 \\ 2 & 4 & -2 & 6 \\ 1 & 2 & 0 & 1 \end{pmatrix}, rows 11 and 22 are proportional; the reduction made row 22 zero and then SWAPPED rows. Row ii of RR is a combination of rows of AA, never row ii of AA in disguise.

5. Declaring a basis because the number of vectors is right

the whole question

What not to write

“(1,2,0)(1, 2, 0), (0,1,1)(0, 1, 1) and (1,3,1)(1, 3, 1) are three vectors of R3\mathbb{R}^3, so they form a basis.”

What to write

“Three vectors in R3\mathbb{R}^3, of dimension 33: they form a basis if they are independent. Here (1,3,1)=(1,2,0)+(0,1,1)(1, 3, 1) = (1, 2, 0) + (0, 1, 1), so they do NOT.”

Why: The rule of mm vectors removes ONE of the two checks, never both. The right size is a necessary condition; independence or spanning still has to be shown.

6. Counting equations instead of independent equations

2 marks, and a basis with one vector missing

What not to write

“Three equations in R4\mathbb{R}^4, so the subspace has dimension 4−3=14 - 3 = 1.”

What to write

“The third equation is the sum of the first two, the coefficient matrix has rank 22, so the dimension is 4−2=24 - 2 = 2.”

Why: A subspace defined by equations is a null space, and its dimension is nn minus the RANK. A redundant equation removes nothing, exactly as a redundant row reduces to zero.

7. Giving a vector of a plane three coordinates

the coordinate part, 2 marks

What not to write

“B={(1,0,1),(0,1,1)}B = \{(1, 0, 1), (0, 1, 1)\} and v=(2,3,5)v = (2, 3, 5), so [v]B=(2,3,5)[v]_B = (2, 3, 5).”

What to write

“v=2(1,0,1)+3(0,1,1)v = 2(1, 0, 1) + 3(0, 1, 1), so [v]B=(2,3)[v]_B = (2, 3): two coordinates, because BB has two vectors.”

Why: Coordinates are the coefficients of a combination of basis vectors, one per basis vector. The entries of vv are its coordinates in the STANDARD basis of R3\mathbb{R}^3, which is not the basis asked for.

8. Completing a family with a vector that is already in its span

the completion, 2 to 3 marks

What not to write

“(2,1,3)(2, 1, 3) is not a multiple of (1,0,1)(1, 0, 1) nor of (0,1,1)(0, 1, 1), so the three vectors form a basis of R3\mathbb{R}^3.”

What to write

“(2,1,3)=2(1,0,1)+(0,1,1)(2, 1, 3) = 2(1, 0, 1) + (0, 1, 1) lies in their plane z=x+yz = x + y. Take (0,0,1)(0, 0, 1) instead: 1≠0+01 \neq 0 + 0, so it is outside and the three form a basis.”

Why: A new vector must avoid the SPAN of the family, not just each vector of it. Testing pairs is the independence test of two vectors, and it says nothing about three.

Which method to choose

Which gesture the question is asking for

Read what the statement GIVES: a span, equations, a family of the right size, a size and a rank, or a basis and a vector

1 vector: a line2 independent: a basis3 vectors: dependent
Inside a plane, of dimension 22: one vector only spans a line, two independent vectors are a basis, and a third vector is always a combination of two, here their sum.
  • If a span, “find a basis of span{v1,…,vk}\text{span}\{v_1, \dots, v_k\}” → vectors as COLUMNS, reduce, keep the ORIGINAL vectors in pivot positions

    Example: v3=2v1−v2v_3 = 2v_1 - v_2 is dropped, {v1,v2,v5}\{v_1, v_2, v_5\} kept, dimension 33

  • If homogeneous equations, “the set of xx such that ...” → it is a null space: solve, one basis vector per free variable

    Example: x1−x2+2x3−x4=0x_1 - x_2 + 2x_3 - x_4 = 0 in R4\mathbb{R}^4: dimension 4−1=34 - 1 = 3

  • If mm vectors in a subspace whose dimension is known to be mm → ONE check: independence, or spanning, whichever is cheaper

    Example: (1,1,1,2)(1, 1, 1, 2) and (0,1,1,1)(0, 1, 1, 1) in a subspace of dimension 22: not proportional, so a basis

  • If an independent family, “extend to a basis of Rn\mathbb{R}^n” → append e1,…,ene_1, \dots, e_n after it, reduce, keep the original pivot columns

    Example: {(1,1,0,2),(0,1,1,1)}\{(1, 1, 0, 2), (0, 1, 1, 1)\} completes with e1e_1 and e2e_2

  • If only the SIZE of a matrix and its rank, or a statement about one subspace → rank plus nullity =n= n, dim⁡col=dim⁡row=r\dim \text{col} = \dim \text{row} = r, no computation

    Example: 6×86 \times 8 of rank 55: nullity 33, dim⁡null(AT)=1\dim \text{null}(A^T) = 1

  • If a basis BB and a vector vv, “find [v]B[v]_B” → solve the system whose columns are the basis vectors and whose right-hand side is vv

    Example: (3,5,4)(3, 5, 4) in {(0,1,1),(1,0,1),(1,1,0)}\{(0, 1, 1), (1, 0, 1), (1, 1, 0)\}: (3,1,2)(3, 1, 2)

If none of these fits, the question is almost always the three fundamental subspaces of one matrix: reduce once, then read null\text{null} and row\text{row} on RR and copy col\text{col} from AA.

How the answer is expected to be written

A marker ticks steps. Here they are in order, with the concluding sentence expected word for word.

Bases of the three fundamental subspaces

When to use it: “Find a basis and the dimension of null(A)\text{null}(A), col(A)\text{col}(A) and row(A)\text{row}(A)”, or any one of the three

  1. 1 Reduce AA to RR and name every operation: R2→R2−2R1R_2 \to R_2 - 2R_1. Method marks are given line by line.
  2. 2 Circle the pivot positions and state the rank: “pivots in columns 11 and 33, so rank(A)=2\text{rank}(A) = 2”.
  3. 3 Null space: write the free variables as parameters, solve for the pivot variables, and split the general solution into one vector per parameter.
  4. 4 Column space: name the columns and the matrix, “columns 11 and 33 of AA”, then write the vectors of AA.
  5. 5 Row space: the non-zero rows of RR, and say why: row operations do not change the row space.
  6. 6 Close with the check rank+nullity=n\text{rank} + \text{nullity} = n, and substitute one null space vector into the ORIGINAL AA.

Concluding sentence

“The pivots of RR are in columns 11 and 33, so a basis of col(A)\text{col}(A) is formed by columns 11 and 33 of AA, and dim⁡col(A)=dim⁡row(A)=2\dim \text{col}(A) = \dim \text{row}(A) = 2, dim⁡null(A)=4−2=2\dim \text{null}(A) = 4 - 2 = 2.”

The trap: Writing the column space basis without saying which matrix the columns come from. Even when the vectors are right, the marker cannot tell whether the method was.

Marking: Typically 2 marks for the reduction, then 2 per subspace (1 for the basis, 1 for the dimension), and 1 for the rank plus nullity check. A wrong column space basis costs its 2 marks even when the reduction is perfect.

Proving that a family is a basis with the dimension

When to use it: “Show that {w1,…,wm}\{w_1, \dots, w_m\} is a basis of WW” when dim⁡W\dim W is known or easy to find

  1. 1 Check that each wiw_i lies in WW, by substitution into the equations of WW.
  2. 2 State dim⁡W=m\dim W = m, with its reason: a basis already found, or nn minus the number of independent equations.
  3. 3 Prove ONE property: independence (usually cheaper for two or three vectors) or spanning.
  4. 4 Conclude by quoting the theorem: mm independent vectors in a subspace of dimension mm form a basis.

Concluding sentence

“The vectors lie in WW, they are independent, and dim⁡W=2\dim W = 2; two independent vectors in a subspace of dimension 22 form a basis of WW.”

The trap: Forgetting the first step. Two independent vectors of R^4 are a basis of SOME plane, not necessarily of W.

Marking: Usually 1 mark for membership, 1 for the dimension, 1 for independence and 1 for the conclusion that names the theorem.

Check before you hand in

Five minutes of checking recover more marks than one more problem started in a hurry.

The typical problem, taken apart

The three subspaces of one matrix, from a single reduction

Let A=(1−1212−254−11−11)A = \begin{pmatrix} 1 & -1 & 2 & 1 \\ 2 & -2 & 5 & 4 \\ -1 & 1 & -1 & 1 \end{pmatrix}.

Find a basis and the dimension of null(A)\text{null}(A), col(A)\text{col}(A) and row(A)\text{row}(A), and check the rank theorem.

Step 1

R2→R2−2R1R_2 \to R_2 - 2R_1 gives (0,0,1,2)(0, 0, 1, 2); R3→R3+R1R_3 \to R_3 + R_1 gives (0,0,1,2)(0, 0, 1, 2); R3→R3−R2R_3 \to R_3 - R_2 gives a zero row; R1→R1−2R2R_1 \to R_1 - 2R_2 gives (1,−1,0,−3)(1, -1, 0, -3). So R=(1−10−300120000)R = \begin{pmatrix} 1 & -1 & 0 & -3 \\ 0 & 0 & 1 & 2 \\ 0 & 0 & 0 & 0 \end{pmatrix}.

Why

Every operation is named because the marks are given for the path. The zero row is information, not a nuisance: it says that the third row of AA was a combination of the first two, so the rank is 22, not 33.

Step 2

Pivots in columns 11 and 33: rank(A)=2\text{rank}(A) = 2. Free variables x2=sx_2 = s, x4=tx_4 = t; then x1=s+3tx_1 = s + 3t and x3=−2tx_3 = -2t, so x=s(1,1,0,0)+t(3,0,−2,1)x = s(1, 1, 0, 0) + t(3, 0, -2, 1). Basis of null(A)\text{null}(A): {(1,1,0,0),(3,0,−2,1)}\{(1, 1, 0, 0), (3, 0, -2, 1)\}, dimension 22.

Why

One vector per free variable, and they are independent for free: each has a 11 in its own free slot and a 00 in the other. Using RR is legitimate here, because Ax=0Ax = 0 and Rx=0Rx = 0 have exactly the same solutions.

Step 3

Basis of row(A)\text{row}(A): the non-zero rows of RR, {(1,−1,0,−3),(0,0,1,2)}\{(1, -1, 0, -3), (0, 0, 1, 2)\}, dimension 22.

Why

Row operations recombine rows reversibly, so the row space of RR IS the row space of AA, and its non-zero rows are visibly independent thanks to their leading 11s.

Step 4

Basis of col(A)\text{col}(A): columns 11 and 33 OF AA, {(1,2,−1),(2,5,−1)}\{(1, 2, -1), (2, 5, -1)\}, dimension 22.

1-1212-254-11-111-10-300120000A =R =rrefcopy these columnspositions found here

Why

This is the step the whole sheet is about. RR gave the positions; the vectors come from AA. All four columns of AA satisfy 3y1−y2+y3=03y_1 - y_2 + y_3 = 0, while the pivot columns of RR, (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0), give 33 and −1-1: copying them would give a basis of the wrong plane.

Step 5

Check: rank+nullity=2+2=4\text{rank} + \text{nullity} = 2 + 2 = 4, the number of columns. And A(3,0,−2,1)A(3, 0, -2, 1) gives 3−4+1=03 - 4 + 1 = 0, 6−10+4=06 - 10 + 4 = 0, −3+2+1=0-3 + 2 + 1 = 0.

Why

The count check is free and catches a lost free variable; the substitution into the ORIGINAL AA, not into RR, catches a sign error in the null space. Thirty seconds for two independent safety nets.

The conclusion, written out

“rank(A)=2\text{rank}(A) = 2. null(A)\text{null}(A) has basis {(1,1,0,0),(3,0,−2,1)}\{(1, 1, 0, 0), (3, 0, -2, 1)\}, row(A)\text{row}(A) has basis {(1,−1,0,−3),(0,0,1,2)}\{(1, -1, 0, -3), (0, 0, 1, 2)\}, and col(A)\text{col}(A) has basis {(1,2,−1),(2,5,−1)}\{(1, 2, -1), (2, 5, -1)\}, columns 11 and 33 of AA; all three have dimension 22, and 2+2=42 + 2 = 4.”

The classic mistake on this problem: Answering col(A)=span{(1,0,0),(0,1,0)}\text{col}(A) = \text{span}\{(1, 0, 0), (0, 1, 0)\}, the plane y3=0y_3 = 0. It has the right dimension, so the rank theorem check passes, and it is still the wrong subspace: (1,2,−1)(1, 2, -1), the first column of AA, is not in it.

Learn by heart

  • • A basis is independent AND spanning; all bases of WW have dim⁡W\dim W vectors; dim⁡{0}=0\dim\{0\} = 0.
  • • In dimension mm: mm independent vectors are a basis, mm spanning vectors are a basis, more than mm are dependent.
  • • null(A)\text{null}(A): solve Rx=0Rx = 0. row(A)\text{row}(A): non-zero rows of RR. col(A)\text{col}(A): pivot columns of the ORIGINAL AA.
  • • rank(A)=dim⁡col(A)=dim⁡row(A)=rank(AT)\text{rank}(A) = \dim \text{col}(A) = \dim \text{row}(A) = \text{rank}(A^T).
  • • rank(A)+dim⁡null(A)=n\text{rank}(A) + \dim \text{null}(A) = n, the number of COLUMNS. Zero rows of RR count dim⁡null(AT)=m−r\dim \text{null}(A^T) = m - r.
  • • Subspace given by equations: dimension =n−= n - rank of the coefficient matrix, never n−n - number of equations.
  • • Completing a basis: append e1,…,ene_1, \dots, e_n AFTER the family, reduce, keep the original pivot columns.

Frequently asked questions

How do I find a basis for the column space of a matrix?

Row reduce the matrix to find which columns hold a pivot, then go back to the ORIGINAL matrix and copy those columns. They form a basis of the column space, and their number is the rank. Never copy the columns of the reduced matrix: row operations change the column space, so those vectors are usually not even in it, even though there are the right number of them.

Why is the row space basis taken from the reduced matrix but the column space basis from the original?

Row operations replace rows by combinations of rows, which never changes the row space, so the non-zero rows of the reduced form are a basis of it. The same operations mix the entries inside each column, which does change the column space. What they preserve on the column side is only the linear relations between columns, which is why the reduced form tells you which original columns to keep.

What does the rank-nullity theorem say, and is n the number of rows or columns?

For any matrix, the rank plus the dimension of the null space equals n, the number of COLUMNS, which is the number of unknowns. Each column either holds a pivot or corresponds to a free variable. So a 5 by 7 matrix of rank 3 has a null space of dimension 4. The number of rows minus the rank counts something else, the zero rows of the reduced form.

Do I need to check both independence and spanning to show vectors form a basis?

Not when you know the dimension. In a subspace of dimension m, a family of exactly m vectors of that subspace is a basis as soon as it is independent, or as soon as it spans, so one check is enough. Say the dimension and quote that rule in your answer. With a different number of vectors, the answer is no immediately: too many are dependent, too few cannot span.

Practise it

Corrected exercises: Basis, dimension and the fundamental subspaces, MATH 133 at McGill

A method is proved on a paper, not on a sheet. The set for the same chapter takes each of these traps into a problem, with the solution written out step by step.

  • 10 corrected exercises
  • 100 points
  • 150 minutes
Do the exercises
Previous sheet Subspaces, span and independence Next sheet Linear transformations

See also

Looking for a MATH 133 tutor in Montreal?

Get in touch for a first session. The basis chapter is where linear algebra stops being arithmetic on matrices and becomes a way of counting, and that shift is quicker to make with someone beside you.

Site by Studio Squalli