MATH 133 Linear Algebra and Geometry • McGill University, Montreal

Corrected exercises: basis, dimension and the fundamental subspaces (MATH 133)

This is the corrected exercise set for the basis and dimension chapter of MATH 133, Linear Algebra and Geometry, the first-year course taken at McGill University, sections 5.2 and 5.4 of Nicholson. Everything happens in Rn\mathbb{R}^n, as the course requires: bases and dimension of subspaces, extracting a basis from a spanning family and completing an independent one, the three fundamental subspaces of a matrix, the rank theorem, and coordinates relative to a basis. All the numbers reduce by hand, with no calculator.

The thread running through the whole set: row reduction gives you a COUNT and POSITIONS, never the vectors. The count is the dimension, and it survives row operations. The vectors are taken from the matrix the subspace belongs to: the pivot columns of the ORIGINAL AA for col(A)\text{col}(A), the non-zero rows of the REDUCED form for row(A)\text{row}(A), the basic solutions for null(A)\text{null}(A). And once the dimension is known, a family of the right size needs one check instead of two, while rank plus nullity answers a whole class of questions without any computation at all.

The traps named explicitly in the solutions: quoting the pivot columns of the reduced form as a basis of the column space, taking rows of AA that seem to match the non-zero rows of RR after a row swap, subtracting the rank from the number of rows instead of columns, counting equations instead of independent equations, adding to a family a vector that already lies in its span, and giving three coordinates to a vector of a plane.

10 corrected exercises • 100 points • 150 minutes

Revision sheet for this chapter → Every MATH 133 chapter →

Course recap

  • • A basis of a subspace WW is an independent family that spans WW. All bases of WW have the same size, dim⁡W\dim W; dim⁡Rn=n\dim \mathbb{R}^n = n and dim⁡{0}=0\dim\{0\} = 0.
  • • In a subspace of dimension mm: more than mm vectors are dependent, fewer than mm cannot span, and mm vectors form a basis as soon as they are independent OR span.
  • • null(A)\text{null}(A): solve Rx=0Rx = 0, one basis vector per free variable. row(A)\text{row}(A): the non-zero rows of RR. col(A)\text{col}(A): the columns of the ORIGINAL AA in pivot positions.
  • • rank(A)=dim⁡col(A)=dim⁡row(A)=rank(AT)\text{rank}(A) = \dim \text{col}(A) = \dim \text{row}(A) = \text{rank}(A^T).
  • • Rank theorem: rank(A)+dim⁡null(A)=n\text{rank}(A) + \dim \text{null}(A) = n, the number of COLUMNS of AA.
  • • A subspace of Rn\mathbb{R}^n given by homogeneous equations has dimension nn minus the rank of their coefficient matrix.
  • • If B={b1,…,bm}B = \{b_1, \dots, b_m\} is a basis of WW and v∈Wv \in W, the coordinates of vv are the unique cic_i with v=c1b1+⋯+cmbmv = c_1 b_1 + \dots + c_m b_m: mm numbers, found by solving one system.

Part A: the basics (/50)

Exercise 1: A plane through the origin: two bases, one dimension

A basis of a subspace WW is a family of vectors of WW that is independent AND spans WW. Every basis of WW has the same number of vectors, and that number is the dimension of WW. The payoff comes the moment the dimension is known: in a subspace of dimension mm, a family of exactly mm vectors needs only ONE of the two checks.

The figure shows the plane P={(x,y,z):x+2y−z=0}P = \{(x, y, z) : x + 2y - z = 0\} of R3\mathbb{R}^3, with two of its vectors drawn from the origin.

xyzOuwP: x + 2y - z = 0
  • a) Solve the equation of PP to find a basis of PP. Give dim⁡P\dim P.
  • b) Check that u=(0,1,2)u = (0, 1, 2) and w=(3,−1,1)w = (3, -1, 1) lie in PP, and explain why {u,w}\{u, w\} is a basis of PP without checking that it spans.
  • c) The vector v=(3,1,5)v = (3, 1, 5) lies in PP. Give its coordinates relative to the basis {u,w}\{u, w\}, then relative to the basis found in a).
  • d) Can {u,w,(−2,1,0)}\{u, w, (-2, 1, 0)\} be a basis of PP? Answer first without computing, then exhibit the dependency.
  • e) Add one vector to {u,w}\{u, w\} to obtain a basis of R3\mathbb{R}^3, and justify in one line.
Show the solution

Answers

  • a) Basis {(−2,1,0),(1,0,1)}\{(-2, 1, 0), (1, 0, 1)\}, dim⁡P=2\dim P = 2
  • b) 0+2−2=00 + 2 - 2 = 0 and 3−2−1=03 - 2 - 1 = 0; two independent vectors in a plane of dimension 22 form a basis
  • c) [v]=(2,1)[v] = (2, 1) in {u,w}\{u, w\}; [v]=(1,5)[v] = (1, 5) in {(−2,1,0),(1,0,1)}\{(-2,1,0), (1,0,1)\}
  • d) No: three vectors in dimension 22 are dependent; (−2,1,0)=13u−23w(-2, 1, 0) = \frac{1}{3}u - \frac{2}{3}w
  • e) Add e1=(1,0,0)e_1 = (1, 0, 0), which is not in PP since 1≠01 \neq 0

a) The coefficient matrix is the single row (1    2    −1)(1 \;\; 2 \;\; -1), already reduced, with its pivot on xx. The variables yy and zz are free: x=−2y+zx = -2y + z, so (x,y,z)=y(−2,1,0)+z(1,0,1)(x, y, z) = y(-2, 1, 0) + z(1, 0, 1). Every vector of PP is a combination of (−2,1,0)(-2, 1, 0) and (1,0,1)(1, 0, 1), and these two are independent because each has a 11 in the free position where the other has a 00 (look at the yy and zz entries). So {(−2,1,0),(1,0,1)}\{(-2, 1, 0), (1, 0, 1)\} is a basis and dim⁡P=2\dim P = 2: three unknowns, one independent equation, two free variables. This is exactly the null space of the 1×31 \times 3 matrix (1    2    −1)(1 \;\; 2 \;\; -1), and rank plus nullity says 1+2=31 + 2 = 3.

b) Membership is one substitution each: 0+2(1)−2=00 + 2(1) - 2 = 0 and 3+2(−1)−1=03 + 2(-1) - 1 = 0. The two vectors are not multiples of one another (the first entry of uu is 00, that of ww is not, while their second entries are both non-zero), so they are independent. Now the dimension does the rest: PP has dimension 22, and in a subspace of dimension mm any mm independent vectors automatically span. So {u,w}\{u, w\} is a basis of PP, with no spanning computation at all. Checking both conditions is not wrong, it is wasted time; forgetting to say WHY one check suffices (the dimension is 22) is what costs the mark.

c) Solve au+bw=vau + bw = v: (3b,  a−b,  2a+b)=(3,1,5)(3b, \; a - b, \; 2a + b) = (3, 1, 5). The first entry gives b=1b = 1, the second a=2a = 2, and the third checks: 2(2)+1=52(2) + 1 = 5. So v=2u+wv = 2u + w and [v]{u,w}=(2,1)[v]_{\{u,w\}} = (2, 1). In the basis of a), the coordinates are simply the free variables: y=1y = 1, z=5z = 5, and indeed 1⋅(−2,1,0)+5⋅(1,0,1)=(3,1,5)1 \cdot (-2, 1, 0) + 5 \cdot (1, 0, 1) = (3, 1, 5). So [v]=(1,5)[v] = (1, 5) there. Same vector, two different coordinate pairs: coordinates belong to a basis, not to a vector. And note both pairs have TWO entries, not three, because vv is being described inside a plane.

d) No, and no computation is needed to say so: PP has dimension 22, and any three vectors in a subspace of dimension 22 are dependent. To exhibit the dependency, solve au+bw=(−2,1,0)au + bw = (-2, 1, 0): 3b=−23b = -2 gives b=−23b = -\frac{2}{3}, and 2a+b=02a + b = 0 gives a=13a = \frac{1}{3}; the middle entry checks, 13+23=1\frac{1}{3} + \frac{2}{3} = 1. So (−2,1,0)=13u−23w(-2, 1, 0) = \frac{1}{3}u - \frac{2}{3}w, that is 3(−2,1,0)=u−2w3(-2, 1, 0) = u - 2w.

e) Any vector outside PP will do. Take e1=(1,0,0)e_1 = (1, 0, 0): 1+0−0=1≠01 + 0 - 0 = 1 \neq 0, so e1∉Pe_1 \notin P. Then {u,w,e1}\{u, w, e_1\} is independent (a vector outside the span of an independent pair cannot be a combination of it), and three independent vectors in R3\mathbb{R}^3, of dimension 33, form a basis. The one-line justification the marker wants is precisely that last clause: three independent vectors in a space of dimension three.

Exercise 2: Extracting a basis from a spanning family, and the vectors you may not keep

A subspace is often handed to you as a span: W=span{v1,…,vk}W = \text{span}\{v_1, \dots, v_k\}, with no promise that the viv_i are independent. The standard extraction puts them as the COLUMNS of a matrix, row reduces, and keeps the ORIGINAL vectors sitting in the pivot columns. The reduced matrix decides which positions to keep; it never supplies the vectors.

Here W=span{v1,v2,v3,v4,v5}W = \text{span}\{v_1, v_2, v_3, v_4, v_5\} in R4\mathbb{R}^4 with v1=(1,2,−1,0)v_1 = (1, 2, -1, 0), v2=(0,1,1,1)v_2 = (0, 1, 1, 1), v3=(2,3,−3,−1)v_3 = (2, 3, -3, -1), v4=(1,3,0,1)v_4 = (1, 3, 0, 1) and v5=(1,0,0,2)v_5 = (1, 0, 0, 2).

  • a) Row reduce the 4×54 \times 5 matrix whose columns are v1,…,v5v_1, \dots, v_5, naming each operation.
  • b) Give a basis of WW taken from the viv_i, and dim⁡W\dim W.
  • c) Express v3v_3 and v4v_4 in terms of your basis, reading the coefficients off the reduced form.
  • d) A student answers b) with the three pivot columns of the REDUCED matrix, e1,e2,e3e_1, e_2, e_3. Given that WW is the hyperplane −6y1+y2−4y3+3y4=0-6y_1 + y_2 - 4y_3 + 3y_4 = 0, show that not one of those three vectors lies in WW.
  • e) List the same five vectors in the reverse order v5,v4,v3,v2,v1v_5, v_4, v_3, v_2, v_1. Which basis does the same method now extract, and what has not changed?
Show the solution

Answers

  • a) R=(1021001−1100000100000)R = \begin{pmatrix} 1 & 0 & 2 & 1 & 0 \\ 0 & 1 & -1 & 1 & 0 \\ 0 & 0 & 0 & 0 & 1 \\ 0 & 0 & 0 & 0 & 0 \end{pmatrix}, pivots in columns 1,2,51, 2, 5
  • b) {v1,v2,v5}\{v_1, v_2, v_5\}, dim⁡W=3\dim W = 3
  • c) v3=2v1−v2v_3 = 2v_1 - v_2, v4=v1+v2v_4 = v_1 + v_2
  • d) e1,e2,e3e_1, e_2, e_3 give −6-6, 11, −4-4, never 00: none is in WW
  • e) {v5,v4,v3}\{v_5, v_4, v_3\}: another basis, still 33 vectors

a) The matrix has rows (1,0,2,1,1)(1, 0, 2, 1, 1), (2,1,3,3,0)(2, 1, 3, 3, 0), (−1,1,−3,0,0)(-1, 1, -3, 0, 0), (0,1,−1,1,2)(0, 1, -1, 1, 2). First column: R2→R2−2R1R_2 \to R_2 - 2R_1 gives (0,1,−1,1,−2)(0, 1, -1, 1, -2) and R3→R3+R1R_3 \to R_3 + R_1 gives (0,1,−1,1,1)(0, 1, -1, 1, 1). Second column: R3→R3−R2R_3 \to R_3 - R_2 gives (0,0,0,0,3)(0, 0, 0, 0, 3) and R4→R4−R2R_4 \to R_4 - R_2 gives (0,0,0,0,4)(0, 0, 0, 0, 4). Then R3→13R3R_3 \to \frac{1}{3}R_3 gives (0,0,0,0,1)(0, 0, 0, 0, 1) and R4→R4−4R3R_4 \to R_4 - 4R_3 kills the last row. Clearing above the third pivot: R2→R2+2R3R_2 \to R_2 + 2R_3 gives (0,1,−1,1,0)(0, 1, -1, 1, 0) and R1→R1−R3R_1 \to R_1 - R_3 gives (1,0,2,1,0)(1, 0, 2, 1, 0). The reduced form is (1021001−1100000100000)\begin{pmatrix} 1 & 0 & 2 & 1 & 0 \\ 0 & 1 & -1 & 1 & 0 \\ 0 & 0 & 0 & 0 & 1 \\ 0 & 0 & 0 & 0 & 0 \end{pmatrix}, with pivots in columns 11, 22 and 55.

b) Keep the ORIGINAL vectors in the pivot columns: {v1,v2,v5}\{v_1, v_2, v_5\} is a basis of WW, and dim⁡W=3\dim W = 3. Why this works: row operations do not change the linear relations between the columns. A relation ∑civi=0\sum c_i v_i = 0 holds for the columns of the original matrix exactly when it holds for the columns of RR, because both say that (c1,…,c5)(c_1, \dots, c_5) solves the same homogeneous system. On RR, the pivot columns are visibly independent and every other column is visibly a combination of them, so the same is true of v1,v2,v5v_1, v_2, v_5.

c) Column 33 of RR is (2,−1,0,0)(2, -1, 0, 0), which is 2×2 \times(column 11) −1×- 1 \times(column 22). The same relation holds among the original columns: v3=2v1−v2v_3 = 2v_1 - v_2. Check: 2(1,2,−1,0)−(0,1,1,1)=(2,3,−3,−1)2(1, 2, -1, 0) - (0, 1, 1, 1) = (2, 3, -3, -1). Column 44 of RR is (1,1,0,0)(1, 1, 0, 0), so v4=v1+v2=(1,3,0,1)v_4 = v_1 + v_2 = (1, 3, 0, 1). The non-pivot columns of RR are not decorations: they are the recipe expressing each discarded vector in the kept ones.

d) Substitute each into −6y1+y2−4y3+3y4-6y_1 + y_2 - 4y_3 + 3y_4: e1=(1,0,0,0)e_1 = (1, 0, 0, 0) gives −6-6, e2=(0,1,0,0)e_2 = (0, 1, 0, 0) gives 11, e3=(0,0,1,0)e_3 = (0, 0, 1, 0) gives −4-4. None gives 00, so NOT ONE of the student's three vectors belongs to WW. The equation is right, too: v1v_1 gives −6+2+4+0=0-6 + 2 + 4 + 0 = 0, v2v_2 gives 0+1−4+3=00 + 1 - 4 + 3 = 0 and v5v_5 gives −6+0+0+6=0-6 + 0 + 0 + 6 = 0. The student has the right NUMBER, three, because row operations preserve the dimension, and the wrong vectors, because they do not preserve the column space. That answer scores zero on the basis and full marks on the dimension.

e) In the order v5,v4,v3,v2,v1v_5, v_4, v_3, v_2, v_1, the method keeps v5v_5; then v4v_4, which is not a multiple of v5v_5; then asks whether v3=(2,3,−3,−1)v_3 = (2, 3, -3, -1) is a combination av5+bv4=(a+b,3b,0,2a+b)a v_5 + b v_4 = (a + b, 3b, 0, 2a + b). The third entry of any such combination is 00 and that of v3v_3 is −3-3, so v3v_3 is new and is kept. Three pivots are already reached, and dim⁡W=3\dim W = 3, so v2v_2 and v1v_1 are discarded. The extracted basis is {v5,v4,v3}\{v_5, v_4, v_3\}: a different basis, the same size. Which vectors survive depends on the order; how many survive does not, and that invariant is the dimension.

Exercise 3: Null space, column space, row space: one matrix, three sources

This is the question of the chapter, and it appears on every MATH 133 final in some form. One row reduction answers all three parts, but each subspace takes its basis from a DIFFERENT place: null(A)\text{null}(A) from the solutions of Ax=0Ax = 0, row(A)\text{row}(A) from the non-zero rows of the reduced form RR, and col(A)\text{col}(A) from the columns of the ORIGINAL AA that sit in pivot positions.

Let A=(1210124100−1−201200113)A = \begin{pmatrix} 1 & 2 & 1 & 0 & 1 \\ 2 & 4 & 1 & 0 & 0 \\ -1 & -2 & 0 & 1 & 2 \\ 0 & 0 & 1 & 1 & 3 \end{pmatrix}.

  • a) Reduce AA to its reduced row echelon form RR, naming each operation.
  • b) Give a basis of null(A)\text{null}(A) and its dimension.
  • c) Give a basis of col(A)\text{col}(A) and its dimension, saying which matrix the vectors come from.
  • d) Give a basis of row(A)\text{row}(A) and its dimension, and check rank plus nullity.
  • e) Show that the first pivot column of RR, the vector e1=(1,0,0,0)e_1 = (1, 0, 0, 0), does not lie in col(A)\text{col}(A).
Show the solution

Answers

  • a) R=(1200−1001020001100000)R = \begin{pmatrix} 1 & 2 & 0 & 0 & -1 \\ 0 & 0 & 1 & 0 & 2 \\ 0 & 0 & 0 & 1 & 1 \\ 0 & 0 & 0 & 0 & 0 \end{pmatrix}, pivots in columns 1,3,41, 3, 4
  • b) {(−2,1,0,0,0),(1,0,−2,−1,1)}\{(-2, 1, 0, 0, 0), (1, 0, -2, -1, 1)\}, nullity 22
  • c) Columns 1,3,41, 3, 4 of AA: {(1,2,−1,0),(1,1,0,1),(0,0,1,1)}\{(1, 2, -1, 0), (1, 1, 0, 1), (0, 0, 1, 1)\}, dimension 33
  • d) {(1,2,0,0,−1),(0,0,1,0,2),(0,0,0,1,1)}\{(1, 2, 0, 0, -1), (0, 0, 1, 0, 2), (0, 0, 0, 1, 1)\}, dimension 33; 3+2=53 + 2 = 5
  • e) Writing e1e_1 as a combination of columns 1,3,41, 3, 4 of AA leads to 1=01 = 0: e1∉col(A)e_1 \notin \text{col}(A)

a) First column: R2→R2−2R1R_2 \to R_2 - 2R_1 gives (0,0,−1,0,−2)(0, 0, -1, 0, -2) and R3→R3+R1R_3 \to R_3 + R_1 gives (0,0,1,1,3)(0, 0, 1, 1, 3); R4=(0,0,1,1,3)R_4 = (0, 0, 1, 1, 3) already starts with zeros. Column 22 has nothing below row 11, so the next pivot is in column 33: R2→−R2R_2 \to -R_2 gives (0,0,1,0,2)(0, 0, 1, 0, 2), then R3→R3−R2R_3 \to R_3 - R_2 and R4→R4−R2R_4 \to R_4 - R_2 both give (0,0,0,1,1)(0, 0, 0, 1, 1). Then R4→R4−R3R_4 \to R_4 - R_3 gives a zero row. Finally R1→R1−R2R_1 \to R_1 - R_2 clears above the second pivot: (1,2,0,0,−1)(1, 2, 0, 0, -1). So R=(1200−1001020001100000)R = \begin{pmatrix} 1 & 2 & 0 & 0 & -1 \\ 0 & 0 & 1 & 0 & 2 \\ 0 & 0 & 0 & 1 & 1 \\ 0 & 0 & 0 & 0 & 0 \end{pmatrix}, with pivots in columns 11, 33 and 44: rank 33.

b) Solve Rx=0Rx = 0. The free variables are x2=sx_2 = s and x5=tx_5 = t; the rows read x1=−2s+tx_1 = -2s + t, x3=−2tx_3 = -2t, x4=−tx_4 = -t. So x=s(−2,1,0,0,0)+t(1,0,−2,−1,1)x = s(-2, 1, 0, 0, 0) + t(1, 0, -2, -1, 1), and {(−2,1,0,0,0),(1,0,−2,−1,1)}\{(-2, 1, 0, 0, 0), (1, 0, -2, -1, 1)\} is a basis of null(A)\text{null}(A), one vector per free variable, independent because each carries a 11 in its own free slot and a 00 in the other. Nullity 22. Check the second on the ORIGINAL AA, row by row: 1+0−2+0+1=01 + 0 - 2 + 0 + 1 = 0, 2+0−2+0+0=02 + 0 - 2 + 0 + 0 = 0, −1+0+0−1+2=0-1 + 0 + 0 - 1 + 2 = 0, 0+0−2−1+3=00 + 0 - 2 - 1 + 3 = 0. Here using RR is legitimate: Ax=0Ax = 0 and Rx=0Rx = 0 have the same solutions.

c) The pivots sit in columns 11, 33 and 44, so the basis of col(A)\text{col}(A) is made of columns 11, 33 and 44 OF AA: {(1,2,−1,0),(1,1,0,1),(0,0,1,1)}\{(1, 2, -1, 0), (1, 1, 0, 1), (0, 0, 1, 1)\}, and dim⁡col(A)=3\dim \text{col}(A) = 3. The reduced form told us which positions to keep and how many; the vectors must be vectors of col(A)\text{col}(A), and only the columns of AA are guaranteed to be. The discarded columns are combinations of the kept ones with the coefficients read on RR: column 22 of AA is 2×2 \times column 11, and column 55 is −-column 1+2×1 + 2 \timescolumn 3+3 + column 44, that is (−1+2+0,−2+2+0,1+0+1,0+2+1)=(1,0,2,3)(-1 + 2 + 0, -2 + 2 + 0, 1 + 0 + 1, 0 + 2 + 1) = (1, 0, 2, 3), which is indeed column 55.

d) Row operations replace rows by combinations of rows and are reversible, so they do not change the row space. The non-zero rows of RR are independent (each has a leading 11 where the others have 00), so they form a basis: {(1,2,0,0,−1),(0,0,1,0,2),(0,0,0,1,1)}\{(1, 2, 0, 0, -1), (0, 0, 1, 0, 2), (0, 0, 0, 1, 1)\}, dimension 33. The same number 33 as for col(A)\text{col}(A), although the two subspaces do not even live in the same space: col(A)⊆R4\text{col}(A) \subseteq \mathbb{R}^4, row(A)⊆R5\text{row}(A) \subseteq \mathbb{R}^5. Rank plus nullity: 3+2=53 + 2 = 5, the number of COLUMNS of AA, as it must be.

e) Try to write e1=a(1,2,−1,0)+b(1,1,0,1)+c(0,0,1,1)e_1 = a(1, 2, -1, 0) + b(1, 1, 0, 1) + c(0, 0, 1, 1). Entry by entry: a+b=1a + b = 1, 2a+b=02a + b = 0, −a+c=0-a + c = 0, b+c=0b + c = 0. Subtracting the first from the second gives a=−1a = -1, so b=2b = 2, then c=a=−1c = a = -1, and the last equation demands 2−1=02 - 1 = 0: impossible. So e1∉col(A)e_1 \notin \text{col}(A). Every column of AA satisfies y4=y1+y3y_4 = y_1 + y_3 (check: 0=1−10 = 1 - 1, 0=2−20 = 2 - 2, 1=1+01 = 1 + 0, 1=0+11 = 0 + 1, 3=1+23 = 1 + 2), and e1e_1 does not. Quoting the pivot columns of RR as a basis of col(A)\text{col}(A) would therefore give a family that is not even inside the subspace: zero on part c), however clean the reduction.

Exercise 4: The same reading with the reduced form given, and the row that moved

On a final, the reduced form is sometimes GIVEN, so that the question tests only the reading. The figure shows AA and its reduced form RR, with the two pivot positions boxed. The reduction swapped two rows on the way, which is exactly the situation where a second trap appears, on the row side this time.

A=(12−1324−261201)A = \begin{pmatrix} 1 & 2 & -1 & 3 \\ 2 & 4 & -2 & 6 \\ 1 & 2 & 0 & 1 \end{pmatrix} and R=(1201001−20000)R = \begin{pmatrix} 1 & 2 & 0 & 1 \\ 0 & 0 & 1 & -2 \\ 0 & 0 & 0 & 0 \end{pmatrix}.

12-1324-2612011201001-20000A =R =c1c2c3c4rrefboxed: the two pivot positions
  • a) Give a basis of null(A)\text{null}(A).
  • b) Give a basis of col(A)\text{col}(A), naming the matrix and the columns used.
  • c) A student writes: “the zero row of RR is row 33, so rows 11 and 22 of AA form a basis of row(A)\text{row}(A)”. Correct the student, then give two bases of row(A)\text{row}(A): one from RR, one made of rows of AA.
  • d) Without reducing ATA^T, give rank(AT)\text{rank}(A^T) and a basis of col(AT)\text{col}(A^T).
  • e) Give dim⁡null(AT)\dim \text{null}(A^T), and a non-zero vector of null(AT)\text{null}(A^T) read from a relation between the rows of AA.
Show the solution

Answers

  • a) {(−2,1,0,0),(−1,0,2,1)}\{(-2, 1, 0, 0), (-1, 0, 2, 1)\}
  • b) Columns 11 and 33 of AA: {(1,2,1),(−1,−2,0)}\{(1, 2, 1), (-1, -2, 0)\}
  • c) Rows 1,21, 2 of AA are proportional. Bases: {(1,2,0,1),(0,0,1,−2)}\{(1, 2, 0, 1), (0, 0, 1, -2)\}, or rows 11 and 33 of AA
  • d) rank(AT)=2\text{rank}(A^T) = 2; basis {(1,2,0,1),(0,0,1,−2)}\{(1, 2, 0, 1), (0, 0, 1, -2)\} written as columns
  • e) dim⁡=3−2=1\dim = 3 - 2 = 1; y=(−2,1,0)y = (-2, 1, 0) since −2⋅row1+row2=0-2 \cdot \text{row}_1 + \text{row}_2 = 0

a) Read Rx=0Rx = 0: the pivots are in columns 11 and 33, so x2=sx_2 = s and x4=tx_4 = t are free. The rows give x1=−2s−tx_1 = -2s - t and x3=2tx_3 = 2t. Hence x=s(−2,1,0,0)+t(−1,0,2,1)x = s(-2, 1, 0, 0) + t(-1, 0, 2, 1) and {(−2,1,0,0),(−1,0,2,1)}\{(-2, 1, 0, 0), (-1, 0, 2, 1)\} is a basis of null(A)\text{null}(A), nullity 22. Check the second vector on AA: −1+0−2+3=0-1 + 0 - 2 + 3 = 0, −2+0−4+6=0-2 + 0 - 4 + 6 = 0, −1+0+0+1=0-1 + 0 + 0 + 1 = 0.

b) Columns 11 and 33 of AA, namely (1,2,1)(1, 2, 1) and (−1,−2,0)(-1, -2, 0), dimension 22. Not columns 11 and 33 of RR: those are (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0), and every column of AA has its second entry equal to twice its first (2=2⋅12 = 2 \cdot 1, 4=2⋅24 = 2 \cdot 2, −2=2⋅(−1)-2 = 2 \cdot (-1), 6=2⋅36 = 2 \cdot 3), because row 22 of AA is twice row 11. So col(A)\text{col}(A) lies in the plane y2=2y1y_2 = 2y_1, and (0,1,0)(0, 1, 0) violates it. Same trap as always, and the figure is there to make it visible: the boxes mark positions in RR, the vectors are taken from AA.

c) The student assumes that row ii of RR comes from row ii of AA. It does not: the reduction did R2→R2−2R1R_2 \to R_2 - 2R_1, which made row 22 zero at once, then R3→R3−R1R_3 \to R_3 - R_1 and a SWAP of rows 22 and 33, so the zero row of RR is the old row 22. And rows 11 and 22 of AA, (1,2,−1,3)(1, 2, -1, 3) and (2,4,−2,6)(2, 4, -2, 6), are proportional: they span a line, not a space of dimension 22. The safe basis is the non-zero rows of RR: {(1,2,0,1),(0,0,1,−2)}\{(1, 2, 0, 1), (0, 0, 1, -2)\}. A basis made of rows of AA also exists: row(A)\text{row}(A) has dimension 22, and rows 11 and 33, (1,2,−1,3)(1, 2, -1, 3) and (1,2,0,1)(1, 2, 0, 1), are two independent vectors of it (third entries −1-1 and 00 with equal first entries), so they form a basis by the dimension argument.

d) rank(AT)=rank(A)=2\text{rank}(A^T) = \text{rank}(A) = 2, because the columns of ATA^T are the rows of AA: dim⁡col(AT)=dim⁡row(A)=dim⁡col(A)\dim \text{col}(A^T) = \dim \text{row}(A) = \dim \text{col}(A). And col(AT)\text{col}(A^T) is literally row(A)\text{row}(A) with the vectors written vertically, so a basis is (1,2,0,1)(1, 2, 0, 1) and (0,0,1,−2)(0, 0, 1, -2) as column vectors of R4\mathbb{R}^4. No reduction of the 4×34 \times 3 matrix ATA^T is needed, and doing one would cost time without adding a single fact.

e) ATA^T is 4×34 \times 3, so rank plus nullity counts its 33 columns: dim⁡null(AT)=3−2=1\dim \text{null}(A^T) = 3 - 2 = 1. A vector y=(y1,y2,y3)y = (y_1, y_2, y_3) with ATy=0A^T y = 0 is exactly a relation y1row1+y2row2+y3row3=0y_1 \text{row}_1 + y_2 \text{row}_2 + y_3 \text{row}_3 = 0 among the rows of AA. The relation is in plain sight: row2=2 row1\text{row}_2 = 2\,\text{row}_1, so y=(−2,1,0)y = (-2, 1, 0). Since the dimension is 11, this single vector is even a basis. It is also the coefficient vector of the equation −2y1+y2=0-2y_1 + y_2 = 0 that carves col(A)\text{col}(A) out of R3\mathbb{R}^3, the same fact seen from the other side.

Exercise 5: Rank plus nullity: concluding without computing

For an m×nm \times n matrix AA of rank rr: dim⁡col(A)=dim⁡row(A)=r\dim \text{col}(A) = \dim \text{row}(A) = r, and r+dim⁡null(A)=nr + \dim \text{null}(A) = n, the number of COLUMNS. Two facts come free: r≤mr \le m and r≤nr \le n. With these, a whole family of questions is answered from the SIZE and the RANK alone, without a matrix in sight.

The figure splits the nn columns and the mm rows once and for all. No entry of any matrix is needed below.

n columns of A: the unknowns, vectors of R^nr pivot columnsn - r free columnsrank r = dim col(A) = dim row(A)nullity n - r = dim null(A)r non-zero rows of Rm - rm rows of A: the equations, vectors of R^m
  • a) AA is 6×86 \times 8 with rank 55. Give dim⁡null(A)\dim \text{null}(A), dim⁡col(A)\dim \text{col}(A), dim⁡row(A)\dim \text{row}(A) and dim⁡null(AT)\dim \text{null}(A^T).
  • b) AA is 7×47 \times 4 and Ax=0Ax = 0 has only the trivial solution. Give the rank, identify row(A)\text{row}(A), and say whether col(A)=R7\text{col}(A) = \mathbb{R}^7.
  • c) Can a 4×64 \times 6 matrix have a null space that is a line? Justify.
  • d) AA is 5×55 \times 5 and null(A)\text{null}(A) is a line. Give the rank, say whether AA is invertible, and describe col(A)\text{col}(A).
  • e) AA is 3×53 \times 5 and col(A)=R3\text{col}(A) = \mathbb{R}^3. Give the nullity, and say whether Ax=bAx = b is consistent for every bb and how many free parameters its solutions carry.
Show the solution

Answers

  • a) 33, 55, 55, 11
  • b) Rank 44; row(A)=R4\text{row}(A) = \mathbb{R}^4; col(A)\text{col}(A) has dimension 4<74 < 7, so it is not R7\mathbb{R}^7
  • c) No: rank ≤4\le 4 forces nullity ≥2\ge 2
  • d) Rank 44; not invertible; col(A)\text{col}(A) is a subspace of dimension 44 of R5\mathbb{R}^5
  • e) Nullity 22; consistent for every bb; 22 free parameters

a) Nullity =n−r=8−5=3= n - r = 8 - 5 = 3. The column space and the row space both have dimension equal to the rank, 55, although col(A)⊆R6\text{col}(A) \subseteq \mathbb{R}^6 and row(A)⊆R8\text{row}(A) \subseteq \mathbb{R}^8. For ATA^T, which is 8×68 \times 6 with the same rank 55, the null space has dimension 6−5=16 - 5 = 1: rank plus nullity for ATA^T counts the columns of ATA^T, which are the 66 rows of AA. Four numbers from two, and the only trap is subtracting from the wrong size: 6−5=16 - 5 = 1 is dim⁡null(AT)\dim \text{null}(A^T), never dim⁡null(A)\dim \text{null}(A).

b) Only the trivial solution means nullity 00, so the rank is 4−0=44 - 0 = 4. Then row(A)\text{row}(A) is a subspace of R4\mathbb{R}^4 of dimension 44, and a subspace of Rn\mathbb{R}^n of dimension nn is Rn\mathbb{R}^n itself (a basis of it is nn independent vectors of Rn\mathbb{R}^n, hence a basis of Rn\mathbb{R}^n). So row(A)=R4\text{row}(A) = \mathbb{R}^4. On the other side, col(A)\text{col}(A) has dimension 44 inside R7\mathbb{R}^7, so it is NOT R7\mathbb{R}^7, and Ax=bAx = b is inconsistent for some bb. Seven equations, four unknowns: one-to-one, never onto.

c) No. The rank is at most the number of rows, 44, so the nullity is at least 6−4=26 - 4 = 2. A line would be nullity 11, which would need rank 55, impossible with 44 rows. Every 4×64 \times 6 matrix therefore has at least a plane of solutions to Ax=0Ax = 0. The argument uses BOTH bounds on the rank: r≤mr \le m is what forbids the line, r+nullity=nr + \text{nullity} = n is what turns it into a statement about the null space.

d) A line is nullity 11, so the rank is 5−1=45 - 1 = 4. A square matrix with a non-trivial null space is not invertible (the invertible matrix theorem needs rank 55). col(A)\text{col}(A) is a subspace of dimension 44 of R5\mathbb{R}^5, a hyperplane through the origin, the solution set of a single non-trivial linear equation. So Ax=bAx = b is consistent only for the bb in that hyperplane, and then it has a whole line of solutions.

e) col(A)=R3\text{col}(A) = \mathbb{R}^3 means rank 33, the most a 3×53 \times 5 matrix can have. The nullity is 5−3=25 - 3 = 2. Every b∈R3b \in \mathbb{R}^3 lies in col(A)\text{col}(A), so Ax=bAx = b is consistent for every bb. Its solutions are one particular solution plus the null space, so they carry 22 free parameters: a plane of solutions in R5\mathbb{R}^5 for each bb. Onto, never one-to-one: the exact mirror of b).

Part B: problems and reasoning (/50)

Exercise 6: Completing an independent family into a basis of R^4

Every independent family of Rn\mathbb{R}^n can be completed into a basis, and there is a method that never guesses: place the family FIRST, then the standard basis e1,…,ene_1, \dots, e_n, as the columns of one matrix, reduce, and keep the ORIGINAL columns in pivot positions. The standard basis guarantees that the columns span Rn\mathbb{R}^n; the reduction discards what is redundant.

Here u1=(1,1,0,2)u_1 = (1, 1, 0, 2) and u2=(0,1,1,1)u_2 = (0, 1, 1, 1) in R4\mathbb{R}^4.

  • a) Show in one line that {u1,u2}\{u_1, u_2\} is independent.
  • b) Complete {u1,u2}\{u_1, u_2\} into a basis of R4\mathbb{R}^4 by reducing the 4×64 \times 6 matrix (u1  u2  e1  e2  e3  e4)(u_1 \; u_2 \; e_1 \; e_2 \; e_3 \; e_4), naming each operation.
  • c) Another student completes with w=(1,0,−1,1)w = (1, 0, -1, 1) and e4e_4. Is {u1,u2,w,e4}\{u_1, u_2, w, e_4\} a basis of R4\mathbb{R}^4?
  • d) Explain why the method can never discard u1u_1 or u2u_2, and show that {u1,u2,e3,e4}\{u_1, u_2, e_3, e_4\} is also a basis. What does that say about the answer to b)?
  • e) An independent family has kk vectors in Rn\mathbb{R}^n. How many vectors does a completion add? Can a family of 55 vectors of R4\mathbb{R}^4 be completed into a basis?
Show the solution

Answers

  • a) Neither is a multiple of the other: first entries 11 and 00, second entries 11 and 11
  • b) Pivots in columns 1,2,3,41, 2, 3, 4: basis {u1,u2,e1,e2}\{u_1, u_2, e_1, e_2\}
  • c) No: w=u1−u2w = u_1 - u_2, so the family is dependent
  • d) u1,u2u_1, u_2 come first and are independent, so their columns are pivot columns; det⁡(u1 u2 e3 e4)=1≠0\det(u_1\,u_2\,e_3\,e_4) = 1 \neq 0; the completion is not unique
  • e) n−kn - k vectors; no, 55 vectors of R4\mathbb{R}^4 are dependent

a) If au1+bu2=0au_1 + bu_2 = 0, the first entry gives a=0a = 0 (since u2u_2 starts with 00), and then the second entry gives b=0b = 0. Two vectors are independent exactly when neither is a multiple of the other, and u2u_2 cannot be a multiple of u1u_1 because its first entry is 00 while its second is not.

b) The rows of the matrix are (1,0,1,0,0,0)(1, 0, 1, 0, 0, 0), (1,1,0,1,0,0)(1, 1, 0, 1, 0, 0), (0,1,0,0,1,0)(0, 1, 0, 0, 1, 0), (2,1,0,0,0,1)(2, 1, 0, 0, 0, 1). Operations: R2→R2−R1R_2 \to R_2 - R_1 gives (0,1,−1,1,0,0)(0, 1, -1, 1, 0, 0); R4→R4−2R1R_4 \to R_4 - 2R_1 gives (0,1,−2,0,0,1)(0, 1, -2, 0, 0, 1); R3→R3−R2R_3 \to R_3 - R_2 gives (0,0,1,−1,1,0)(0, 0, 1, -1, 1, 0); R4→R4−R2R_4 \to R_4 - R_2 gives (0,0,−1,−1,0,1)(0, 0, -1, -1, 0, 1); R4→R4+R3R_4 \to R_4 + R_3 gives (0,0,0,−2,1,1)(0, 0, 0, -2, 1, 1). The echelon form already shows the pivots, in columns 11, 22, 33 and 44: finishing to the reduced form would not move them. So keep the ORIGINAL columns 11 to 44: {u1,u2,e1,e2}\{u_1, u_2, e_1, e_2\} is a basis of R4\mathbb{R}^4. Four independent vectors in a space of dimension 44, nothing more to check.

c) No. The vector ww looks new, but u1−u2=(1−0,1−1,0−1,2−1)=(1,0,−1,1)=wu_1 - u_2 = (1 - 0, 1 - 1, 0 - 1, 2 - 1) = (1, 0, -1, 1) = w. So ww lies in span{u1,u2}\text{span}\{u_1, u_2\} and the family {u1,u2,w,e4}\{u_1, u_2, w, e_4\} is dependent: it spans at most a space of dimension 33. A vector added during a completion must lie OUTSIDE the span of what is already there, and a quick look at the entries is not a test of that. The method of b) is safe precisely because the reduction does the test.

d) Columns 11 and 22 come first. The first column is non-zero, so it holds a pivot; the second is not a multiple of the first, so after elimination it still has a non-zero entry below row 11 and holds the second pivot. More generally, a column is a non-pivot column exactly when it is a combination of the columns BEFORE it, and an independent family placed first never is. For the other completion, the matrix (u1  u2  e3  e4)(u_1 \; u_2 \; e_3 \; e_4) has rows (1,0,0,0)(1, 0, 0, 0), (1,1,0,0)(1, 1, 0, 0), (0,1,1,0)(0, 1, 1, 0), (2,1,0,1)(2, 1, 0, 1): it is lower triangular with 11 on the diagonal, so its determinant is 1≠01 \neq 0 and its columns form a basis. The completion is therefore NOT unique; the method returns one completion, dictated by the order e1,e2,e3,e4e_1, e_2, e_3, e_4, and any other one found correctly scores the same.

e) A basis of Rn\mathbb{R}^n has exactly nn vectors, so a completion adds n−kn - k of them, here 4−2=24 - 2 = 2. A family of 55 vectors of R4\mathbb{R}^4 can never be completed: it is already dependent, since more than nn vectors of Rn\mathbb{R}^n always are. The right move there is the opposite one, EXTRACTION, which keeps at most 44 of them. Completion grows an independent family up to the dimension; extraction cuts a spanning family down to it; both stop at the same number.

Exercise 7: Subspaces cut out by equations: count the independent ones

A subspace of Rn\mathbb{R}^n given by homogeneous linear equations is the null space of their coefficient matrix. Its dimension is therefore nn minus the rank of that matrix: nn minus the number of INDEPENDENT equations, never simply minus the number of equations written.

In R4\mathbb{R}^4, let HH be the hyperplane x1−x2+2x3−x4=0x_1 - x_2 + 2x_3 - x_4 = 0.

  • a) Give a basis of HH and dim⁡H\dim H.
  • b) Let VV be the set of vectors of HH that also satisfy x1+x2−x4=0x_1 + x_2 - x_4 = 0. Give a basis of VV and dim⁡V\dim V.
  • c) A third equation, 2x1+2x3−2x4=02x_1 + 2x_3 - 2x_4 = 0, is added to the two defining VV. A student concludes that the new subspace has dimension 11. Correct the conclusion.
  • d) Show that {(1,1,1,2),(0,1,1,1)}\{(1, 1, 1, 2), (0, 1, 1, 1)\} is a basis of VV, and give the coordinates of (−1,1,1,0)(-1, 1, 1, 0) in that basis.
  • e) The vectors (1,1,0,0)(1, 1, 0, 0), (0,2,1,0)(0, 2, 1, 0), (1,1,1,2)(1, 1, 1, 2) and (3,1,−1,0)(3, 1, -1, 0) all lie in HH. Can they be independent?
Show the solution

Answers

  • a) {(1,1,0,0),(−2,0,1,0),(1,0,0,1)}\{(1, 1, 0, 0), (-2, 0, 1, 0), (1, 0, 0, 1)\}, dim⁡H=3\dim H = 3
  • b) {(−1,1,1,0),(1,0,0,1)}\{(-1, 1, 1, 0), (1, 0, 0, 1)\}, dim⁡V=2\dim V = 2
  • c) The third equation is the sum of the first two: rank 22, dimension still 4−2=24 - 2 = 2
  • d) Both satisfy the two equations and are not proportional; coordinates (−1,2)(-1, 2)
  • e) No: four vectors in a subspace of dimension 33 are dependent

a) The coefficient matrix (1  −1  2  −1)(1 \; -1 \; 2 \; -1) has rank 11 with its pivot on x1x_1, so x2=rx_2 = r, x3=sx_3 = s, x4=tx_4 = t are free and x1=r−2s+tx_1 = r - 2s + t. Hence x=r(1,1,0,0)+s(−2,0,1,0)+t(1,0,0,1)x = r(1, 1, 0, 0) + s(-2, 0, 1, 0) + t(1, 0, 0, 1), and these three vectors form a basis of HH (each has a 11 in its own free slot and 00 in the other two). dim⁡H=4−1=3\dim H = 4 - 1 = 3. A hyperplane of Rn\mathbb{R}^n, one non-trivial equation, always has dimension n−1n - 1.

b) The matrix is (1−12−1110−1)\begin{pmatrix} 1 & -1 & 2 & -1 \\ 1 & 1 & 0 & -1 \end{pmatrix}. R2→R2−R1R_2 \to R_2 - R_1 gives (0,2,−2,0)(0, 2, -2, 0), R2→12R2R_2 \to \frac{1}{2}R_2 gives (0,1,−1,0)(0, 1, -1, 0), and R1→R1+R2R_1 \to R_1 + R_2 gives (1,0,1,−1)(1, 0, 1, -1). Pivots on x1x_1 and x2x_2, free x3=sx_3 = s and x4=tx_4 = t: x1=−s+tx_1 = -s + t, x2=sx_2 = s. So x=s(−1,1,1,0)+t(1,0,0,1)x = s(-1, 1, 1, 0) + t(1, 0, 0, 1) and {(−1,1,1,0),(1,0,0,1)}\{(-1, 1, 1, 0), (1, 0, 0, 1)\} is a basis of VV, dim⁡V=4−2=2\dim V = 4 - 2 = 2. Check the first vector in both equations: −1−1+2−0=0-1 - 1 + 2 - 0 = 0 and −1+1−0=0-1 + 1 - 0 = 0.

c) The new equation is the SUM of the two others: (1,−1,2,−1)+(1,1,0,−1)=(2,0,2,−2)(1, -1, 2, -1) + (1, 1, 0, -1) = (2, 0, 2, -2). Any vector satisfying the first two satisfies it automatically, so the subspace is still VV. In matrix terms, the 3×43 \times 4 coefficient matrix has rank 22, not 33: its third row reduces to zero. The dimension is 4−rank=4−2=24 - \text{rank} = 4 - 2 = 2. Counting three equations and answering 4−3=14 - 3 = 1 is the error of counting what is written instead of what is independent, the same error as counting rows instead of pivots.

d) Membership: (1,1,1,2)(1, 1, 1, 2) gives 1−1+2−2=01 - 1 + 2 - 2 = 0 and 1+1−2=01 + 1 - 2 = 0; (0,1,1,1)(0, 1, 1, 1) gives 0−1+2−1=00 - 1 + 2 - 1 = 0 and 0+1−1=00 + 1 - 1 = 0. They are not proportional (first entries 11 and 00, second entries both 11), hence independent, and since dim⁡V=2\dim V = 2, two independent vectors of VV form a basis: no spanning check needed. Coordinates: a(1,1,1,2)+b(0,1,1,1)=(a,  a+b,  a+b,  2a+b)a(1, 1, 1, 2) + b(0, 1, 1, 1) = (a, \; a + b, \; a + b, \; 2a + b). Setting this equal to (−1,1,1,0)(-1, 1, 1, 0) gives a=−1a = -1, then b=2b = 2, and the last entry checks: −2+2=0-2 + 2 = 0. So the coordinates are (−1,2)(-1, 2): two numbers, because VV has dimension 22.

e) No, and no computation is needed: they lie in HH, which has dimension 33, and any four vectors of a subspace of dimension 33 are dependent. (Membership, for the record: 1−1=01 - 1 = 0, −2+2=0-2 + 2 = 0, 1−1+2−2=01 - 1 + 2 - 2 = 0, 3−1−2=03 - 1 - 2 = 0.) The dimension works in both directions: it caps the size of an independent family at 33, and it certifies that any THREE independent vectors of HH are a basis of HH.

Exercise 8: Five statements to correct

Each statement below was written by a student revising for the MATH 133 final. Say whether it is TRUE or FALSE, correct every false one in one sentence, and settle it with the smallest counterexample you can find.

  • a) “A subspace has one basis, and the standard basis is the one to use.”
  • b) “Three vectors lying in a subspace of dimension 33 always form a basis of it.”
  • c) “A 3×73 \times 7 matrix has nullity 44.”
  • d) “row(A)\text{row}(A) and col(A)\text{col}(A) have the same dimension, so for a square matrix they are the same subspace.”
  • e) “The zero subspace {0}\{0\} has dimension 11, since it contains one vector.”
Show the solution

Answers

  • a) False: a non-zero subspace has infinitely many bases, and the standard vectors need not even lie in it
  • b) False: they must also be independent (or spanning)
  • c) False: the nullity is AT LEAST 44, and equals 44 only when the rank is 33
  • d) False: same dimension, different subspaces in general
  • e) False: dim⁡{0}=0\dim\{0\} = 0, its basis is empty

a) FALSE. Any non-zero subspace has infinitely many bases: replacing a basis vector by a non-zero multiple of itself already gives a new one. Worse, the standard vectors usually do not even belong to the subspace: the line spanned by (1,1)(1, 1) in R2\mathbb{R}^2 contains neither (1,0)(1, 0) nor (0,1)(0, 1), and its bases are the {(c,c)}\{(c, c)\} with c≠0c \neq 0. Correct sentence: a subspace has many bases, all with the same number of vectors, and only Rn\mathbb{R}^n itself has the standard basis among them.

b) FALSE. Having the right number is not enough; the three vectors must also be independent, OR span. In R3\mathbb{R}^3, of dimension 33, the vectors (1,0,0)(1, 0, 0), (0,1,0)(0, 1, 0) and (1,1,0)(1, 1, 0) are three vectors that all lie in the plane z=0z = 0: they are dependent, since the third is the sum of the first two, and they span only that plane. Correct sentence: in a subspace of dimension mm, mm vectors form a basis as soon as they are independent, or as soon as they span; ONE of the two checks is needed, not zero.

c) FALSE. The rank of a 3×73 \times 7 matrix is at most 33, so the nullity 7−r7 - r is at least 7−3=47 - 3 = 4. It equals 44 only when the rank is exactly 33. The zero 3×73 \times 7 matrix has rank 00 and nullity 77; a matrix whose three rows are all equal and non-zero has rank 11 and nullity 66. Correct sentence: a 3×73 \times 7 matrix has nullity at least 44, and exactly 7−rank7 - \text{rank}.

d) FALSE. They always have the same dimension, the rank, but they are different subspaces in general, even when AA is square. For A=(0100)A = \begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix}, the only non-zero row is (0,1)(0, 1), so row(A)=span{(0,1)}\text{row}(A) = \text{span}\{(0, 1)\}, while the only non-zero column is (1,0)(1, 0), so col(A)=span{(1,0)}\text{col}(A) = \text{span}\{(1, 0)\}. Two different lines of R2\mathbb{R}^2, both of dimension 11. Correct sentence: dim⁡row(A)=dim⁡col(A)=rank(A)\dim \text{row}(A) = \dim \text{col}(A) = \text{rank}(A), and that equality of NUMBERS says nothing about equality of the subspaces.

e) FALSE. The family {0}\{0\} is dependent, since 1⋅0=01 \cdot 0 = 0 is a non-trivial combination giving zero, so it cannot be a basis. The basis of the zero subspace is the EMPTY family, which is independent by default and spans {0}\{0\} by convention, so dim⁡{0}=0\dim\{0\} = 0. This is not a technicality: it is what makes rank plus nullity work for an invertible n×nn \times n matrix, n+0=nn + 0 = n. Correct sentence: the zero subspace has dimension 00; any subspace containing a non-zero vector has dimension at least 11.

Exercise 9: Crystal lattices: coordinates in a basis that is not the standard one

Crystallographers never locate an atom with the standard basis. They use the LATTICE vectors of the crystal, a basis adapted to its geometry, and the coordinates of a position relative to that basis say at once whether it is a lattice site: it is exactly when all its coordinates are integers. Finding them is solving one linear system, and the basis property guarantees exactly one answer.

The figure shows a two-dimensional lattice built on a=(2,0)a = (2, 0) and b=(1,2)b = (1, 2) (lengths in ångströms), with the lattice sites in grey and two positions P=(6,4)P = (6, 4) and Q=(5,3)Q = (5, 3). The last parts move to the three-dimensional face-centred cubic lattice of copper and aluminium, whose lattice vectors, in units of half the side of the cube, are a1=(0,1,1)a_1 = (0, 1, 1), a2=(1,0,1)a_2 = (1, 0, 1) and a3=(1,1,0)a_3 = (1, 1, 0).

abOPQ
  • a) Explain why {a,b}\{a, b\} is a basis of R2\mathbb{R}^2.
  • b) Find the coordinates of PP and of QQ relative to {a,b}\{a, b\}. Which one is a lattice site?
  • c) Show that {a1,a2,a3}\{a_1, a_2, a_3\} is a basis of R3\mathbb{R}^3.
  • d) Find the coordinates of (3,5,4)(3, 5, 4) and of (1,0,0)(1, 0, 0) relative to {a1,a2,a3}\{a_1, a_2, a_3\}, and say which one is a lattice site.
  • e) Prove that a point (x,y,z)(x, y, z) with integer entries is a lattice site exactly when x+y+zx + y + z is even.
Show the solution

Answers

  • a) Two non-proportional vectors in a space of dimension 22; det⁡=4≠0\det = 4 \neq 0
  • b) [P]=(2,2)[P] = (2, 2), a lattice site; [Q]=(74,32)[Q] = (\frac{7}{4}, \frac{3}{2}), not a site
  • c) det⁡(a1 a2 a3)=2≠0\det(a_1\,a_2\,a_3) = 2 \neq 0: three independent vectors of R3\mathbb{R}^3
  • d) [(3,5,4)]=(3,1,2)[(3, 5, 4)] = (3, 1, 2), a site; [(1,0,0)]=(−12,12,12)[(1, 0, 0)] = (-\frac{1}{2}, \frac{1}{2}, \frac{1}{2}), not a site
  • e) Coordinates s−xs - x, s−ys - y, s−zs - z with s=x+y+z2s = \frac{x + y + z}{2}: integers exactly when the sum is even

a) R2\mathbb{R}^2 has dimension 22, and aa and bb are two vectors that are not multiples of one another (aa has second entry 00, bb does not, and a≠0a \neq 0). Two independent vectors in a space of dimension 22 form a basis, so no spanning argument is needed. Equivalently, det⁡(2102)=4≠0\det \begin{pmatrix} 2 & 1 \\ 0 & 2 \end{pmatrix} = 4 \neq 0. The 44 has a physical meaning too: it is the area of one cell of the lattice, in square ångströms.

b) Solve c1a+c2b=Pc_1 a + c_2 b = P, that is 2c1+c2=62c_1 + c_2 = 6 and 2c2=42c_2 = 4. The second equation gives c2=2c_2 = 2, then c1=2c_1 = 2: [P]=(2,2)[P] = (2, 2), two integers, so P=2a+2bP = 2a + 2b is a lattice site, which the figure confirms. For QQ: 2c2=32c_2 = 3 gives c2=32c_2 = \frac{3}{2}, and 2c1=5−32=722c_1 = 5 - \frac{3}{2} = \frac{7}{2} gives c1=74c_1 = \frac{7}{4}. So [Q]=(74,32)[Q] = (\frac{7}{4}, \frac{3}{2}): QQ is inside a cell, three quarters of the way along aa and halfway along bb from the site a+b=(3,2)a + b = (3, 2). Note that the standard coordinates of QQ are integers, (5,3)(5, 3), and that proves nothing: integrality only means something in the lattice basis.

c) Three vectors in R3\mathbb{R}^3, of dimension 33: it suffices to show that they are independent. Expand det⁡(011101110)\det \begin{pmatrix} 0 & 1 & 1 \\ 1 & 0 & 1 \\ 1 & 1 & 0 \end{pmatrix} along the first row, which starts with a zero: 0−1⋅(1⋅0−1⋅1)+1⋅(1⋅1−0⋅1)=1+1=20 - 1 \cdot (1 \cdot 0 - 1 \cdot 1) + 1 \cdot (1 \cdot 1 - 0 \cdot 1) = 1 + 1 = 2. Non-zero, so the columns are independent and form a basis of R3\mathbb{R}^3. The value 22 is the volume of a primitive cell, a quarter of the cube of side 22, which holds four lattice sites.

d) Write c1a1+c2a2+c3a3=(c2+c3,  c1+c3,  c1+c2)c_1 a_1 + c_2 a_2 + c_3 a_3 = (c_2 + c_3, \; c_1 + c_3, \; c_1 + c_2). For (3,5,4)(3, 5, 4): adding the three equations gives 2(c1+c2+c3)=122(c_1 + c_2 + c_3) = 12, so c1+c2+c3=6c_1 + c_2 + c_3 = 6, then c1=6−3=3c_1 = 6 - 3 = 3, c2=6−5=1c_2 = 6 - 5 = 1, c3=6−4=2c_3 = 6 - 4 = 2. Check: (1+2,  3+2,  3+1)=(3,5,4)(1 + 2, \; 3 + 2, \; 3 + 1) = (3, 5, 4). Integer coordinates: a lattice site. For (1,0,0)(1, 0, 0): the sum gives c1+c2+c3=12c_1 + c_2 + c_3 = \frac{1}{2}, so c1=12−1=−12c_1 = \frac{1}{2} - 1 = -\frac{1}{2}, c2=12c_2 = \frac{1}{2}, c3=12c_3 = \frac{1}{2}. Check: (12+12,  −12+12,  −12+12)=(1,0,0)(\frac{1}{2} + \frac{1}{2}, \; -\frac{1}{2} + \frac{1}{2}, \; -\frac{1}{2} + \frac{1}{2}) = (1, 0, 0). Not a site: (1,0,0)(1, 0, 0) is the middle of an edge of the cube, a place where no atom sits in this structure.

e) The computation of d) works for any (x,y,z)(x, y, z): with s=x+y+z2s = \frac{x + y + z}{2}, the coordinates are c1=s−xc_1 = s - x, c2=s−yc_2 = s - y, c3=s−zc_3 = s - z, and they are the ONLY coordinates, because {a1,a2,a3}\{a_1, a_2, a_3\} is a basis. If x,y,zx, y, z are integers and x+y+zx + y + z is even, ss is an integer and so are the three coordinates: the point is a site. If x+y+zx + y + z is odd, ss is a half-integer and so is c1=s−xc_1 = s - x: not a site. So the face-centred cubic lattice is the set of integer points with an even coordinate sum, and (3,5,4)(3, 5, 4), with sum 1212, is one of them while (1,0,0)(1, 0, 0) is not. Uniqueness of coordinates is the whole proof: without it, a point could have fractional coordinates in one decomposition and integer ones in another.

Exercise 10: A final-exam problem: a parameter, a rank that drops, three subspaces

The closing question of a MATH 133 final often puts a parameter in the matrix and asks for everything at once: the value where the rank drops, the three bases at that value, and what changes elsewhere. It tests the whole chapter, and in particular whether the column space trap survives exam pressure.

Let A=(12102431122k)A = \begin{pmatrix} 1 & 2 & 1 & 0 \\ 2 & 4 & 3 & 1 \\ 1 & 2 & 2 & k \end{pmatrix}, where kk is a real number.

  • a) Row reduce AA, naming each operation, and find the value of kk for which rank(A)=2\text{rank}(A) = 2.
  • b) For that value of kk, give bases of null(A)\text{null}(A), col(A)\text{col}(A) and row(A)\text{row}(A).
  • c) For that value of kk, find the condition on b=(b1,b2,b3)b = (b_1, b_2, b_3) for Ax=bAx = b to be consistent. Is (1,1,1)(1, 1, 1) in col(A)\text{col}(A)? Are the pivot columns of RR?
  • d) Now take k=3k = 3. Give the rank, the nullity, and col(A)\text{col}(A). Explain why, in this case only, the pivot columns of RR happen to be a basis of col(A)\text{col}(A) as well.
  • e) Back to the value of a): complete your basis of col(A)\text{col}(A) into a basis of R3\mathbb{R}^3.
Show the solution

Answers

  • a) R3R_3 ends as (0,0,0,k−1)(0, 0, 0, k - 1): rank 22 exactly when k=1k = 1
  • b) null\text{null}: {(−2,1,0,0),(1,0,−1,1)}\{(-2, 1, 0, 0), (1, 0, -1, 1)\}; col\text{col}: {(1,2,1),(1,3,2)}\{(1, 2, 1), (1, 3, 2)\}; row\text{row}: {(1,2,0,−1),(0,0,1,1)}\{(1, 2, 0, -1), (0, 0, 1, 1)\}
  • c) b1−b2+b3=0b_1 - b_2 + b_3 = 0; (1,1,1)(1, 1, 1) is not in col(A)\text{col}(A); neither is (1,0,0)(1, 0, 0) nor (0,1,0)(0, 1, 0)
  • d) Rank 33, nullity 11, col(A)=R3\text{col}(A) = \mathbb{R}^3, so any basis of R3\mathbb{R}^3 is a basis of it
  • e) {(1,2,1),(1,3,2),(1,0,0)}\{(1, 2, 1), (1, 3, 2), (1, 0, 0)\}

a) R2→R2−2R1R_2 \to R_2 - 2R_1 gives (0,0,1,1)(0, 0, 1, 1) and R3→R3−R1R_3 \to R_3 - R_1 gives (0,0,1,k)(0, 0, 1, k). Then R3→R3−R2R_3 \to R_3 - R_2 gives (0,0,0,k−1)(0, 0, 0, k - 1). Pivots sit in columns 11 and 33 whatever kk is; column 44 receives a third pivot exactly when k−1≠0k - 1 \neq 0. So rank(A)=3\text{rank}(A) = 3 for k≠1k \neq 1 and rank(A)=2\text{rank}(A) = 2 for k=1k = 1. Column 22 never holds a pivot: it is twice column 11 for every kk.

b) With k=1k = 1, the third row is zero and R1→R1−R2R_1 \to R_1 - R_2 gives (1,2,0,−1)(1, 2, 0, -1), so R=(120−100110000)R = \begin{pmatrix} 1 & 2 & 0 & -1 \\ 0 & 0 & 1 & 1 \\ 0 & 0 & 0 & 0 \end{pmatrix}. Null space: x2=sx_2 = s and x4=tx_4 = t free, x1=−2s+tx_1 = -2s + t, x3=−tx_3 = -t, basis {(−2,1,0,0),(1,0,−1,1)}\{(-2, 1, 0, 0), (1, 0, -1, 1)\}, nullity 22. Column space: columns 11 and 33 OF AA, {(1,2,1),(1,3,2)}\{(1, 2, 1), (1, 3, 2)\}, dimension 22. Row space: non-zero rows of RR, {(1,2,0,−1),(0,0,1,1)}\{(1, 2, 0, -1), (0, 0, 1, 1)\}, dimension 22. Rank plus nullity: 2+2=42 + 2 = 4. Check the second null vector on AA: 1−1+0=01 - 1 + 0 = 0, 2−3+1=02 - 3 + 1 = 0, 1−2+1=01 - 2 + 1 = 0.

c) Carry bb through the same operations on the augmented matrix: the right-hand sides become b1b_1, b2−2b1b_2 - 2b_1, and (b3−b1)−(b2−2b1)=b1−b2+b3(b_3 - b_1) - (b_2 - 2b_1) = b_1 - b_2 + b_3. The last row reads 0=b1−b2+b30 = b_1 - b_2 + b_3, so the system is consistent exactly when b1−b2+b3=0b_1 - b_2 + b_3 = 0, which is therefore the equation of the plane col(A)\text{col}(A) (both basis columns satisfy it: 1−2+1=01 - 2 + 1 = 0 and 1−3+2=01 - 3 + 2 = 0). For b=(1,1,1)b = (1, 1, 1): 1−1+1=1≠01 - 1 + 1 = 1 \neq 0, so (1,1,1)∉col(A)(1, 1, 1) \notin \text{col}(A) and Ax=bAx = b has no solution. The pivot columns of RR, (1,0,0)(1, 0, 0) and (0,1,0)(0, 1, 0), give 11 and −1-1: NEITHER lies in col(A)\text{col}(A).

d) For k=3k = 3 the last row is (0,0,0,2)(0, 0, 0, 2): rank 33, nullity 4−3=14 - 3 = 1. A subspace of R3\mathbb{R}^3 of dimension 33 is R3\mathbb{R}^3, so col(A)=R3\text{col}(A) = \mathbb{R}^3. The textbook basis is columns 11, 33, 44 of AA: (1,2,1)(1, 2, 1), (1,3,2)(1, 3, 2), (0,1,3)(0, 1, 3). But since col(A)\text{col}(A) is all of R3\mathbb{R}^3, ANY basis of R3\mathbb{R}^3 is a basis of it, including the pivot columns of RR, (1,0,0)(1, 0, 0), (0,1,0)(0, 1, 0), (0,0,1)(0, 0, 1). This is the only situation where the wrong method gives a right answer: full row rank, r=mr = m. It is also why the trap survives: students who practise on invertible matrices never see it fail. Do not rely on it; take the columns of AA every time.

e) col(A)\text{col}(A) has dimension 22 in R3\mathbb{R}^3, so one vector must be added, chosen OUTSIDE the plane b1−b2+b3=0b_1 - b_2 + b_3 = 0. The vector e1=(1,0,0)e_1 = (1, 0, 0) gives 1≠01 \neq 0, so it is outside, and {(1,2,1),(1,3,2),(1,0,0)}\{(1, 2, 1), (1, 3, 2), (1, 0, 0)\} is independent, hence a basis of R3\mathbb{R}^3 (three independent vectors in dimension 33). The equation of col(A)\text{col}(A) found in c) turned the completion into a one-line test, which is the best reason to compute it.

See also

Looking for a tutor in Montreal?

Get in touch for a first session. We work on problems set at the real level of Montreal assessments.

Site by Studio Squalli