MATH 133 Linear Algebra and Geometry • McGill University, Montreal

Corrected exercises: diagonalization and its applications (MATH 133)

This is the corrected exercise set for the diagonalization chapter of MATH 133, Linear Algebra and Geometry, at McGill University: Nicholson sections 3.3, 3.4 and 5.5. It covers the definition P−1AP=DP^{-1}AP = D, the criterion of nn independent eigenvectors, algebraic and geometric multiplicities, powers An=PDnP−1A^n = PD^nP^{-1}, similar matrices and their invariants, and the three applications the course examines: linear dynamical systems, two-state Markov chains and linear recurrences. No calculator anywhere: every characteristic polynomial factors by hand.

The thread running through the whole set: diagonalizable is a COUNTING question. Are there nn independent eigenvectors or not? A repeated eigenvalue is not a verdict, the dimension of its eigenspace is, and it costs one rank. Once PP is built, every application is read in the eigenvector axes, where AA does nothing but stretch each axis by its eigenvalue: powers, the long run of a population, the steady state of a chain and the closed formula of a recurrence are the same computation four times.

The traps named explicitly in the solutions: concluding "double root, so not diagonalizable" without computing a rank, taking one eigenvector per eigenvalue whatever the multiplicity, writing the eigenvalues of DD in a different order from the columns of PP, putting the eigenvectors in the rows, writing A=P−1DPA = P^{-1}DP, raising the entries of AA to the power nn, believing that shared invariants prove similarity, and quoting an eigenvector as a steady state without scaling it to the total.

10 corrected exercises • 100 points • 150 minutes

Revision sheet for this chapter → Every MATH 133 chapter →

Course recap

  • • AA is diagonalizable when P−1AP=DP^{-1}AP = D, with PP invertible and DD diagonal; then A=PDP−1A = PDP^{-1}.
  • • Criterion: nn linearly independent eigenvectors. They are the COLUMNS of PP, and the ii-th diagonal entry of DD is the eigenvalue of the ii-th column.
  • • Geometric multiplicity dim⁡Eλ=n−rank(A−λI)\dim E_\lambda = n - \text{rank}(A - \lambda I), and 1≤dim⁡Eλ≤1 \le \dim E_\lambda \le algebraic multiplicity. Diagonalizable if and only if they are equal for every eigenvalue.
  • • nn distinct eigenvalues: diagonalizable. The converse is false (II is diagonal).
  • • An=PDnP−1A^n = PD^nP^{-1} and Dn=diag(λ1n,…,λnn)D^n = \text{diag}(\lambda_1^n, \dots, \lambda_n^n). If v0=c1u1+⋯+cnunv_0 = c_1u_1 + \dots + c_nu_n in eigenvectors, Akv0=c1λ1ku1+⋯+cnλnkunA^kv_0 = c_1\lambda_1^ku_1 + \dots + c_n\lambda_n^ku_n.
  • • Similar matrices (B=P−1APB = P^{-1}AP) share determinant, trace, rank, characteristic polynomial and eigenvalues. Sharing them does not prove similarity.
  • • A Markov matrix has columns adding up to 11, so 11 is an eigenvalue; the steady state is its eigenvector scaled to the total.

Part A: the basics (/50)

Exercise 1: One sign apart: a double eigenvalue decided by its eigenspace

An n×nn \times n matrix is diagonalizable when it has nn linearly independent eigenvectors. A repeated eigenvalue is the only place where that count can fall short, and it is exactly where students stop thinking and start guessing.

Consider A=(300121−112)A = \begin{pmatrix} 3 & 0 & 0 \\ 1 & 2 & 1 \\ -1 & 1 & 2 \end{pmatrix} and B=(300121112)B = \begin{pmatrix} 3 & 0 & 0 \\ 1 & 2 & 1 \\ 1 & 1 & 2 \end{pmatrix}. The two matrices differ by a single sign, in the bottom left corner.

  • a) Compute the characteristic polynomial of AA by cofactor expansion along a well-chosen row, and give the eigenvalues with their algebraic multiplicities. Explain why BB has exactly the same polynomial.
  • b) For the repeated eigenvalue of AA, find the eigenspace: its dimension and a basis.
  • c) Do the same for BB.
  • d) Decide which of AA and BB is diagonalizable. For the one that is, give PP and DD with P−1AP=DP^{-1}AP = D.
  • e) Explain why the simple eigenvalue λ=1\lambda = 1 never needed a rank test, in either matrix.
Show the solution

Answers

  • a) det⁡(A−λI)=(3−λ)2(1−λ)\det(A - \lambda I) = (3-\lambda)^2(1-\lambda) for both: λ=3\lambda = 3 (algebraic multiplicity 22), λ=1\lambda = 1 (multiplicity 11)
  • b) dim⁡E3=2\dim E_3 = 2, basis (1,1,0)(1,1,0), (−1,0,1)(-1,0,1)
  • c) dim⁡E3=1\dim E_3 = 1, basis (0,1,1)(0,1,1)
  • d) AA is diagonalizable, P=(1−1010101−1)P = \begin{pmatrix} 1 & -1 & 0 \\ 1 & 0 & 1 \\ 0 & 1 & -1 \end{pmatrix}, D=diag(3,3,1)D = \text{diag}(3,3,1); BB is not
  • e) Algebraic multiplicity 11 forces geometric multiplicity 11

a) Expand along row 11, which holds two zeros, so only one cofactor survives: det⁡(A−λI)=(3−λ)det⁡(2−λ112−λ)=(3−λ)((2−λ)2−1)\det(A - \lambda I) = (3-\lambda)\det\begin{pmatrix} 2-\lambda & 1 \\ 1 & 2-\lambda \end{pmatrix} = (3-\lambda)\big((2-\lambda)^2 - 1\big). The bracket is a difference of squares, (2−λ−1)(2−λ+1)=(1−λ)(3−λ)(2-\lambda-1)(2-\lambda+1) = (1-\lambda)(3-\lambda), so the polynomial is (3−λ)2(1−λ)(3-\lambda)^2(1-\lambda): λ=3\lambda = 3 with algebraic multiplicity 22 and λ=1\lambda = 1 with multiplicity 11. For BB the same expansion along row 11 deletes row 11 and column 11, and what remains is the SAME 2×22 \times 2 block: the entry that changed sign sits in column 11, which the minor never sees. Two quick checks: the trace 3+2+2=7=3+3+13 + 2 + 2 = 7 = 3 + 3 + 1, and det⁡A=3×(4−1)=9=3×3×1\det A = 3 \times (4 - 1) = 9 = 3 \times 3 \times 1.

b) A−3I=(0001−11−11−1)A - 3I = \begin{pmatrix} 0 & 0 & 0 \\ 1 & -1 & 1 \\ -1 & 1 & -1 \end{pmatrix}. The operation R3→R3+R2R_3 \to R_3 + R_2 turns row 33 into a zero row, so one pivot remains: rank 11, and the nullity is 3−1=23 - 1 = 2. The single equation x−y+z=0x - y + z = 0 leaves yy and zz free, x=y−zx = y - z, so E3=span{(1,1,0),(−1,0,1)}E_3 = \text{span}\{(1,1,0), (-1,0,1)\}. Check each one: A(1,1,0)=(3,3,0)A(1,1,0) = (3,3,0) and A(−1,0,1)=(−3,0,3)A(-1,0,1) = (-3,0,3). The geometric multiplicity is 22, equal to the algebraic one: the double root has kept a whole PLANE of eigenvectors.

c) B−3I=(0001−1111−1)B - 3I = \begin{pmatrix} 0 & 0 & 0 \\ 1 & -1 & 1 \\ 1 & 1 & -1 \end{pmatrix}. Now R3→R3−R2R_3 \to R_3 - R_2 gives (0,2,−2)(0, 2, -2), a second pivot: rank 22, nullity 11. The equations x−y+z=0x - y + z = 0 and y−z=0y - z = 0 give y=zy = z and x=0x = 0, so E3=span{(0,1,1)}E_3 = \text{span}\{(0,1,1)\}, and indeed B(0,1,1)=(0,3,3)B(0,1,1) = (0,3,3). The geometric multiplicity is 11, strictly less than 22: the eigenvalue is DEFECTIVE. Same polynomial, same eigenvalues, and one sign has cost a whole dimension of eigenvectors.

d) For AA, the eigenvalue 11: A−I=(200111−111)A - I = \begin{pmatrix} 2 & 0 & 0 \\ 1 & 1 & 1 \\ -1 & 1 & 1 \end{pmatrix} gives x=0x = 0 from R1R_1, then y+z=0y + z = 0, so E1=span{(0,1,−1)}E_1 = \text{span}\{(0,1,-1)\}. Together with the basis of E3E_3 that is 33 eigenvectors, and they are independent: det⁡P=−2≠0\det P = -2 \neq 0 for P=(1−1010101−1)P = \begin{pmatrix} 1 & -1 & 0 \\ 1 & 0 & 1 \\ 0 & 1 & -1 \end{pmatrix}. So AA is diagonalizable and P−1AP=D=diag(3,3,1)P^{-1}AP = D = \text{diag}(3, 3, 1), with the eigenvalues in the order of the columns. For BB, the eigenspaces supply 1+1=21 + 1 = 2 independent eigenvectors, one short of 33: no invertible PP can be built, and BB is NOT diagonalizable. The verdict came from one rank, never from the polynomial.

e) For every eigenvalue, 1≤1 \le geometric multiplicity ≤\le algebraic multiplicity: an eigenvalue always has at least one eigenvector, and it can never have more independent ones than its multiplicity as a root. Algebraic multiplicity 11 squeezes the geometric one to exactly 11, so a simple eigenvalue can never be the reason a matrix fails. On an exam, the rank test is spent on the repeated eigenvalues only; computing E1E_1 is still needed, but to fill a column of PP, not to decide anything.

Exercise 2: A parameter decides, and it is not the one you expect

Let A=(2a102b00−1)A = \begin{pmatrix} 2 & a & 1 \\ 0 & 2 & b \\ 0 & 0 & -1 \end{pmatrix}, where aa and bb are real numbers.

The matrix is triangular, so its eigenvalues cost nothing. The whole question is what happens inside the eigenspace of the repeated one, and which of the two parameters can reach it.

  • a) Give the eigenvalues of AA with their algebraic multiplicities, and justify in one line.
  • b) Find all values of aa and bb for which AA is diagonalizable.
  • c) Take a=0a = 0 and b=3b = 3, so A=(20102300−1)A = \begin{pmatrix} 2 & 0 & 1 \\ 0 & 2 & 3 \\ 0 & 0 & -1 \end{pmatrix}. Find an invertible PP and a diagonal DD with P−1AP=DP^{-1}AP = D.
  • d) For which real kk is C=(110k)C = \begin{pmatrix} 1 & 1 \\ 0 & k \end{pmatrix} diagonalizable?
  • e) From d), a student concludes: "a matrix is diagonalizable exactly when its eigenvalues are distinct". Give the counterexample that kills the word exactly, and state the correct criterion.
Show the solution

Answers

  • a) 22 (algebraic multiplicity 22) and −1-1 (multiplicity 11), for all aa, bb
  • b) Diagonalizable if and only if a=0a = 0, whatever bb
  • c) P=(10−101−3003)P = \begin{pmatrix} 1 & 0 & -1 \\ 0 & 1 & -3 \\ 0 & 0 & 3 \end{pmatrix}, D=diag(2,2,−1)D = \text{diag}(2, 2, -1)
  • d) All k≠1k \neq 1
  • e) I2I_2: repeated eigenvalue, already diagonal. Criterion: geometric == algebraic multiplicity for every eigenvalue

a) A−λIA - \lambda I is still upper triangular, and the determinant of a triangular matrix is the product of its diagonal: det⁡(A−λI)=(2−λ)2(−1−λ)\det(A - \lambda I) = (2-\lambda)^2(-1-\lambda). So λ=2\lambda = 2 with algebraic multiplicity 22 and λ=−1\lambda = -1 with multiplicity 11, whatever aa and bb are. The parameters are invisible to the polynomial, which is exactly why the polynomial alone can never settle the question.

b) Only λ=2\lambda = 2 needs a test. A−2I=(0a100b00−3)A - 2I = \begin{pmatrix} 0 & a & 1 \\ 0 & 0 & b \\ 0 & 0 & -3 \end{pmatrix}. Row 33 is a multiple of (0,0,1)(0,0,1) and so is row 22: R2→R2+b3R3R_2 \to R_2 + \frac{b}{3}R_3 turns row 22 into zeros for EVERY bb. What remains is (0,a,1)(0, a, 1) and (0,0,−3)(0, 0, -3). If a≠0a \neq 0 these two rows have pivots in columns 22 and 33: rank 22, nullity 1<21 < 2, not diagonalizable. If a=0a = 0, R1→R1+13R3R_1 \to R_1 + \frac{1}{3}R_3 kills row 11 too: rank 11, nullity 22, diagonalizable. So AA is diagonalizable if and only if a=0a = 0, and bb plays no role. The reason is structural: bb couples the eigenvalue 22 to the eigenvalue −1-1, which are distinct, while aa couples the eigenvalue 22 to ITSELF, and only that coupling can crush an eigenspace. Writing "a=0a = 0 and b=0b = 0" costs the part.

c) E2E_2: with a=0a = 0, A−2IA - 2I reduces to the single equation z=0z = 0, so E2=span{(1,0,0),(0,1,0)}E_2 = \text{span}\{(1,0,0), (0,1,0)\}. E−1E_{-1}: A+I=(301033000)A + I = \begin{pmatrix} 3 & 0 & 1 \\ 0 & 3 & 3 \\ 0 & 0 & 0 \end{pmatrix} gives 3x+z=03x + z = 0 and 3y+3z=03y + 3z = 0; with z=3z = 3 this is x=−1x = -1, y=−3y = -3, so the eigenvector is (−1,−3,3)(-1, -3, 3). Check: A(−1,−3,3)=(−2+3,−6+9,−3)=(1,3,−3)A(-1,-3,3) = (-2 + 3, -6 + 9, -3) = (1, 3, -3), which is −1-1 times the vector. Hence P=(10−101−3003)P = \begin{pmatrix} 1 & 0 & -1 \\ 0 & 1 & -3 \\ 0 & 0 & 3 \end{pmatrix} and D=diag(2,2,−1)D = \text{diag}(2, 2, -1), the two columns for λ=2\lambda = 2 first because the two 22 come first in DD. PP is triangular with det⁡P=3≠0\det P = 3 \neq 0.

d) CC is triangular, with eigenvalues 11 and kk. If k≠1k \neq 1 they are distinct, and two distinct eigenvalues give two independent eigenvectors: diagonalizable, no further work. If k=1k = 1, C−I=(0100)C - I = \begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix} has rank 11, so dim⁡E1=1<2\dim E_1 = 1 < 2 and CC is not diagonalizable. Answer: every k≠1k \neq 1.

e) The identity I2I_2 has the single eigenvalue 11, repeated, and it is diagonal already, with P=IP = I. The matrix of c) is another counterexample. Distinct eigenvalues are SUFFICIENT, never necessary. The correct criterion: AA is diagonalizable if and only if, for every eigenvalue, the geometric multiplicity equals the algebraic multiplicity; equivalently the dimensions of the eigenspaces add up to nn.

Exercise 3: Building P and D, and the order that ties them

Diagonalizing is a change of axes: along an eigenvector, AA does nothing but stretch. The matrix PP lists those axes as its COLUMNS, and DD lists the stretch factors in the SAME order. Both halves of that sentence cost marks when they are forgotten.

Let A=(1232)A = \begin{pmatrix} 1 & 2 \\ 3 & 2 \end{pmatrix}.

  • a) Find an invertible PP and a diagonal DD with P−1AP=DP^{-1}AP = D.
  • b) Check your answer without computing P−1P^{-1}, by comparing APAP with PDPD column by column.
  • c) Swap the two columns of PP: what becomes of DD? And if instead you multiply the first column of PP by −5-5?
  • d) A student writes the eigenvectors as the ROWS of a matrix QQ. Compute Q−1AQQ^{-1}AQ and show it is not diagonal.
  • e) Compute P−1P^{-1} and verify that PDP−1=APDP^{-1} = A.
Show the solution

Answers

  • a) P=(213−1)P = \begin{pmatrix} 2 & 1 \\ 3 & -1 \end{pmatrix}, D=diag(4,−1)D = \text{diag}(4, -1)
  • b) AP=PD=(8−1121)AP = PD = \begin{pmatrix} 8 & -1 \\ 12 & 1 \end{pmatrix}
  • c) Swapping gives D=diag(−1,4)D = \text{diag}(-1, 4); scaling a column leaves DD unchanged
  • d) Q−1AQ=15(2822−12−13)Q^{-1}AQ = \frac{1}{5}\begin{pmatrix} 28 & 22 \\ -12 & -13 \end{pmatrix}, not diagonal
  • e) P−1=15(113−2)P^{-1} = \frac{1}{5}\begin{pmatrix} 1 & 1 \\ 3 & -2 \end{pmatrix} and PDP−1=APDP^{-1} = A

a) det⁡(A−λI)=(1−λ)(2−λ)−6=λ2−3λ−4=(λ−4)(λ+1)\det(A - \lambda I) = (1-\lambda)(2-\lambda) - 6 = \lambda^2 - 3\lambda - 4 = (\lambda - 4)(\lambda + 1). For λ=4\lambda = 4: A−4I=(−323−2)A - 4I = \begin{pmatrix} -3 & 2 \\ 3 & -2 \end{pmatrix}, and R2→R2+R1R_2 \to R_2 + R_1 leaves −3x+2y=0-3x + 2y = 0, so (2,3)(2, 3). For λ=−1\lambda = -1: A+I=(2233)A + I = \begin{pmatrix} 2 & 2 \\ 3 & 3 \end{pmatrix}, and R2→R2−32R1R_2 \to R_2 - \frac{3}{2}R_1 leaves x+y=0x + y = 0, so (1,−1)(1, -1). Two distinct eigenvalues, so diagonalizability is automatic: P=(213−1)P = \begin{pmatrix} 2 & 1 \\ 3 & -1 \end{pmatrix} and D=diag(4,−1)D = \text{diag}(4, -1). The 44 comes first in DD because (2,3)(2,3) comes first in PP.

b) APAP is AA applied to each column of PP: A(2,3)=(2+6,6+6)=(8,12)=4(2,3)A(2,3) = (2 + 6, 6 + 6) = (8, 12) = 4(2,3) and A(1,−1)=(1−2,3−2)=(−1,1)=−1(1,−1)A(1,-1) = (1 - 2, 3 - 2) = (-1, 1) = -1(1,-1). And PDPD multiplies each column of PP by the matching diagonal entry: PD=(8−1121)PD = \begin{pmatrix} 8 & -1 \\ 12 & 1 \end{pmatrix}. The two agree. Since PP is invertible (det⁡P=−2−3=−5\det P = -2 - 3 = -5), AP=PDAP = PD is the same statement as P−1AP=DP^{-1}AP = D, and it costs two matrix-vector products instead of an inverse. This is the check to write on every copy.

c) Swapping the columns, P′=(12−13)P' = \begin{pmatrix} 1 & 2 \\ -1 & 3 \end{pmatrix}, forces D′=diag(−1,4)D' = \text{diag}(-1, 4): the ii-th diagonal entry of DD is the eigenvalue of the ii-th column of PP, so the two lists move together. Keeping D=diag(4,−1)D = \text{diag}(4, -1) with the swapped PP gives AP′≠P′DAP' \neq P'D, and the answer is wrong although every number in it is right. Multiplying the first column by −5-5 gives (−10,−15)(-10, -15), still an eigenvector for 44, so DD does not change. PP is never unique; DD is unique up to the order of its entries.

d) Q=(231−1)Q = \begin{pmatrix} 2 & 3 \\ 1 & -1 \end{pmatrix}, det⁡Q=−5\det Q = -5, Q−1=15(131−2)Q^{-1} = \frac{1}{5}\begin{pmatrix} 1 & 3 \\ 1 & -2 \end{pmatrix}. Then AQ=(4187)AQ = \begin{pmatrix} 4 & 1 \\ 8 & 7 \end{pmatrix} and Q−1AQ=15(2822−12−13)Q^{-1}AQ = \frac{1}{5}\begin{pmatrix} 28 & 22 \\ -12 & -13 \end{pmatrix}, which is not diagonal. The reason is in the product itself: AQAQ applies AA to the COLUMNS of QQ, here (2,1)(2,1) and (3,−1)(3,-1), and neither of those is an eigenvector. Rows of PP are never read by the product APAP.

e) For a 2×22 \times 2, swap the diagonal, negate the off-diagonal, divide by the determinant: P−1=1−5(−1−1−32)=15(113−2)P^{-1} = \frac{1}{-5}\begin{pmatrix} -1 & -1 \\ -3 & 2 \end{pmatrix} = \frac{1}{5}\begin{pmatrix} 1 & 1 \\ 3 & -2 \end{pmatrix}. Then PDP−1=15(8−1121)(113−2)=15(5101510)=(1232)=APDP^{-1} = \frac{1}{5}\begin{pmatrix} 8 & -1 \\ 12 & 1 \end{pmatrix}\begin{pmatrix} 1 & 1 \\ 3 & -2 \end{pmatrix} = \frac{1}{5}\begin{pmatrix} 5 & 10 \\ 15 & 10 \end{pmatrix} = \begin{pmatrix} 1 & 2 \\ 3 & 2 \end{pmatrix} = A. Note where PP sits: A=PDP−1A = PDP^{-1}, with PP on the LEFT. Multiplying P−1AP=DP^{-1}AP = D by PP on the left and by P−1P^{-1} on the right is the only way to get it back.

Exercise 4: Powers of a matrix, read in the eigenvector axes

Let A=(4−211)A = \begin{pmatrix} 4 & -2 \\ 1 & 1 \end{pmatrix}. The figure draws its eigenvectors v1=(1,1)v_1 = (1,1), for λ=2\lambda = 2, and v2=(2,1)v_2 = (2,1), for λ=3\lambda = 3, as two new axes, and writes the standard vector e1=(1,0)e_1 = (1,0) in those axes as the diagonal of a parallelogram.

In the eigenvector axes, AA multiplies the first coordinate by 22 and the second by 33; AnA^n does it nn times. That is the whole reason diagonalization computes powers.

v₁v₂−v₁e₁λ = 2λ = 3
  • a) Check that v1v_1 and v2v_2 are eigenvectors, and write PP, DD and P−1P^{-1}.
  • b) Prove that An=PDnP−1A^n = PD^nP^{-1} for every integer n≥1n \ge 1.
  • c) Give AnA^n entry by entry. Check the formula at n=0n = 0, at n=1n = 1, and against A3A^3 computed directly.
  • d) Read on the figure how e1e_1 is written in terms of v1v_1 and v2v_2, and deduce Ane1A^ne_1 without any matrix product. Compare with c).
  • e) Put n=−1n = -1 in the formula of c) and check that it gives A−1A^{-1}.
Show the solution

Answers

  • a) Av1=2v1Av_1 = 2v_1, Av2=3v2Av_2 = 3v_2; P=(1211)P = \begin{pmatrix} 1 & 2 \\ 1 & 1 \end{pmatrix}, D=diag(2,3)D = \text{diag}(2,3), P−1=(−121−1)P^{-1} = \begin{pmatrix} -1 & 2 \\ 1 & -1 \end{pmatrix}
  • b) P−1P=IP^{-1}P = I cancels between consecutive factors; induction on nn
  • c) An=(2⋅3n−2n2n+1−2⋅3n3n−2n2n+1−3n)A^n = \begin{pmatrix} 2 \cdot 3^n - 2^n & 2^{n+1} - 2 \cdot 3^n \\ 3^n - 2^n & 2^{n+1} - 3^n \end{pmatrix}, and A3=(46−3819−11)A^3 = \begin{pmatrix} 46 & -38 \\ 19 & -11 \end{pmatrix}
  • d) e1=−v1+v2e_1 = -v_1 + v_2, so Ane1=−2nv1+3nv2=(2⋅3n−2n,3n−2n)A^ne_1 = -2^nv_1 + 3^nv_2 = (2 \cdot 3^n - 2^n, 3^n - 2^n)
  • e) A−1=(1/61/3−1/62/3)A^{-1} = \begin{pmatrix} 1/6 & 1/3 \\ -1/6 & 2/3 \end{pmatrix}

a) Av1=(4−2,1+1)=(2,2)=2v1Av_1 = (4 - 2, 1 + 1) = (2, 2) = 2v_1 and Av2=(8−2,2+1)=(6,3)=3v2Av_2 = (8 - 2, 2 + 1) = (6, 3) = 3v_2. So P=(1211)P = \begin{pmatrix} 1 & 2 \\ 1 & 1 \end{pmatrix}, with the columns in the order v1,v2v_1, v_2, and D=diag(2,3)D = \text{diag}(2, 3) in the same order. det⁡P=1−2=−1\det P = 1 - 2 = -1, so P−1=1−1(1−2−11)=(−121−1)P^{-1} = \frac{1}{-1}\begin{pmatrix} 1 & -2 \\ -1 & 1 \end{pmatrix} = \begin{pmatrix} -1 & 2 \\ 1 & -1 \end{pmatrix}. Check: PP−1=(−1+22−2−1+12−1)=IPP^{-1} = \begin{pmatrix} -1 + 2 & 2 - 2 \\ -1 + 1 & 2 - 1 \end{pmatrix} = I.

b) From P−1AP=DP^{-1}AP = D we get A=PDP−1A = PDP^{-1}. Then A2=PDP−1PDP−1=PD(P−1P)DP−1=PD2P−1A^2 = PDP^{-1}PDP^{-1} = PD(P^{-1}P)DP^{-1} = PD^2P^{-1}: the inner P−1PP^{-1}P collapses to II. By induction, if An=PDnP−1A^n = PD^nP^{-1} then An+1=AnA=PDnP−1PDP−1=PDn+1P−1A^{n+1} = A^nA = PD^nP^{-1}PDP^{-1} = PD^{n+1}P^{-1}. Finally Dn=diag(2n,3n)D^n = \text{diag}(2^n, 3^n), because a product of diagonal matrices multiplies the diagonal entries. Only DD is raised entry by entry; AnA^n is NOT the matrix of the nn-th powers of the entries of AA.

c) PDn=(2n2⋅3n2n3n)PD^n = \begin{pmatrix} 2^n & 2 \cdot 3^n \\ 2^n & 3^n \end{pmatrix}, then multiply by P−1P^{-1}: An=(2⋅3n−2n2n+1−2⋅3n3n−2n2n+1−3n)A^n = \begin{pmatrix} 2 \cdot 3^n - 2^n & 2^{n+1} - 2 \cdot 3^n \\ 3^n - 2^n & 2^{n+1} - 3^n \end{pmatrix}. At n=0n = 0: (2−12−21−12−1)=I\begin{pmatrix} 2 - 1 & 2 - 2 \\ 1 - 1 & 2 - 1 \end{pmatrix} = I. At n=1n = 1: (6−24−63−24−3)=A\begin{pmatrix} 6 - 2 & 4 - 6 \\ 3 - 2 & 4 - 3 \end{pmatrix} = A. At n=3n = 3: (54−816−5427−816−27)=(46−3819−11)\begin{pmatrix} 54 - 8 & 16 - 54 \\ 27 - 8 & 16 - 27 \end{pmatrix} = \begin{pmatrix} 46 & -38 \\ 19 & -11 \end{pmatrix}, and directly A2=(14−105−1)A^2 = \begin{pmatrix} 14 & -10 \\ 5 & -1 \end{pmatrix}, A3=A2A=(56−10−28−1020−1−10−1)A^3 = A^2A = \begin{pmatrix} 56 - 10 & -28 - 10 \\ 20 - 1 & -10 - 1 \end{pmatrix}: the same. The two checks at n=0n = 0 and n=1n = 1 take ten seconds and catch a P−1P^{-1} on the wrong side every time.

d) Following the parallelogram, e1=−v1+v2e_1 = -v_1 + v_2: indeed −(1,1)+(2,1)=(1,0)-(1,1) + (2,1) = (1, 0). Its eigen-coordinates are (−1,1)(-1, 1), and AnA^n acts on them one at a time: Ane1=−2nv1+3nv2=(−2n+2⋅3n,−2n+3n)A^ne_1 = -2^nv_1 + 3^nv_2 = (-2^n + 2 \cdot 3^n, -2^n + 3^n). That is exactly the first column of c), as it must be, since Ane1A^ne_1 IS the first column of AnA^n. The figure also says where things go: 3n3^n outgrows 2n2^n, so Ane1A^ne_1 turns toward the line of v2v_2 as nn grows.

e) With n=−1n = -1: A−1=(23−121−2313−121−13)=(1/61/3−1/62/3)A^{-1} = \begin{pmatrix} \frac{2}{3} - \frac{1}{2} & 1 - \frac{2}{3} \\ \frac{1}{3} - \frac{1}{2} & 1 - \frac{1}{3} \end{pmatrix} = \begin{pmatrix} 1/6 & 1/3 \\ -1/6 & 2/3 \end{pmatrix}. The 2×22 \times 2 formula agrees: det⁡A=4+2=6\det A = 4 + 2 = 6 and A−1=16(12−14)A^{-1} = \frac{1}{6}\begin{pmatrix} 1 & 2 \\ -1 & 4 \end{pmatrix}. The formula is allowed at n=−1n = -1 because D−1=diag(12,13)D^{-1} = \text{diag}(\frac{1}{2}, \frac{1}{3}) exists, that is because 00 is not an eigenvalue.

Exercise 5: Similar matrices: what they share, and what sharing does not prove

Two n×nn \times n matrices AA and BB are similar when B=P−1APB = P^{-1}AP for some invertible PP. They are then the same linear map written in two different bases, and everything that does not depend on the basis is shared: determinant, trace, rank, characteristic polynomial, eigenvalues.

The trap is the converse. Invariants can prove that two matrices are NOT similar; no list of invariants can prove that they are.

  • a) Prove that similar matrices have the same determinant and the same characteristic polynomial. Deduce that they have the same eigenvalues and the same trace.
  • b) Are (1234)\begin{pmatrix} 1 & 2 \\ 3 & 4 \end{pmatrix} and (5010)\begin{pmatrix} 5 & 0 \\ 1 & 0 \end{pmatrix} similar?
  • c) Show that M=(2102)M = \begin{pmatrix} 2 & 1 \\ 0 & 2 \end{pmatrix} and 2I2I have the same characteristic polynomial, trace, determinant and rank, and yet are not similar.
  • d) Show that M1=(1203)M_1 = \begin{pmatrix} 1 & 2 \\ 0 & 3 \end{pmatrix} and M2=(3051)M_2 = \begin{pmatrix} 3 & 0 \\ 5 & 1 \end{pmatrix} ARE similar, by going through a diagonal matrix, and give an SS with M2=S−1M1SM_2 = S^{-1}M_1S.
  • e) In Exercise 1, AA and BB had the same characteristic polynomial. Use an invariant to prove that they are not similar.
Show the solution

Answers

  • a) det⁡(P−1AP)=det⁡A\det(P^{-1}AP) = \det A and P−1AP−λI=P−1(A−λI)PP^{-1}AP - \lambda I = P^{-1}(A - \lambda I)P
  • b) No: det⁡=−2\det = -2 against 00 (the traces agree, which proves nothing)
  • c) Both (2−λ)2(2-\lambda)^2, trace 44, det 44, rank 22; but P−1(2I)P=2I≠MP^{-1}(2I)P = 2I \neq M for every PP
  • d) Both are similar to diag(1,3)\text{diag}(1,3); S=PQ−1=(−211/20)S = PQ^{-1} = \begin{pmatrix} -2 & 1 \\ 1/2 & 0 \end{pmatrix}
  • e) rank(A−3I)=1\text{rank}(A - 3I) = 1 but rank(B−3I)=2\text{rank}(B - 3I) = 2: not similar

a) det⁡(P−1AP)=det⁡(P−1)det⁡Adet⁡P=1det⁡Pdet⁡Adet⁡P=det⁡A\det(P^{-1}AP) = \det(P^{-1})\det A\det P = \frac{1}{\det P}\det A\det P = \det A, by the product rule. For the polynomial, the key line is P−1AP−λI=P−1(A−λI)PP^{-1}AP - \lambda I = P^{-1}(A - \lambda I)P, true because P−1(λI)P=λP−1P=λIP^{-1}(\lambda I)P = \lambda P^{-1}P = \lambda I. Taking determinants, det⁡(B−λI)=det⁡(A−λI)\det(B - \lambda I) = \det(A - \lambda I) for every λ\lambda: same polynomial, hence same eigenvalues with the same algebraic multiplicities. The trace is the sum of the eigenvalues (for a 2×22 \times 2 it is the coefficient in λ2−(tr)λ+det⁡\lambda^2 - (\text{tr})\lambda + \det), so it is shared too. Rank is shared because multiplying by invertible matrices never changes it.

b) The traces agree, 1+4=5=5+01 + 4 = 5 = 5 + 0, and a student who stops there concludes wrongly. The determinants are 4−6=−24 - 6 = -2 and 00. One invariant that differs is enough: NOT similar. The second matrix is singular and the first is not, and no change of basis can make a map lose invertibility.

c) det⁡(M−λI)=(2−λ)2=det⁡(2I−λI)\det(M - \lambda I) = (2 - \lambda)^2 = \det(2I - \lambda I); trace 44 and determinant 44 for both; rank 22 for both. Suppose P−1(2I)P=MP^{-1}(2I)P = M. But P−1(2I)P=2P−1P=2IP^{-1}(2I)P = 2P^{-1}P = 2I, whatever PP is, and 2I≠M2I \neq M. So the ONLY matrix similar to 2I2I is 2I2I itself. The four invariants were all equal and the conclusion is still no. What separates them is the eigenspace: M−2IM - 2I has rank 11, so MM has a single line of eigenvectors, while every vector is an eigenvector of 2I2I.

d) M1M_1 is triangular with eigenvalues 11 and 33, distinct, so M1=PDP−1M_1 = PDP^{-1} with D=diag(1,3)D = \text{diag}(1, 3): E1=span{(1,0)}E_1 = \text{span}\{(1,0)\} and M1−3I=(−2200)M_1 - 3I = \begin{pmatrix} -2 & 2 \\ 0 & 0 \end{pmatrix} gives (1,1)(1,1), so P=(1101)P = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix}. M2M_2 is triangular with eigenvalues 33 and 11: M2−I=(2050)M_2 - I = \begin{pmatrix} 2 & 0 \\ 5 & 0 \end{pmatrix} gives (0,1)(0,1) and M2−3I=(005−2)M_2 - 3I = \begin{pmatrix} 0 & 0 \\ 5 & -2 \end{pmatrix} gives (2,5)(2,5); ordering the columns to match the SAME DD, Q=(0215)Q = \begin{pmatrix} 0 & 2 \\ 1 & 5 \end{pmatrix} and M2=QDQ−1M_2 = QDQ^{-1}. Then D=P−1M1PD = P^{-1}M_1P, so M2=QP−1M1PQ−1=S−1M1SM_2 = QP^{-1}M_1PQ^{-1} = S^{-1}M_1S with S=PQ−1S = PQ^{-1}. Here Q−1=1−2(5−2−10)Q^{-1} = \frac{1}{-2}\begin{pmatrix} 5 & -2 \\ -1 & 0 \end{pmatrix} and S=(−211/20)S = \begin{pmatrix} -2 & 1 \\ 1/2 & 0 \end{pmatrix}. The route through the diagonal matrix is the only general way to PROVE similarity in this course.

e) If B=S−1ASB = S^{-1}AS, then B−3I=S−1(A−3I)SB - 3I = S^{-1}(A - 3I)S, so A−3IA - 3I and B−3IB - 3I would have the same rank. Exercise 1 found rank(A−3I)=1\text{rank}(A - 3I) = 1 and rank(B−3I)=2\text{rank}(B - 3I) = 2. So AA and BB are not similar, although they share their polynomial (3−λ)2(1−λ)(3-\lambda)^2(1-\lambda). Equivalently: a matrix similar to a diagonalizable one is diagonalizable, and AA is while BB is not. This is the 3×33 \times 3 version of c).

Part B: problems and reasoning (/50)

Exercise 6: A population with two age classes, and its dominant eigenvalue

A bird population is counted each spring in two classes: juveniles jkj_k, hatched the previous year, and adults aka_k. Each adult produces on average 33 juveniles that survive to the next count, juveniles do not breed, half of the juveniles survive to become adults, and half of the adults survive another year. With vk=(jk,ak)v_k = (j_k, a_k) this reads vk+1=Avkv_{k+1} = Av_k with A=(030.50.5)A = \begin{pmatrix} 0 & 3 \\ 0.5 & 0.5 \end{pmatrix}.

The count starts at v0=(100,100)v_0 = (100, 100). The figure plots the first five counts in the (j,a)(j, a) plane, in hundreds of birds.

1234567812345v₀v₁v₂v₃v₄juveniles (hundreds)adults (hundreds)
  • a) Diagonalize AA.
  • b) Write v0v_0 as a combination of the eigenvectors, and deduce a closed formula for vkv_k.
  • c) Check the formula against the points v1v_1 and v2v_2 on the figure.
  • d) Describe the long-term behaviour: the growth rate per year and the eventual ratio of juveniles to adults. Explain why the negative eigenvalue does not matter in the long run.
  • e) Keep everything except the juvenile survival rate ss, the 0.50.5 in the bottom left corner of AA. For which ss does the population neither grow nor shrink in the long run?
Show the solution

Answers

  • a) P=(2−311)P = \begin{pmatrix} 2 & -3 \\ 1 & 1 \end{pmatrix}, D=diag(1.5,−1)D = \text{diag}(1.5, -1)
  • b) v0=80(2,1)+20(−3,1)v_0 = 80(2,1) + 20(-3,1), so vk=80(1.5)k(2,1)+20(−1)k(−3,1)v_k = 80(1.5)^k(2,1) + 20(-1)^k(-3,1)
  • c) v1=(300,100)v_1 = (300, 100) and v2=(300,200)v_2 = (300, 200), as plotted
  • d) Growth of 5050 per cent a year, juveniles to adults tending to 2:12 : 1
  • e) s=16s = \frac{1}{6}

a) det⁡(A−λI)=−λ(0.5−λ)−1.5=λ2−0.5λ−1.5\det(A - \lambda I) = -\lambda(0.5 - \lambda) - 1.5 = \lambda^2 - 0.5\lambda - 1.5. Doubling clears the decimals: 2λ2−λ−3=(2λ−3)(λ+1)2\lambda^2 - \lambda - 3 = (2\lambda - 3)(\lambda + 1), so λ1=1.5\lambda_1 = 1.5 and λ2=−1\lambda_2 = -1. For 1.51.5: A−1.5I=(−1.530.5−1)A - 1.5I = \begin{pmatrix} -1.5 & 3 \\ 0.5 & -1 \end{pmatrix}, and R1→R1+3R2R_1 \to R_1 + 3R_2 leaves j=2aj = 2a, so u1=(2,1)u_1 = (2, 1). For −1-1: A+I=(130.51.5)A + I = \begin{pmatrix} 1 & 3 \\ 0.5 & 1.5 \end{pmatrix}, and R2→R2−0.5R1R_2 \to R_2 - 0.5R_1 leaves j=−3aj = -3a, so u2=(−3,1)u_2 = (-3, 1). Distinct eigenvalues: P=(2−311)P = \begin{pmatrix} 2 & -3 \\ 1 & 1 \end{pmatrix}, D=diag(1.5,−1)D = \text{diag}(1.5, -1), det⁡P=5\det P = 5.

b) Solve c1(2,1)+c2(−3,1)=(100,100)c_1(2, 1) + c_2(-3, 1) = (100, 100): the second coordinate gives c2=100−c1c_2 = 100 - c_1, and the first 2c1−300+3c1=1002c_1 - 300 + 3c_1 = 100, so c1=80c_1 = 80 and c2=20c_2 = 20. Since Akui=λikuiA^ku_i = \lambda_i^ku_i, vk=Akv0=80(1.5)k(2,1)+20(−1)k(−3,1)v_k = A^kv_0 = 80(1.5)^k(2, 1) + 20(-1)^k(-3, 1). This is Ak=PDkP−1A^k = PD^kP^{-1} applied to v0v_0, without ever writing P−1P^{-1}: the coefficients c1,c2c_1, c_2 ARE P−1v0P^{-1}v_0.

c) k=1k = 1: (240,120)+(60,−20)=(300,100)(240, 120) + (60, -20) = (300, 100), and directly Av0=(0+300,50+50)=(300,100)Av_0 = (0 + 300, 50 + 50) = (300, 100). k=2k = 2: 80×2.25=18080 \times 2.25 = 180, so (360,180)+(−60,20)=(300,200)(360, 180) + (-60, 20) = (300, 200), and directly Av1=(300,150+50)=(300,200)Av_1 = (300, 150 + 50) = (300, 200). These are the points (3,1)(3, 1) and (3,2)(3, 2) on the figure, in hundreds.

d) Divide by 1.5k1.5^k: vk1.5k=80(2,1)+20(−11.5)k(−3,1)\frac{v_k}{1.5^k} = 80(2, 1) + 20\left(\frac{-1}{1.5}\right)^k(-3, 1), and the second term tends to 00. So in the long run vk≈80(1.5)k(2,1)v_k \approx 80(1.5)^k(2, 1): the population grows by 5050 per cent a year and the juveniles outnumber the adults two to one, whatever the starting count (as long as c1≠0c_1 \neq 0). The eigenvalue −1-1 makes the second component flip sign every year, but its size stays 2020 while the first grows without bound, so its relative weight vanishes. On the figure the counts do not converge to a point, they run away; it is their DIRECTION that settles on the line of u1u_1, the dashed line of the solution figure.

e) With ss in the corner, det⁡(A−λI)=λ2−0.5λ−3s\det(A - \lambda I) = \lambda^2 - 0.5\lambda - 3s. The population is stationary in the long run when the dominant eigenvalue is exactly 11: 1−0.5−3s=01 - 0.5 - 3s = 0, so s=16s = \frac{1}{6}. Check that 11 really is dominant: the two roots add up to 0.50.5, so the other one is −0.5-0.5, smaller in absolute value. One juvenile in six must survive to adulthood; with one in two the colony grows, with fewer than one in six it dies out.

1234567812345v₀v₁v₂v₃v₄a = j/2juveniles (hundreds)adults (hundreds)

Exercise 7: A two-state Markov chain and its steady state

A bike-sharing network has two stations, Hilltop (HH) and Riverside (RR). Each bike is picked up once a day and returned to one of the two stations. Of the bikes taken at Hilltop, 8080 per cent come back to Hilltop and 2020 per cent end at Riverside; of those taken at Riverside, 3030 per cent end at Hilltop and 7070 per cent stay at Riverside. The figure is the transition diagram.

On the morning of day 00 all 500500 bikes are at Hilltop. Let xk=(hk,rk)x_k = (h_k, r_k) be the numbers of bikes at the two stations on the morning of day kk.

HR0.20.30.80.7HilltopRiverside
  • a) Write the transition matrix TT with xk+1=Txkx_{k+1} = Tx_k. What do its columns add up to, and why?
  • b) Show that 11 is an eigenvalue of TT without solving the characteristic equation, then get the other eigenvalue from the trace.
  • c) Diagonalize TT and give xkx_k as an explicit formula.
  • d) Give the steady state and the long-run share of each station. Show that it does not depend on how the 500500 bikes were placed on day 00.
  • e) From which day on does Riverside hold at least 190190 bikes?
Show the solution

Answers

  • a) T=(0.80.30.20.7)T = \begin{pmatrix} 0.8 & 0.3 \\ 0.2 & 0.7 \end{pmatrix}; each column adds up to 11
  • b) T−IT - I has rows adding to zero, so λ=1\lambda = 1; then λ2=1.5−1=0.5\lambda_2 = 1.5 - 1 = 0.5
  • c) P=(312−1)P = \begin{pmatrix} 3 & 1 \\ 2 & -1 \end{pmatrix}, D=diag(1,0.5)D = \text{diag}(1, 0.5), xk=(300+200(0.5)k,200−200(0.5)k)x_k = (300 + 200(0.5)^k, 200 - 200(0.5)^k)
  • d) (300,200)(300, 200): 6060 per cent at Hilltop, 4040 per cent at Riverside, for any start with 500500 bikes
  • e) From day 55 on

a) Column jj says where the bikes that start the day at station jj end up: T=(0.80.30.20.7)T = \begin{pmatrix} 0.8 & 0.3 \\ 0.2 & 0.7 \end{pmatrix}, so that hk+1=0.8hk+0.3rkh_{k+1} = 0.8h_k + 0.3r_k and rk+1=0.2hk+0.7rkr_{k+1} = 0.2h_k + 0.7r_k. Each column adds up to 11 because every bike ends the day SOMEWHERE: no bike is created or lost. Writing the probabilities along the rows instead gives the transpose, and xk+1=Txkx_{k+1} = Tx_k then produces nonsense; check on day 11: T(500,0)=(400,100)T(500, 0) = (400, 100), which adds up to 500500 as it must.

b) T−I=(−0.20.30.2−0.3)T - I = \begin{pmatrix} -0.2 & 0.3 \\ 0.2 & -0.3 \end{pmatrix}: its second row is minus its first, because each column of T−IT - I adds up to 1−1=01 - 1 = 0. So T−IT - I is singular and 11 is an eigenvalue, for EVERY matrix whose columns add up to 11. The trace is the sum of the eigenvalues: 0.8+0.7=1.5=1+λ20.8 + 0.7 = 1.5 = 1 + \lambda_2, so λ2=0.5\lambda_2 = 0.5. Check with the determinant: 0.56−0.06=0.5=1×0.50.56 - 0.06 = 0.5 = 1 \times 0.5.

c) For 11: −0.2h+0.3r=0-0.2h + 0.3r = 0, so u1=(3,2)u_1 = (3, 2). For 0.50.5: T−0.5I=(0.30.30.20.2)T - 0.5I = \begin{pmatrix} 0.3 & 0.3 \\ 0.2 & 0.2 \end{pmatrix} gives h+r=0h + r = 0, so u2=(1,−1)u_2 = (1, -1). Hence P=(312−1)P = \begin{pmatrix} 3 & 1 \\ 2 & -1 \end{pmatrix} and D=diag(1,0.5)D = \text{diag}(1, 0.5). Decompose x0x_0: c1(3,2)+c2(1,−1)=(500,0)c_1(3, 2) + c_2(1, -1) = (500, 0) gives, by adding the two coordinates, 5c1=5005c_1 = 500, so c1=100c_1 = 100 and c2=200c_2 = 200. Then xk=100(3,2)+200(0.5)k(1,−1)=(300+200(0.5)k,200−200(0.5)k)x_k = 100(3, 2) + 200(0.5)^k(1, -1) = (300 + 200(0.5)^k, 200 - 200(0.5)^k). Check: x1=(400,100)x_1 = (400, 100) and x2=(350,150)x_2 = (350, 150), while directly T(400,100)=(320+30,80+70)=(350,150)T(400, 100) = (320 + 30, 80 + 70) = (350, 150).

d) (0.5)k→0(0.5)^k \to 0, so xk→(300,200)x_k \to (300, 200): in the long run 6060 per cent of the bikes are at Hilltop and 4040 per cent at Riverside. The steady-state vector is the eigenvector for 11 SCALED to the total, (0.6,0.4)(0.6, 0.4) as proportions; quoting (3,2)(3, 2) as the answer is not a distribution. It does not depend on the start: the eigenvector (1,−1)(1, -1) adds up to 00, so the total of x0x_0 equals 5c15c_1, and a total of 500500 forces c1=100c_1 = 100 whatever the split. Only the transient term, which dies out, remembers where the bikes started.

e) rk≥190r_k \ge 190 means 200−200(0.5)k≥190200 - 200(0.5)^k \ge 190, that is (0.5)k≤0.05(0.5)^k \le 0.05, that is 2k≥202^k \ge 20. Since 24=162^4 = 16 and 25=322^5 = 32, this holds from k=5k = 5 on. On day 44 Riverside has 200−12.5=187.5200 - 12.5 = 187.5 bikes on average, on day 55 it has 200−6.25=193.75200 - 6.25 = 193.75. No calculator and no logarithm: the powers of 22 do the work.

Exercise 8: Five statements to correct

Each statement below was written by a student revising diagonalization for the MATH 133 final. Each is false as written. Say what is wrong, give the smallest counterexample that settles it, and write the correct statement.

  • a) "A matrix with a repeated eigenvalue cannot be diagonalized."
  • b) "A diagonalizable matrix is invertible, and an invertible matrix is diagonalizable."
  • c) "If P−1AP=DP^{-1}AP = D, then A=P−1DPA = P^{-1}DP."
  • d) "The long-run behaviour of vk+1=Avkv_{k+1} = Av_k depends only on the largest eigenvalue, never on v0v_0."
  • e) "If A2A^2 is diagonalizable, then so is AA."
Show the solution

Answers

  • a) False: I2I_2 has the double eigenvalue 11 and is diagonal
  • b) False both ways: diag(1,0)\text{diag}(1, 0) is diagonalizable and singular; (1101)\begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} is invertible and not diagonalizable
  • c) False: A=PDP−1A = PDP^{-1}; with P=(1101)P = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix}, D=diag(1,2)D = \text{diag}(1,2) the two products differ
  • d) False: with A=diag(2,0.5)A = \text{diag}(2, 0.5) and v0=(0,1)v_0 = (0, 1), vk→0v_k \to 0
  • e) False: N=(0100)N = \begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix} has N2=0N^2 = 0 diagonal, but NN is not diagonalizable

a) FALSE. The identity I2I_2 has the single eigenvalue 11, repeated twice, and it is already diagonal; so is the matrix AA of Exercise 1, with its double eigenvalue 33. A repeated eigenvalue is where diagonalizability CAN fail, not where it does. Correct statement: AA is diagonalizable if and only if, for each eigenvalue, dim⁡Eλ\dim E_\lambda equals its algebraic multiplicity; only the repeated eigenvalues need that test.

b) FALSE in both directions, because the two properties answer different questions. diag(1,0)\text{diag}(1, 0) is diagonal, so diagonalizable, and singular. (1101)\begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} has determinant 11, so it is invertible, and its double eigenvalue 11 has rank(A−I)=1\text{rank}(A - I) = 1, so dim⁡E1=1<2\dim E_1 = 1 < 2: not diagonalizable. Correct: invertibility asks whether 00 is an eigenvalue; diagonalizability asks whether there are enough eigenvectors. Neither implies the other.

c) FALSE: the PP and the P−1P^{-1} have changed sides. Multiply P−1AP=DP^{-1}AP = D on the left by PP and on the right by P−1P^{-1}: A=PDP−1A = PDP^{-1}. With P=(1101)P = \begin{pmatrix} 1 & 1 \\ 0 & 1 \end{pmatrix} and D=diag(1,2)D = \text{diag}(1, 2): PDP−1=(1102)PDP^{-1} = \begin{pmatrix} 1 & 1 \\ 0 & 2 \end{pmatrix} while P−1DP=(1−102)P^{-1}DP = \begin{pmatrix} 1 & -1 \\ 0 & 2 \end{pmatrix}. They differ, and only the first one has (1,1)(1,1), the second column of PP, as an eigenvector for 22. Correct: A=PDP−1A = PDP^{-1}, with the eigenvector matrix on the LEFT.

d) FALSE. Writing v0=c1u1+c2u2v_0 = c_1u_1 + c_2u_2, the dominant eigenvalue wins only if c1≠0c_1 \neq 0. With A=diag(2,0.5)A = \text{diag}(2, 0.5) and v0=(0,1)v_0 = (0, 1), c1=0c_1 = 0 and vk=(0,0.5k)→0v_k = (0, 0.5^k) \to 0, although the largest eigenvalue is 22. Correct: if ∣λ1∣|\lambda_1| is strictly the largest and the component of v0v_0 along u1u_1 is non-zero, then vkv_k behaves like c1λ1ku1c_1\lambda_1^ku_1. In real models the condition c1≠0c_1 \neq 0 is almost always true, which is why it is forgotten.

e) FALSE. N=(0100)N = \begin{pmatrix} 0 & 1 \\ 0 & 0 \end{pmatrix} has N2=(0000)N^2 = \begin{pmatrix} 0 & 0 \\ 0 & 0 \end{pmatrix}, which is diagonal. But NN has the double eigenvalue 00 and rank(N−0I)=1\text{rank}(N - 0I) = 1, so dim⁡E0=1<2\dim E_0 = 1 < 2: not diagonalizable. The TRUE direction is the other one: if A=PDP−1A = PDP^{-1} then A2=PD2P−1A^2 = PD^2P^{-1} with the same PP, so every power of a diagonalizable matrix is diagonalizable.

Exercise 9: Counting pavings: a recurrence solved by diagonalization

A garden path 22 units wide and nn units long is paved with two kinds of slabs: 1×21 \times 2 rectangles, laid either across the path or along it, and 2×22 \times 2 squares. Let tnt_n be the number of different pavings, with t0=1t_0 = 1 (the empty path) and t1=1t_1 = 1 (one slab across).

The figure shows the three pavings of a path of length 22. The recurrence behind this count is a cousin of Fibonacci's, and diagonalization turns it into an exact formula.

two acrosstwo alongone square
  • a) Explain why tn=tn−1+2tn−2t_n = t_{n-1} + 2t_{n-2} for n≥2n \ge 2, and compute t2t_2 to t5t_5.
  • b) With Vn=(tn,tn+1)V_n = (t_n, t_{n+1}), find the matrix AA such that Vn+1=AVnV_{n+1} = AV_n.
  • c) Diagonalize AA.
  • d) Deduce that tn=2n+1+(−1)n3t_n = \frac{2^{n+1} + (-1)^n}{3}, and check it for n=0n = 0 to 55.
  • e) Compute t10t_{10}, and explain why tn+1tn\frac{t_{n+1}}{t_n} tends to 22.
Show the solution

Answers

  • a) Last slab across, or a 2×22 \times 2 end block in two ways; t2=3t_2 = 3, t3=5t_3 = 5, t4=11t_4 = 11, t5=21t_5 = 21
  • b) A=(0121)A = \begin{pmatrix} 0 & 1 \\ 2 & 1 \end{pmatrix}
  • c) P=(112−1)P = \begin{pmatrix} 1 & 1 \\ 2 & -1 \end{pmatrix}, D=diag(2,−1)D = \text{diag}(2, -1)
  • d) V0=23(1,2)+13(1,−1)V_0 = \frac{2}{3}(1,2) + \frac{1}{3}(1,-1), first coordinate tn=2n+1+(−1)n3t_n = \frac{2^{n+1} + (-1)^n}{3}
  • e) t10=683t_{10} = 683; the ratio tends to the dominant eigenvalue 22

a) Look at the right end of the path. Either the last column is ONE slab laid across: what is left is a path of length n−1n - 1, paved in tn−1t_{n-1} ways. Or it is not: then the last column is covered by slabs that also cover the column before it, so the last 2×22 \times 2 block is filled either by two slabs along the path or by one square, two ways, and what is left has length n−2n - 2. The cases are disjoint and cover everything, so tn=tn−1+2tn−2t_n = t_{n-1} + 2t_{n-2}. Then t2=1+2=3t_2 = 1 + 2 = 3, the three pictures of the figure, t3=3+2=5t_3 = 3 + 2 = 5, t4=5+6=11t_4 = 5 + 6 = 11, t5=11+10=21t_5 = 11 + 10 = 21.

b) Vn+1=(tn+1,tn+2)=(tn+1,2tn+tn+1)V_{n+1} = (t_{n+1}, t_{n+2}) = (t_{n+1}, 2t_n + t_{n+1}), so the first new coordinate copies the old second one, and A=(0121)A = \begin{pmatrix} 0 & 1 \\ 2 & 1 \end{pmatrix}. Turning a recurrence of order two into a first-order system on a PAIR of consecutive terms is the whole trick of Nicholson 3.4.

c) det⁡(A−λI)=−λ(1−λ)−2=λ2−λ−2=(λ−2)(λ+1)\det(A - \lambda I) = -\lambda(1 - \lambda) - 2 = \lambda^2 - \lambda - 2 = (\lambda - 2)(\lambda + 1). For 22: A−2I=(−212−1)A - 2I = \begin{pmatrix} -2 & 1 \\ 2 & -1 \end{pmatrix}, and R2→R2+R1R_2 \to R_2 + R_1 leaves y=2xy = 2x, so (1,2)(1, 2). For −1-1: A+I=(1122)A + I = \begin{pmatrix} 1 & 1 \\ 2 & 2 \end{pmatrix}, and R2→R2−2R1R_2 \to R_2 - 2R_1 leaves x+y=0x + y = 0, so (1,−1)(1, -1). Hence P=(112−1)P = \begin{pmatrix} 1 & 1 \\ 2 & -1 \end{pmatrix}, D=diag(2,−1)D = \text{diag}(2, -1), det⁡P=−3\det P = -3.

d) V0=(1,1)=c1(1,2)+c2(1,−1)V_0 = (1, 1) = c_1(1, 2) + c_2(1, -1): adding the two equations c1+c2=1c_1 + c_2 = 1 and 2c1−c2=12c_1 - c_2 = 1 gives 3c1=23c_1 = 2, so c1=23c_1 = \frac{2}{3}, c2=13c_2 = \frac{1}{3}. Then Vn=AnV0=232n(1,2)+13(−1)n(1,−1)V_n = A^nV_0 = \frac{2}{3}2^n(1, 2) + \frac{1}{3}(-1)^n(1, -1), whose first coordinate is tn=2n+1+(−1)n3t_n = \frac{2^{n+1} + (-1)^n}{3}. Check: 2+13=1\frac{2+1}{3} = 1, 4−13=1\frac{4-1}{3} = 1, 8+13=3\frac{8+1}{3} = 3, 16−13=5\frac{16-1}{3} = 5, 32+13=11\frac{32+1}{3} = 11, 64−13=21\frac{64-1}{3} = 21. A formula for an integer sequence with a 33 in the denominator is believable only after this check: the numerator must always be a multiple of 33, and it is.

e) t10=211+13=20493=683t_{10} = \frac{2^{11} + 1}{3} = \frac{2049}{3} = 683, a number nobody would enumerate by hand. In the ratio tn+1tn=2n+2−(−1)n2n+1+(−1)n\frac{t_{n+1}}{t_n} = \frac{2^{n+2} - (-1)^n}{2^{n+1} + (-1)^n}, the terms ±1\pm 1 stay bounded while the powers of 22 explode, so the ratio tends to 22: the DOMINANT eigenvalue. The solution figure shows it: the points hug the curve 232n\frac{2}{3}2^n, alternately 13\frac{1}{3} above and below it, and that alternating gap is the eigenvalue −1-1 at work.

123456751015202530354045(2/3)·2ⁿ4321nnumber of pavings

Exercise 10: Foxes and hares: where the dominant eigenvalue crosses 1

In a predator and prey model, FkF_k is the number of foxes and HkH_k the number of hares, in hundreds, in year kk. Without hares the foxes would halve every year; without foxes the hares would grow by 1010 per cent a year. With xk=(Fk,Hk)x_k = (F_k, H_k) the model is xk+1=Axkx_{k+1} = Ax_k, where A=(0.50.4−p1.1)A = \begin{pmatrix} 0.5 & 0.4 \\ -p & 1.1 \end{pmatrix} and p>0p > 0 measures how many hares a fox eats.

Every characteristic polynomial below factors by hand. This is a final-exam question in its usual shape: diagonalize, then read the long run off the eigenvalues.

  • a) Take p=0.2p = 0.2. Diagonalize AA and describe what happens to both populations in the long run.
  • b) Find the value of pp for which 11 is an eigenvalue of AA.
  • c) Take p=0.125p = 0.125 and x0=(40,30)x_0 = (40, 30). Diagonalize AA and write xkx_k explicitly.
  • d) Give the limit of xkx_k and interpret it. Would another starting point lead to the same limit?
  • e) Without computing any eigenvector, explain what happens when pp is slightly below 0.1250.125.
Show the solution

Answers

  • a) λ=0.9\lambda = 0.9, (1,1)(1,1) and λ=0.7\lambda = 0.7, (2,1)(2,1): both populations die out, about 100100 hares per fox
  • b) p=0.125p = 0.125
  • c) P=(4451)P = \begin{pmatrix} 4 & 4 \\ 5 & 1 \end{pmatrix}, D=diag(1,0.6)D = \text{diag}(1, 0.6), xk=(20+20(0.6)k,25+5(0.6)k)x_k = (20 + 20(0.6)^k, 25 + 5(0.6)^k)
  • d) (20,25)(20, 25): 2020 foxes and 25002500 hares; another start gives another point of the line H=1.25FH = 1.25F
  • e) The dominant eigenvalue exceeds 11: both populations eventually grow

a) det⁡(A−λI)=(0.5−λ)(1.1−λ)+0.4p=λ2−1.6λ+0.55+0.4p\det(A - \lambda I) = (0.5 - \lambda)(1.1 - \lambda) + 0.4p = \lambda^2 - 1.6\lambda + 0.55 + 0.4p. With p=0.2p = 0.2: λ2−1.6λ+0.63=(λ−0.9)(λ−0.7)\lambda^2 - 1.6\lambda + 0.63 = (\lambda - 0.9)(\lambda - 0.7), since 0.9+0.7=1.60.9 + 0.7 = 1.6 and 0.9×0.7=0.630.9 \times 0.7 = 0.63. For 0.90.9: A−0.9I=(−0.40.4−0.20.2)A - 0.9I = \begin{pmatrix} -0.4 & 0.4 \\ -0.2 & 0.2 \end{pmatrix} gives F=HF = H, so (1,1)(1, 1). For 0.70.7: A−0.7I=(−0.20.4−0.20.4)A - 0.7I = \begin{pmatrix} -0.2 & 0.4 \\ -0.2 & 0.4 \end{pmatrix} gives F=2HF = 2H, so (2,1)(2, 1). P=(1211)P = \begin{pmatrix} 1 & 2 \\ 1 & 1 \end{pmatrix}, D=diag(0.9,0.7)D = \text{diag}(0.9, 0.7). Then xk=c10.9k(1,1)+c20.7k(2,1)→(0,0)x_k = c_10.9^k(1, 1) + c_20.7^k(2, 1) \to (0, 0): both species die out. The slower factor 0.90.9 dominates, so the decline settles at 1010 per cent a year with Fk≈HkF_k \approx H_k, one fox per hundred hares, all the way down.

b) 11 is an eigenvalue exactly when A−IA - I is singular: det⁡(A−I)=(−0.5)(0.1)+0.4p=0\det(A - I) = (-0.5)(0.1) + 0.4p = 0, so 0.4p=0.050.4p = 0.05 and p=0.125p = 0.125. No need to solve the quadratic: the definition of an eigenvalue IS the singularity test.

c) p=0.125p = 0.125: λ2−1.6λ+0.6=(λ−1)(λ−0.6)\lambda^2 - 1.6\lambda + 0.6 = (\lambda - 1)(\lambda - 0.6). For 11: A−I=(−0.50.4−0.1250.1)A - I = \begin{pmatrix} -0.5 & 0.4 \\ -0.125 & 0.1 \end{pmatrix} gives 5F=4H5F = 4H, so (4,5)(4, 5). For 0.60.6: A−0.6I=(−0.10.4−0.1250.5)A - 0.6I = \begin{pmatrix} -0.1 & 0.4 \\ -0.125 & 0.5 \end{pmatrix} gives F=4HF = 4H, so (4,1)(4, 1). P=(4451)P = \begin{pmatrix} 4 & 4 \\ 5 & 1 \end{pmatrix}, D=diag(1,0.6)D = \text{diag}(1, 0.6). Decompose x0x_0: c1(4,5)+c2(4,1)=(40,30)c_1(4, 5) + c_2(4, 1) = (40, 30); the first coordinate gives c1+c2=10c_1 + c_2 = 10, the second 5c1+c2=305c_1 + c_2 = 30, so c1=5c_1 = 5 and c2=5c_2 = 5. Hence xk=5(4,5)+5(0.6)k(4,1)=(20+20(0.6)k,25+5(0.6)k)x_k = 5(4, 5) + 5(0.6)^k(4, 1) = (20 + 20(0.6)^k, 25 + 5(0.6)^k). Check k=1k = 1: the formula gives (32,28)(32, 28) and directly (0.5×40+0.4×30,−0.125×40+1.1×30)=(32,28)(0.5 \times 40 + 0.4 \times 30, -0.125 \times 40 + 1.1 \times 30) = (32, 28).

d) (0.6)k→0(0.6)^k \to 0, so xk→(20,25)x_k \to (20, 25): 2020 foxes and 25002500 hares, a stable coexistence. The solution figure shows the approach: the points slide toward the limit along the direction (4,1)(4, 1) of the eigenvalue 0.60.6, while the dashed line H=1.25FH = 1.25F is the line of eigenvalue 11, every point of which is a fixed point. So another starting point gives another limit, c1(4,5)c_1(4, 5), with the SAME ratio of 125125 hares per fox. Compare with a Markov chain, where the total is conserved and fixes c1c_1; nothing is conserved here.

e) Write q(λ)=λ2−1.6λ+0.55+0.4pq(\lambda) = \lambda^2 - 1.6\lambda + 0.55 + 0.4p. Then q(1)=−0.05+0.4pq(1) = -0.05 + 0.4p, which is NEGATIVE when p<0.125p < 0.125. The parabola qq opens upward and is positive for large λ\lambda, so it crosses zero somewhere beyond 11: the dominant eigenvalue is greater than 11. Then c1λ1kc_1\lambda_1^k grows, and both populations eventually increase together in the proportions of the dominant eigenvector. The value p=0.125p = 0.125 is the knife edge between extinction and growth, and the whole analysis came from the sign of one number.

510152025303540455101520253035x₀x₁limit (20, 25)H = 1.25Ffoxes Fhares H (hundreds)

See also

Struggling with MATH 133?

I tutor first-year linear algebra at McGill University and Concordia University, in English or in French, in Montreal or online. Get in touch for a first session.

Site by Studio Squalli