线性代数 · free preview

MIT 18.06 Problem Set 10

Gram-Schmidt orthogonalization, the singular value decomposition and Fourier series.

1. MIT 18.06 Problem Set 10 — how this assessment works

This lesson reproduces the Problem Set “MIT 18.06 Problem Set 10” from MIT OpenCourseWare 18.06 Linear Algebra (Spring 2010) (https://ocw.mit.edu/courses/18-06-linear-algebra-spring-2010/), licensed under CC BY-NC-SA 4.0. Work through 13 problems in order: type your reasoning in the answer box or write it on the handwriting pad, then submit for AI grading.

How the grading works Every problem is graded by an AI mathematics teacher that reads the official solution shipped with the course. It checks your work criterion by criterion, awards partial credit for correct steps, and returns written feedback. Equivalent mathematics and valid alternative methods are accepted — a different route to the same result can still earn full marks.

If your answer is incomplete, the feedback names exactly which steps are missing, so you can correct them and try again.

2. MIT 18.06 PSET10 Problem 1 — Jordan blocks of different sizes are not similar (4 pts)

These Jordan matrices have eigenvalues 0,0,0,00, 0, 0, 0. They have two eigenvectors (one from each block). But the block sizes don't match and they are not similar:

J=(0100000000010000)andK=(0100001000000000)J=(\begin{array}{cc|cc} 0 & 1 & 0 & 0 \\ 0 & 0 & 0 & 0 \\ \hline 0 & 0 & 0 & 1 \\ 0 & 0 & 0 & 0 \end{array}) \qquad \text{and} \qquad K=(\begin{array}{ccc|c} 0 & 1 & 0 & 0 \\ 0 & 0 & 1 & 0 \\ 0 & 0 & 0 & 0 \\ \hline 0 & 0 & 0 & 0 \end{array})

For any matrix MM, compare JMJM with MKMK. If they are equal show that MM is not invertible. Then M−1JM=KM^{-1}JM=K is impossible; JJ is not similar to KK.

3. MIT 18.06 PSET10 Problem 2 — A transpose is always similar to A (4 pts)

Prove that ATA^T is always similar to AA (we know that the λ\lambda's are the same):

  1. For one Jordan block JiJ_i: find MiM_i so that Mi−1JiMi=JiTM_i^{-1}J_iM_i=J_i^T (see example 3).
  2. For any JJ with blocks JiJ_i: build M0M_0 from blocks so that M0−1JM0=JTM_0^{-1}JM_0=J^T.
  3. For any A=MJM−1A=MJM^{-1}: Show that ATA^T is similar to JTJ^T and so to JJ and so to AA.

4. MIT 18.06 PSET10 Problem 3 — Five true statements about similarity (4 pts)

Why are these statements all true?

(a) If AA is similar to BB then A2A^2 is similar to B2B^2.

(b) A2A^2 and B2B^2 can be similar when AA and BB are not similar.

(c) (3004)\begin{pmatrix} 3 & 0 \\ 0 & 4 \end{pmatrix} is similar to (3104)\begin{pmatrix} 3 & 1 \\ 0 & 4 \end{pmatrix}.

(d) (3003)\begin{pmatrix} 3 & 0 \\ 0 & 3 \end{pmatrix} is not similar to (3103)\begin{pmatrix} 3 & 1 \\ 0 & 3 \end{pmatrix}.

(e) If we exchange rows 1 and 2 of AA, and then exchange columns 1 and 2 the eigenvalues stay the same. In this case M=?M=?

5. MIT 18.06 PSET10 Problem 4 — All eigenvalues zero implies A^n is the zero matrix (12 pts)

If an n×nn \times n matrix AA has all eigenvalues λ=0\lambda=0 prove that AnA^n is the zero matrix.

6. MIT 18.06 PSET10 Problem 5 — Shifted QR: A_2 is similar to A_1 (12 pts)

For the shifted QRQR method in the Worked Example 6.6 B, show that A2A_2 is similar to A1A_1. No change in eigenvalues, and the AA's quickly approach a diagonal matrix.

7. MIT 18.06 PSET10 Problem 6 — Similar to its own inverse (12 pts)

If AA is similar to A−1A^{-1}, must all the eigenvalues equal 11 or −1-1?

8. MIT 18.06 PSET10 Problem 7 — SVD of the Fibonacci matrix (4 pts)

Find the eigenvalues and unit eigenvectors of ATAA^T A and AATAA^T. Keep each Av=σuAv=\sigma u for the Fibonacci matrix A=(1110)A=\begin{pmatrix} 1 & 1 \\ 1 & 0 \end{pmatrix}. Construct the singular value decomposition and verify that AA equal sUΣVTsU\Sigma V^T.

9. MIT 18.06 PSET10 Problem 8 — SVD when the columns are orthogonal (4 pts)

Suppose AA has orthogonal columns w1,…,wnw_1, \ldots, w_n of lengths σ1,…,σn\sigma_1, \ldots, \sigma_n. What are U,ΣU, \Sigma and VV in the SVD?

10. MIT 18.06 PSET10 Problem 9 — SVD of the 4 by 3 first difference matrix (12 pts)

The 1,−11,-1 first difference matrix AA has ATAA^T A the second difference matrix. The singular vectors of AA are sine vectors VV and cosine vectors uu. Then Av=σuAv=\sigma u is the discrete form of d/dx(sin⁡cx)=c(cos⁡cx)d/dx(\sin cx)=c(\cos cx). This is the best SVD I have seen.

A=(100−1100−1100−1)ATA=(2−10−12−10−12).A=(\begin{array}{ccc} 1 & 0 & 0 \\ -1 & 1 & 0 \\ 0 &-1 & 1 \\ 0 & 0 &-1 \end{array}) \qquad A^T A=(\begin{array}{ccc} 2 &-1 & 0 \\ -1 & 2 &-1 \\ 0 &-1 & 2 \end{array}).

Then the orthogonal sine matrix is

V=12(sin⁡π/4sin⁡2π/4sin⁡3π/4sin⁡2π/4sin⁡4π/4sin⁡6π/4sin⁡3π/4sin⁡6π/4sin⁡9π/4).V=\frac{1}{\sqrt{2}} (\begin{array}{ccc} \sin \pi/4 & \sin 2\pi/4 & \sin 3\pi/4 \\ \sin 2\pi/4 & \sin 4\pi/4 & \sin 6\pi/4 \\ \sin 3\pi/4 & \sin 6\pi/4 & \sin 9\pi/4 \end{array}).

(a) Put numbers in VV: The unit eigenvectors of ATAA^T A are singular vectors of AA. Show that the columns of VV have ATAv=λvA^T Av=\lambda v with λ=2−2,2,2+2\lambda=2-\sqrt{2}, 2, 2+\sqrt{2}.

(b) Multiply AVAV and verify taht its columns are orthogonal. They are σ1u1\sigma_1u_1 and σ2u2\sigma_2u_2 and σ3u3\sigma_3u_3. The first columns of the cosine matrix UU are u1,u2,u3u_1, u_2, u_3.

(c) Since AA is 4×34 \times 3 weneed a fourth orthogonal vector u4u_4. It comes from the nullspace of ATA^T. What is u4u_4?

11. MIT 18.06 PSET10 Problem 10 — The fourth Legendre polynomial (4 pts)

The first three Legendre polynomials are 1,x,x2−1/31, x, x^2-1/3. Choose cc so that the fourth polynomial x3−cxx^3-cx is orthogonal to the first three. All integrals go from −1-1 to 11.

12. MIT 18.06 PSET10 Problem 11 — Square wave: three Fourier integrals (4 pts)

For the square wave f(x)f(x) in Example 3 show that

∫02πf(x)cos⁡x dx=0∫02πf(x)sin⁡x dx=4∫02πf(x)sin⁡2x dx=0.\int_0^{2\pi} f(x) \cos x \, dx=0 \qquad \int_0^{2\pi} f(x) \sin x \, dx=4 \qquad \int_0^{2\pi} f(x) \sin 2x \, dx=0.

Which three Fourier coefficients come from those integrals?

13. MIT 18.06 PSET10 Problem 12 — The 5 by 5 differentiation matrix (12 pts)

The functions 1,cos⁡x,sin⁡x,cos⁡2x,sin⁡2x,…1, \cos x, \sin x, \cos 2x, \sin 2x, \ldots are a basis for a Hilberts space. Write the derivatives of those first five functions as combinations of the same five functions. What is the 5×55 \times 5 “differentiation matrix” for those functions?

14. MIT 18.06 PSET10 Problem 13 — Square pulse approaching a delta function (12 pts)

Find the Fourier coefficients aka_k and bkb_k of the square pulse F(x)F(x) centered at x=0x=0: f(x)=1/hf(x)=1/h for ∣x∣≤h/2|x| \le h/2 and F(x)=0F(x)=0 for h/2<∣x∣≤πh/2 < |x| \le \pi. As h→0h \to 0, this F(x)F(x) approaches a delta function. Find the limits of aka_k and bkb_k.

Practice this interactively

Free account · instant grading · spaced review that schedules itself.

Start this course for free