The operator norm via the largest eigenvalue of Aáµ€A
Statement
Show that is the largest eigenvalue of , and that , where are the singular values of (the square roots of the eigenvalues of ).
Hint
Write and note that is symmetric positive semi-definite.
Diagonalise in an orthonormal basis to compute the maximum of over unit vectors.
Show solutionHide solution
Solution
Idea. The quantity is a quadratic form in with matrix ; the maximum of a quadratic form on the unit sphere is the largest eigenvalue of its (symmetric) matrix.
Step 1: is symmetric PSD. , and . So the spectral theorem gives an orthonormal eigenbasis with eigenvalues (non-negative since ).
Step 2: maximum of the quadratic form. Write with . Then
with equality for . Hence , so .
Step 3: Frobenius norm. and the trace of a symmetric matrix is the sum of its eigenvalues. So .
Remark. Consequently , which reproves the comparison of the two norms, with equality cases visible: iff only one singular value is non-zero (rank ), and iff all singular values are equal (multiples of orthogonal matrices).