Operator norm: submultiplicativity and comparison with Frobenius
Statement
Let be the operator norm. Show that and that
Hint
Use the basic inequality for all .
For the two comparisons, write using the rows of , and using the columns of .
Show solutionHide solution
Solution
Idea. Submultiplicativity follows from applying the definition twice. The comparison with uses Cauchy-Schwarz in one direction and a sum over the unit vectors in the other.
Step 1: the basic inequality. By definition of the supremum, for we have (and it is trivial for ).
Step 2: submultiplicativity. For every , . Taking the supremum over unit gives .
Step 3: . Let be the rows of . Then and by Cauchy-Schwarz
Take and the supremum.
Step 4: . The columns of are the vectors . Hence
Remark. Both bounds are sharp: the first is an equality for rank-one matrices, the second for orthogonal matrices (see the problem on the best constants). One consequence, used constantly: is controlled by the entries, e.g. .