Existence of a closest matrix of rank at most r
Statement
Let be any norm on , and . Show that there exists with such that
Hint
Show that is closed and restrict the minimisation to a compact subset.
Show solutionHide solution
Solution
Closedness of . iff all minors of size vanish. Minors are polynomials in the entries, hence continuous, and is an intersection of zero sets of continuous functions, so it is closed. (For , .)
Reduction to a compact set. , so the minimum, if it exists, is at most . Consider
This is closed (closed closed ball) and bounded, so it is compact since . If , then and
so such a is worse than .
Existence. is continuous, so it attains its minimum on the nonempty compact set , at some . By the previous paragraph is a minimiser on all of .
Remark. Existence holds for every norm, but uniqueness may fail (for the operator norm there are many best rank- approximations when or even in general). For the Frobenius and operator norms the minimum is explicit: see the Eckart-Young problem. The statement is false for the *set of rank exactly * matrices, which is not closed.