Maths WorkshopMaths problems with full solutions
Exercise 656Topology › Topology of Mn(ℝ) › Rank, spectrum and normsL2Added 6 Nov 2026

Existence of a closest matrix of rank at most r

#low rank approximation#compactness#coercivity

Statement

Let NN be any norm on Mn(R)M_n(\mathbb{R}), A∈Mn(R)A\in M_n(\mathbb{R}) and 0≤r≤n0\le r\le n. Show that there exists B0B_0 with rank⁡B0≤r\operatorname{rank}B_0\le r such that
N(A−B0)=min⁡{N(A−B):rank⁡B≤r}.N(A-B_0)=\min\{N(A-B):\operatorname{rank}B\le r\}.

Hint

Show that Rr={rank⁡≤r}\mathcal{R}_r=\{\operatorname{rank}\le r\} is closed and restrict the minimisation to a compact subset.

Show solutionHide solution

Solution

Closedness of Rr\mathcal{R}_r. rank⁡B≤r\operatorname{rank}B\le r iff all minors of size r+1r+1 vanish. Minors are polynomials in the entries, hence continuous, and Rr\mathcal{R}_r is an intersection of zero sets of continuous functions, so it is closed. (For r=nr=n, Rr=Mn(R)\mathcal{R}_r=M_n(\mathbb{R}).)

Reduction to a compact set. 0∈Rr0\in\mathcal{R}_r, so the minimum, if it exists, is at most N(A)N(A). Consider
K=Rr∩{B:N(B)≤2N(A)}.K=\mathcal{R}_r\cap\{B:N(B)\le2N(A)\}.
This is closed (closed ∩\cap closed ball) and bounded, so it is compact since Mn(R)≅Rn2M_n(\mathbb{R})\cong\mathbb{R}^{n^2}. If B∈Rr∖KB\in\mathcal{R}_r\setminus K, then N(B)>2N(A)N(B)>2N(A) and
N(A−B)≥N(B)−N(A)>N(A)=N(A−0),N(A-B)\ge N(B)-N(A)>N(A)=N(A-0),
so such a BB is worse than B=0∈KB=0\in K.

Existence. B↦N(A−B)B\mapsto N(A-B) is continuous, so it attains its minimum on the nonempty compact set KK, at some B0B_0. By the previous paragraph B0B_0 is a minimiser on all of Rr\mathcal{R}_r.

Remark. Existence holds for every norm, but uniqueness may fail (for the operator norm there are many best rank-rr approximations when σr+1=σr+2\sigma_{r+1}=\sigma_{r+2} or even in general). For the Frobenius and operator norms the minimum is explicit: see the Eckart-Young problem. The statement is false for the *set of rank exactly rr* matrices, which is not closed.