Maths WorkshopMaths problems with full solutions
Exercise 2052Topology › Topology of Mn(ℝ) › Continuity of matrix mapsM1Added 7 Nov 2026

The orthogonal matrix nearest to a given matrix

#orthogonal Procrustes#SVD#Frobenius norm#polar decomposition

Statement

Let A∈Mn(R)A\in M_n(\mathbb{R}) have singular values σ1,…,σn\sigma_1,\dots,\sigma_n and SVD A=UΣVTA=U\Sigma V^T. Show that
min⁡Q∈O(n)∥A−Q∥F2=∑i=1n(σi−1)2,\min_{Q\in O(n)}\|A-Q\|_F^2=\sum_{i=1}^n(\sigma_i-1)^2,
attained at Q=UVTQ=UV^T, which is the orthogonal factor of a polar decomposition of AA. If AA is invertible, this minimiser is unique.

Hint

Expand ∥A−Q∥F2=∥A∥F2−2tr⁡(QTA)+∥Q∥F2\|A-Q\|_F^2=\|A\|_F^2-2\operatorname{tr}(Q^TA)+\|Q\|_F^2 and note ∥Q∥F2=n\|Q\|_F^2=n.

Insert the SVD in the trace and set W=VTQTUW=V^TQ^TU.

Show solutionHide solution

Solution

Idea. Minimising the distance is the same as maximising tr⁡(QTA)\operatorname{tr}(Q^TA), which becomes ∑σiWii\sum\sigma_iW_{ii} for an orthogonal matrix WW.

Step 1: expansion. With ⟨X,Y⟩=tr⁡(XTY)\langle X,Y\rangle=\operatorname{tr}(X^TY),
∥A−Q∥F2=∥A∥F2−2tr⁡(QTA)+∥Q∥F2=∑iσi2−2tr⁡(QTA)+n,\|A-Q\|_F^2=\|A\|_F^2-2\operatorname{tr}(Q^TA)+\|Q\|_F^2=\sum_i\sigma_i^2-2\operatorname{tr}(Q^TA)+n,
using ∥A∥F2=∑σi2\|A\|_F^2=\sum\sigma_i^2 and ∥Q∥F2=tr⁡(QTQ)=n\|Q\|_F^2=\operatorname{tr}(Q^TQ)=n.

Step 2: the trace. By cyclicity of the trace,
tr⁡(QTA)=tr⁡(QTUΣVT)=tr⁡(VTQTU Σ)=tr⁡(WΣ)=∑iσiWii,W:=VTQTU∈O(n).\operatorname{tr}(Q^TA)=\operatorname{tr}(Q^TU\Sigma V^T)=\operatorname{tr}(V^TQ^TU\,\Sigma)=\operatorname{tr}(W\Sigma)=\sum_i\sigma_iW_{ii},\qquad W:=V^TQ^TU\in O(n).

Step 3: bound. Every entry of an orthogonal matrix satisfies ∣Wii∣≤1|W_{ii}|\le1 (columns are unit vectors). Since σi≥0\sigma_i\ge0,
tr⁡(QTA)≤∑iσi,\operatorname{tr}(Q^TA)\le\sum_i\sigma_i,
with equality when W=IW=I, that is VTQTU=I  ⟺  Q=UVTV^TQ^TU=I\iff Q=UV^T.

Step 4: the minimum.
min⁡Q∥A−Q∥F2=∑σi2−2∑σi+n=∑(σi−1)2.\min_Q\|A-Q\|_F^2=\sum\sigma_i^2-2\sum\sigma_i+n=\sum(\sigma_i-1)^2.

Step 5: polar factor. A=UΣVT=(UVT)(VΣVT)A=U\Sigma V^T=(UV^T)(V\Sigma V^T), with VΣVTV\Sigma V^T symmetric PSD: the orthogonal factor is UVTUV^T.

Step 6: uniqueness for invertible AA. All σi>0\sigma_i>0, so equality forces Wii=1W_{ii}=1 for every ii. A unit column with a 11 in position ii is eie_i, so W=IW=I and Q=UVTQ=UV^T is the only minimiser.

Numeric check. For a random 4×44\times4 matrix, ∥A−UVT∥F2=2.2953=∑(σi−1)2\|A-UV^T\|_F^2=2.2953=\sum(\sigma_i-1)^2, and the best of 2000 random orthogonal matrices gave 3.41>2.2953.41>2.295.

Remark. This is the *orthogonal Procrustes problem*. For a singular AA the minimiser may be non-unique (e.g. A=0A=0: every QQ is at distance n\sqrt n). Consequently the nearest-orthogonal map is continuous on GLnGL_n but not on all of MnM_n.