The orthogonal matrix nearest to a given matrix
Statement
Let have singular values and SVD . Show that
attained at , which is the orthogonal factor of a polar decomposition of . If is invertible, this minimiser is unique.
Hint
Expand and note .
Insert the SVD in the trace and set .
Show solutionHide solution
Solution
Idea. Minimising the distance is the same as maximising , which becomes for an orthogonal matrix .
Step 1: expansion. With ,
using and .
Step 2: the trace. By cyclicity of the trace,
Step 3: bound. Every entry of an orthogonal matrix satisfies (columns are unit vectors). Since ,
with equality when , that is .
Step 4: the minimum.
Step 5: polar factor. , with symmetric PSD: the orthogonal factor is .
Step 6: uniqueness for invertible . All , so equality forces for every . A unit column with a in position is , so and is the only minimiser.
Numeric check. For a random matrix, , and the best of 2000 random orthogonal matrices gave .
Remark. This is the *orthogonal Procrustes problem*. For a singular the minimiser may be non-unique (e.g. : every is at distance ). Consequently the nearest-orthogonal map is continuous on but not on all of .