Maths WorkshopMaths problems with full solutions
Exercise 2070Calculus › Multivariable calculus › Optimisation in several variablesOlympiadAdded 2 Nov 2026

Rayleigh quotient and eigenvalues

#Rayleigh quotient#eigenvalues#optimisation on the sphere

Statement

Let AA be a real symmetric n×nn \times n matrix. Show that the maximum of
R(x)=xTAxxTxR(x) = \frac{x^T A x}{x^T x}
over Rn∖{0}\mathbb{R}^n \setminus \{0\} is the largest eigenvalue of AA, attained at an associated eigenvector.

Hint

Apply Lagrange to f(x)=xTAxf(x) = x^T A x under the constraint xTx=1x^T x = 1. The condition ∇f=λ∇g\nabla f = \lambda \nabla g gives Ax=λxAx = \lambda x.

Show solutionHide solution

Solution

Lagrange. Maximize f(x)=xTAxf(x) = x^T A x under g(x)=xTx=1g(x) = x^T x = 1. The gradients are
∇f=2Ax,∇g=2x.\nabla f = 2Ax, \qquad \nabla g = 2x.
The condition ∇f=λ∇g\nabla f = \lambda \nabla g gives
Ax=λx.Ax = \lambda x.
So xx is an eigenvector of AA associated with the eigenvalue λ\lambda.

Value at a critical point. If Ax=λxAx = \lambda x, then
f(x)=xTAx=xT(λx)=λxTx=λ.f(x) = x^T A x = x^T (\lambda x) = \lambda x^T x = \lambda.
So the maximum of ff on the sphere is the largest eigenvalue λmax⁡\lambda_{\max}.

Rayleigh quotient. For x≠0x \neq 0, R(x)=f(x/∥x∥)R(x) = f(x/\|x\|), so the maximum of RR over Rn∖{0}\mathbb{R}^n \setminus \{0\} is also λmax⁡\lambda_{\max}.

Conclusion. The maximum is attained at a unit eigenvector associated with λmax⁡\lambda_{\max}.