Summary of constrained optimization
Statement
Summarize the key methods for constrained optimization.
Hint
Review critical points, Hessian, Lagrange, boundary.
Show solutionHide solution
Solution
Unconstrained critical points.
- Solve .
- Classify via the Hessian: positive definite (min), negative definite (max), indefinite (saddle).
Lagrange multipliers. For under : , plus the constraint.
Boundary. Parameterize or restrict to the boundary surface; combine with interior results.
Compact sets. If the set is compact, global extrema exist; check interior, boundary, and corners.
KKT for inequalities. For : Lagrange with nonnegativity conditions.
Examples. Circles, lines, ellipsoids, quadratics, multi-constraint problems.
Conclusion. Constrained optimization reduces to finding critical points of the Lagrangian and evaluating on boundaries.