Documentation

IntroductoryLecturesOnConvexOptimization_Nesterov_2004.Chap02.Definition_2_35

Statements

Source excerpts; proofs omitted. recall restates an existing declaration; #check records an expression, not its inferred type.

Definition 2.35: the textbook gradient mapping and reduced gradient are represented by the canonical owner declarations gradientMapping and reducedGradient. The point gradientMapping Q hQ_nonempty hQ_closed hQ_convex f xBar γ is the unique minimizer of the quadratically regularized first-order Taylor model over Q, and reducedGradient Q hQ_nonempty hQ_closed hQ_convex f xBar γ is the scaled residual γ • (xBar - gradientMapping Q hQ_nonempty hQ_closed hQ_convex f xBar γ).

recall gradientMapping
    {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E]
    (Q : Set E) (hQ_nonempty : Q.Nonempty)
    (hQ_closed : IsClosed Q) (hQ_convex : Convex ℝ Q)
    (f : E → ℝ) (xBar : E) (γ : NNRealˣ) :
    E

Lean source

Source context
open scoped Gradient ProjectedGradient
universe u
variable {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E]
recall reducedGradient
    {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E]
    (Q : Set E) (hQ_nonempty : Q.Nonempty)
    (hQ_closed : IsClosed Q) (hQ_convex : Convex ℝ Q)
    (f : E → ℝ) (xBar : E) (γ : NNRealˣ) :
    E

Lean source

Source context
open scoped Gradient ProjectedGradient
universe u
variable {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E]

Module source

theorem gradientMapping_minimizes_objective {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {Q : Set E} (hQ_nonempty : Q.Nonempty) (hQ_closed : IsClosed Q) (hQ_convex : Convex ℝ Q) {f : E → ℝ} {xBar : E} {γ : NNRealˣ} :
gradientMapping Q hQ_nonempty hQ_closed hQ_convex f xBar γ ∈ Q ∧ IsMinOn (quadraticallyRegularizedObjective (firstOrderTaylorModelAt f xBar) (↑↑γ) xBar) Q (gradientMapping Q hQ_nonempty hQ_closed hQ_convex f xBar γ)

The projected-gradient point belongs to Q and minimizes the quadratically regularized first-order Taylor model from Definition 2.35 over Q.