Documentation

IntroductoryLecturesOnConvexOptimization_Nesterov_2004.Chap01.Definition_1_6_5

def IsGStar {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] (f : E β†’ ℝ) (L : NNReal) :

Definition 1.6.5 (1): an objective f : E β†’ ℝ belongs to the textbook class 𝒒_* when f ∈ C^{1,1}_L and f is bounded below. Specializing E to ℝⁿ recovers the textbook formulation.

Instances For
    Instances For
      @[simp]
      theorem isGStar_iff {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] (f : E β†’ ℝ) (L : NNReal) :
      f ∈ {f : E β†’ ℝ | IsGStar f L} ↔ ContDiff ℝ 1 f ∧ LipschitzWith L (gradient f) ∧ BddBelow (Set.range f)

      Unfolding f ∈ 𝒒⋆[L] gives the canonical conjunction of C^{1,1}_L regularity and lower boundedness.

      theorem IsGStar.contDiff {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {f : E β†’ ℝ} {L : NNReal} (h : f ∈ {f : E β†’ ℝ | IsGStar f L}) :
      ContDiff ℝ 1 f

      Membership in 𝒒_* supplies the CΒΉ regularity component of the objective.

      theorem IsGStar.gradient_lipschitz {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {f : E β†’ ℝ} {L : NNReal} (h : f ∈ {f : E β†’ ℝ | IsGStar f L}) :
      LipschitzWith L (gradient f)

      Membership in 𝒒_* supplies the global L-Lipschitz bound on the gradient.

      theorem IsGStar.bddBelow {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {f : E β†’ ℝ} {L : NNReal} (h : f ∈ {f : E β†’ ℝ | IsGStar f L}) :
      BddBelow (Set.range f)

      Membership in 𝒒_* supplies lower boundedness of the objective values.

      theorem IsGStar.differentiableAt {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {f : E β†’ ℝ} {L : NNReal} (h : f ∈ {f : E β†’ ℝ | IsGStar f L}) (x : E) :
      DifferentiableAt ℝ f x

      Membership in 𝒒_* supplies ordinary differentiability at every point.

      theorem IsGStar.hasGradientAt {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] {f : E β†’ ℝ} {L : NNReal} (h : f ∈ {f : E β†’ ℝ | IsGStar f L}) (x : E) :
      HasGradientAt f (gradient f x) x

      Membership in 𝒒_* makes the displayed totalized gradient the genuine gradient.

      def IsEpsilonSolution {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] (f : E β†’ ℝ) (x0 : E) (Ξ΅ : ℝ) (xBar : E) :

      A point xΜ„ is an Ξ΅-solution for an objective f relative to the starting point xβ‚€ when f(xΜ„) ≀ f(xβ‚€) and β€–βˆ‡ f(xΜ„)β€– ≀ Ξ΅. This source-facing stopping predicate lives on the plain objective f : E β†’ ℝ; when f ∈ 𝒒⋆[L], the displayed gradient is source-faithful by IsGStar.hasGradientAt. Specializing E to ℝⁿ recovers the textbook formulation.

      Instances For
        @[simp]
        theorem isEpsilonSolution_iff {E : Type u} [NormedAddCommGroup E] [InnerProductSpace ℝ E] [CompleteSpace E] (f : E β†’ ℝ) (x0 xBar : E) (Ξ΅ : ℝ) :
        IsEpsilonSolution f x0 Ξ΅ xBar ↔ f xBar ≀ f x0 ∧ β€–gradient f xBarβ€– ≀ Ξ΅

        Unfolding IsEpsilonSolution f xβ‚€ Ξ΅ xΜ„ gives the textbook conditions f(xΜ„) ≀ f(xβ‚€) and β€–βˆ‡ f(xΜ„)β€– ≀ Ξ΅.

        noncomputable def gStarProblemClass (n : β„•) (L : NNReal) (Ξ΅ : ℝ) :
        BlackBoxOptimizationProblemClass (EuclideanSpace ℝ (Fin n)) (ℝ Γ— EuclideanSpace ℝ (Fin n)) ({ f : EuclideanSpace ℝ (Fin n) β†’ ℝ // f ∈ {f : EuclideanSpace ℝ (Fin n) β†’ ℝ | IsGStar f L} } Γ— EuclideanSpace ℝ (Fin n) Γ— EuclideanSpace ℝ (Fin n))

        Definition 1.6.5 (2): the textbook class 𝒒_* at accuracy threshold Ξ΅, viewed as a Chapter 1 black-box optimization problem class. Its model is the subtype of lower-bounded unconstrained C^{1,1}_L(ℝⁿ) objectives, its oracle is the canonical first-order answer map x ↦ (f x, βˆ‡ f x), and its stopping criterion accepts exactly the triples (f, xβ‚€, xΜ„) for which xΜ„ is an Ξ΅-solution for the model objective f relative to xβ‚€.

        Instances For
          @[simp]
          theorem gStarProblemClass_stops_iff {L : NNReal} {n : β„•} {Ξ΅ : ℝ} (f : { f : EuclideanSpace ℝ (Fin n) β†’ ℝ // f ∈ {f : EuclideanSpace ℝ (Fin n) β†’ ℝ | IsGStar f L} }) (x0 xBar : EuclideanSpace ℝ (Fin n)) :
          (f, x0, xBar) ∈ (gStarProblemClass n L Ξ΅).stoppingCriterion ↔ IsEpsilonSolution (↑f) x0 Ξ΅ xBar

          A state is accepted by gStarProblemClass n L Ξ΅ exactly when its endpoint is an Ξ΅-solution for the model objective relative to its starting point.

          @[simp]
          theorem gStarProblemClass_oracle_apply {L : NNReal} {n : β„•} {Ξ΅ : ℝ} (f : { f : EuclideanSpace ℝ (Fin n) β†’ ℝ // f ∈ {f : EuclideanSpace ℝ (Fin n) β†’ ℝ | IsGStar f L} }) (x : EuclideanSpace ℝ (Fin n)) :
          (gStarProblemClass n L Ξ΅).oracle f x = (↑f x, gradient (↑f) x)

          The oracle of gStarProblemClass n L Ξ΅ is the canonical first-order answer map (f, x) ↦ (f x, βˆ‡ f x).