Documentation

Books.ConvexAnalysis_Rockafellar_1970.Chap06.section27_part1

def sublevelSet {n : } (f : (Fin n)WithTop ) (α : ) :
Set (Fin n)

Definition 6.27.1 (Sublevel set): for an extended-real-valued function f : ℝ^n → (-∞, +∞] and α ∈ ℝ, the α-sublevel set lev_α f is {x ∈ ℝ^n | f x ≤ α}.

Equations
    Instances For
      noncomputable def functionInfimum {n : } (f : (Fin n)WithTop ) :

      Definition 6.27.2 (Infimum of a function): for an extended-real-valued function f : ℝ^n → (-∞, +∞], the infimum inf f is the infimum in [-∞, +∞] of the set of values {f x | x ∈ ℝ^n}, viewed in [-∞, +∞], equivalently the greatest lower bound of those values.

      Equations
        Instances For
          def minimumSet {n : } (f : (Fin n)WithTop ) :
          Set (Fin n)

          Definition 6.27.3 (Minimum set): for an extended-real-valued function f : ℝ^n → (-∞, +∞], the minimum set is the set of minimizers, namely {x ∈ ℝ^n | f x = inf f}, with f x viewed in [-∞, +∞].

          Equations
            Instances For
              def IsConvexFunction {n : } (f : (Fin n)WithTop ) :

              An extended-real-valued function on ℝ^n is convex when its epigraph is a convex subset of ℝ^n × ℝ.

              Equations
                Instances For
                  def withTopFunctionToEReal {n : } (f : (Fin n)WithTop ) :
                  (Fin n)EReal

                  Lift a WithTop-valued function to an EReal-valued function by viewing each value in (-∞, +∞] as an extended real with no additional -∞ values introduced.

                  Equations
                    Instances For
                      def epigraphWithTop {n : } (h : (Fin n)WithTop ) :
                      Set ((Fin n) × )

                      Definition 6.27.9 (Epigraph): for an extended-real-valued function h : ℝ^n → (-∞, +∞], the epigraph epi h is the subset of ℝ^(n+1) consisting of the pairs (x, μ) with h x ≤ μ. In Lean, ℝ^(n+1) is modeled as (Fin n → ℝ) × ℝ.

                      Equations
                        Instances For
                          theorem helperForProposition_6_27_1_mem_epigraphWithTop_iff {n : } {f : (Fin n)WithTop } {x : Fin n} {α : } :

                          Helper for Proposition 6.27.1: membership in the α-sublevel set is the same as membership in the epigraph at height α.

                          theorem helperForProposition_6_27_1_affineCombo_same_height {n : } {x y : Fin n} {a b α : } (hab : a + b = 1) :
                          a (x, α) + b (y, α) = (a x + b y, α)

                          Helper for Proposition 6.27.1: an affine combination of two points with common height α still has height α when the coefficients sum to 1.

                          Helper for Proposition 6.27.1: convexity of the function is exactly convexity of its epigraph written with the dedicated definition epigraphWithTop.

                          Helper for Proposition 6.27.1: once the epigraph is convex, each horizontal slice at height α is convex, so the corresponding sublevel set is convex.

                          theorem convex_sublevelSet {n : } {f : (Fin n)WithTop } (hf : IsConvexFunction f) (α : ) :

                          Proposition 6.27.1 (Convexity of sublevel sets): if f : ℝ^n → (-∞, +∞] is a convex function, then for every α ∈ ℝ the sublevel set sublevelSet f α = {x | f x ≤ α} is convex.

                          Helper for Proposition 6.27.2: the real sublevel set is the preimage of the lower interval (-∞, α] in WithTop.

                          theorem helperForProposition_6_27_2_isClosed_preimage_Iic {n : } {f : (Fin n)WithTop } (hf_closed : LowerSemicontinuous f) (α : ) :

                          Helper for Proposition 6.27.2: a lower semicontinuous WithTop-valued function has closed preimages of lower closed rays (-∞, α].

                          Helper for Proposition 6.27.2: lower semicontinuity alone already forces every real sublevel set of f to be closed.

                          theorem isClosed_sublevelSet_of_closed_convexFunction {n : } {f : (Fin n)WithTop } (hf_closed : LowerSemicontinuous f) (hf_convex : IsConvexFunction f) (α : ) :

                          Proposition 6.27.2 (Closedness of sublevel sets): if f : ℝ^n → (-∞, +∞] is a closed convex function, then for every α ∈ ℝ the sublevel set sublevelSet f α = {x | f x ≤ α} is closed.

                          def effectiveDomainWithTop {n : } (f : (Fin n)WithTop ) :
                          Set (Fin n)

                          The effective domain of a (-∞, +∞]-valued function on ℝ^n is the set of points where the function is finite.

                          Equations
                            Instances For
                              def IsDirectionOfRecessionWithTop {n : } (f : (Fin n)WithTop ) (y : Fin n) :

                              Definition 6.27.4 (Direction of recession): for an extended-real-valued function f : ℝ^n → (-∞, +∞], a nonzero vector y is a direction of recession of f when for every x ∈ dom f and every λ ≥ 0, one has f (x + λ y) ≤ f x; equivalently, the function λ ↦ f (x + λ y) is non-increasing on [0, ∞).

                              Equations
                                Instances For

                                  Definition 6.27.5 (Parabolic convex set): the set P ⊆ ℝ² is {(ξ₁, ξ₂) ∈ ℝ² | ξ₂ ≥ ξ₁²}.

                                  Equations
                                    Instances For
                                      @[reducible, inline]

                                      A concrete Euclidean model of ℝ².

                                      Equations
                                        Instances For

                                          Definition 6.27.7 (Squared distance function): for a set P ⊆ ℝ² and each x ∈ ℝ², define f₀(x) to be the infimum of the squared Euclidean distances ‖x - y‖² as y ranges over P. Here the infimum is taken in WithTop, so squaredDistance P x takes values in [0, +∞]; in particular, this convention gives squaredDistance P x = ⊤ when P = ∅.

                                          Equations
                                            Instances For

                                              The parabolic convex set viewed inside the Euclidean-space model of ℝ².

                                              Equations
                                                Instances For

                                                  The squared-distance function specialized to the parabolic convex set.

                                                  Equations
                                                    Instances For
                                                      @[reducible, inline]
                                                      noncomputable abbrev indicatorFunctionEReal {n : } (C : Set (Fin n)) :
                                                      (Fin n)EReal

                                                      Definition 6.27.6 (Indicator function): for a set C ⊆ ℝ^n, the indicator function δ(· | C) is the extended-real-valued function equal to 0 on C and +∞ outside C. This reuses the existing EReal-valued indicator function already defined in the project.

                                                      Equations
                                                        Instances For

                                                          The auxiliary function f₁ on the Euclidean plane is the squared norm x ↦ ‖x‖², viewed as a (-∞, +∞]-valued function with no +∞ values.

                                                          Equations
                                                            Instances For

                                                              The auxiliary function f₂ on the Euclidean plane is the indicator δ(· | P) of the parabolic convex set P, taking the value 0 on P and +∞ outside P.

                                                              Equations
                                                                Instances For

                                                                  Definition 6.27.8 (Auxiliary functions; The function f): define the three functions (f₁, f₂, f) on ℝ² by f₁(x) = ‖x‖², f₂(x) = δ(x | P), and, for x = (ξ₁, ξ₂) ∈ ℝ², f(x) = f₀(ξ₁, ξ₂) - ξ₁, where f₀ is the squared-distance function to the parabolic set P. In Lean, ξ₁ is the first coordinate x (0 : Fin 2).

                                                                  Equations
                                                                    Instances For

                                                                      The parabolic objective function f is the third component of the bundled triple (f₁, f₂, f).

                                                                      Equations
                                                                        Instances For

                                                                          Helper for Proposition 6.27.8: the Euclidean parabolic set contains the origin, so the squared-distance infimum is taken over a nonempty set.

                                                                          Helper for Proposition 6.27.8: the Euclidean parabolic set is convex.

                                                                          Helper for Proposition 6.27.8: the squared-distance function is the coercion of the real infimum of squared norms over the parabolic set.

                                                                          Helper for Proposition 6.27.8: the parabolic objective is the coercion of the real squared-distance envelope minus the first coordinate.

                                                                          Helper for Proposition 6.27.8: the real squared-distance envelope over the parabolic set is convex on the whole Euclidean plane.

                                                                          Helper for Proposition 6.27.8: the negative first-coordinate map is affine, hence convex on the whole Euclidean plane.

                                                                          Proposition 6.27.8: the function f defined by f(x) = f₀(x) - ξ₁ for x = (ξ₁, ξ₂) ∈ ℝ², where f₀ is the squared-distance function to the parabolic convex set, is finite everywhere on ℝ² and is convex.

                                                                          Helper for Proposition 6.27.3: membership in a real sublevel set already forces the function value to be finite.

                                                                          Helper for Proposition 6.27.3: a finite WithTop value comes from an actual real level, so the point lies in some real sublevel set.

                                                                          Helper for Proposition 6.27.3: a point belongs to the union of all real sublevel sets exactly when the function is finite there.

                                                                          Proposition 6.27.3 (Union of sublevel sets): for a proper function f : ℝ^n → (-∞, +∞], the union of all real sublevel sets is the effective domain dom f = {x ∈ ℝ^n | f x < +∞}.

                                                                          Helper for Proposition 6.27.4: if the function infimum is -∞, then no point can realize that value because f only takes values in (-∞, +∞].

                                                                          Helper for Proposition 6.27.4: if the function infimum is +∞, then every value of f must be +∞, so every point is a minimizer.

                                                                          Helper for Proposition 6.27.4: if the function infimum is neither -∞ nor +∞, then it is represented by a finite real number.

                                                                          Helper for Proposition 6.27.4: once the infimum is a finite real value α, the minimum set coincides with the α-sublevel set.

                                                                          theorem convex_minimumSet {n : } {f : (Fin n)WithTop } (hf : IsConvexFunction f) :

                                                                          Proposition 6.27.4 (Convexity of the minimum set): if f : ℝ^n → (-∞, +∞] is a convex function and M is its minimum set, then M is a convex subset of ℝ^n.

                                                                          theorem isClosed_minimumSet_of_closed_convexFunction {n : } {f : (Fin n)WithTop } (hf_closed : LowerSemicontinuous f) (hf_convex : IsConvexFunction f) :

                                                                          Proposition 6.27.5 (Closedness of the minimum set): if f : ℝ^n → (-∞, +∞] is a closed convex function and M is its minimum set, then M is a closed subset of ℝ^n.

                                                                          Helper for Proposition 6.27.6: the function infimum lies below every point value in the range used to define it.

                                                                          theorem helperForProposition_6_27_6_mem_minimumSet_iff_pointwiseLowerBound {n : } {f : (Fin n)WithTop } {x : Fin n} :
                                                                          x minimumSet f ∀ (z : Fin n), (f x) (f z)

                                                                          Helper for Proposition 6.27.6: belonging to the minimum set means that the value at x is below every point value of f.

                                                                          Helper for Proposition 6.27.6: the EReal order for the lifted function is exactly the same as the WithBot (WithTop ℝ) order on the original WithTop values.

                                                                          Helper for Proposition 6.27.6: the zero dual vector is a subgradient exactly when the lifted function value at x is below every lifted function value.

                                                                          Proposition 6.27.6 (Characterization of minimizers by the subdifferential): let f : ℝ^n → (-∞, +∞] be a proper convex function, and let M be the minimum set of f. Then for any x ∈ ℝ^n, one has x ∈ M if and only if the zero dual vector belongs to the subdifferential of f at x. Equivalently, x is a minimizer exactly when x^* = 0 is a subgradient of f at x.

                                                                          theorem helperForProposition_6_27_7_value_le_affineCombinationOfHeights {n : } {f : (Fin n)WithTop } (hf : IsConvexFunction f) {x y : Fin n} {a b t : } (ht0 : 0 t) (ht1 : t 1) (hx : f x a) (hy : f y b) :
                                                                          f ((1 - t) x + t y) ↑((1 - t) * a + t * b)

                                                                          Helper for Proposition 6.27.7: convexity of the epigraph bounds the function value at a segment point by the affine combination of the two finite endpoint heights.

                                                                          theorem helperForProposition_6_27_7_segmentPoint_mem_ball {n : } {x y : Fin n} {ε : } ( : 0 < ε) :
                                                                          have t := ε / (2 * (ε + y - x)); have z := (1 - t) x + t y; 0 < t t < 1 z - x < ε

                                                                          Helper for Proposition 6.27.7: the standard short segment point from x toward y stays inside the local-minimum ball.

                                                                          theorem helperForProposition_6_27_7_globalLowerBound_of_localMinimum {n : } {f : (Fin n)WithTop } (hf : IsConvexFunction f) {x : Fin n} (hx : x effectiveDomainWithTop f) (hlocal : ε > 0, ∀ (z : Fin n), z - x < εf z f x) (y : Fin n) :
                                                                          f y f x

                                                                          Helper for Proposition 6.27.7: a finite local minimum of a convex function is already a global lower bound.

                                                                          theorem localMinimumPoint_globalMinimizer_of_proper_convexFunction {n : } {f : (Fin n)WithTop } (hproper : (effectiveDomainWithTop f).Nonempty) (hf : IsConvexFunction f) {x : Fin n} (hx : x effectiveDomainWithTop f) (hlocal : ε > 0, ∀ (z : Fin n), z - x < εf z f x) :
                                                                          (∀ (y : Fin n), f y f x) 0 subdifferentialAt (withTopFunctionToEReal f) x

                                                                          Proposition 6.27.7 (A local minimum of a convex function is global): let f : ℝ^n → (-∞, +∞] be a proper convex function, and let x ∈ dom f. If x is a finite local minimum point of f, meaning that there exists ε > 0 such that f z ≥ f x whenever ‖z - x‖ < ε, then x is a global minimum point of f, so f y ≥ f x for every y ∈ ℝ^n. Consequently, 0 ∈ ∂f(x).