Documentation

FirstOrderMethodsOptimization_Beck_2017.Chap03.Proposition_3_23

noncomputable def coordinatewiseMax {ι : Type u} (x : ι) :

The max function on a finite coordinate space, specializing to x ↦ max_i x i on ℝ^n.

Instances For
    def activeCoordinateFace {ι : Type u} [Fintype ι] (x : ι) :
    Set (ι)

    The face of the standard simplex supported on the active coordinates of x, namely the indices i with coordinatewiseMax x = x i.

    Instances For
      @[simp]
      theorem mem_activeCoordinateFace_iff {ι : Type u} [Fintype ι] {x l : ι} :
      l activeCoordinateFace x l stdSimplex ι ∀ (i : ι), coordinatewiseMax x x il i = 0

      Membership in activeCoordinateFace x means belonging to the standard simplex and being supported on the active coordinates of x.

      theorem coordinatewiseMax_eq_sup' {ι : Type u} [Fintype ι] [Nonempty ι] (x : ι) :
      coordinatewiseMax x = Finset.univ.sup' x

      On a nonempty finite coordinate space, coordinatewiseMax x is the ordinary finite maximum over Finset.univ.

      theorem le_coordinatewiseMax {ι : Type u} [Nonempty ι] [Finite ι] (x : ι) (i : ι) :
      theorem coordinatewiseMax_add_const {ι : Type u} [Nonempty ι] [Finite ι] (x : ι) (t : ) :
      (coordinatewiseMax fun (i : ι) => x i + t) = coordinatewiseMax x + t
      @[simp]
      theorem activeCoordinateFace_const_eq_stdSimplex {ι : Type u} [Fintype ι] [Nonempty ι] (α : ) :
      (activeCoordinateFace fun (x : ι) => α) = stdSimplex ι

      For a constant coordinate vector, every coordinate is active, so the active face is the whole standard simplex.

      theorem euclidean_subdifferentialAt_coordinatewiseMax_eq_activeCoordinateFace {ι : Type u} [Fintype ι] [Nonempty ι] (x : EuclideanSpace ι) :
      euclideanSubdifferentialAt (fun (y : EuclideanSpace ι) => coordinatewiseMax y.ofLp) x = WithLp.toLp 2 '' activeCoordinateFace x.ofLp

      Proposition 3.23 [Subdifferential of the max function]: the Euclidean/vector-side subdifferential of the coordinatewise maximum on ℝ^n is exactly the face of the standard simplex supported on the active coordinates.

      theorem mem_euclideanSubdifferentialAt_coordinatewiseMax_toLp_iff {ι : Type u} [Fintype ι] [Nonempty ι] {x : ι} {z : EuclideanSpace ι} :
      z euclideanSubdifferentialAt (fun (y : EuclideanSpace ι) => coordinatewiseMax y.ofLp) (WithLp.toLp 2 x) z.ofLp activeCoordinateFace x

      Membership form of Proposition 3.23 at a coordinate vector x : ι → ℝ. This is the source-facing statement: a Euclidean vector z is a subgradient of y ↦ max_i y i at x exactly when its coordinate vector lies in the active face of the simplex at x.

      theorem subdifferentialAt_coordinatewiseMax_eq_image_activeCoordinateFace {ι : Type u} [Fintype ι] [Nonempty ι] (x : EuclideanSpace ι) :
      subdifferentialAt (fun (y : EuclideanSpace ι) => coordinatewiseMax y.ofLp) x = (InnerProductSpace.toDualMap (EuclideanSpace ι)) '' WithLp.toLp 2 '' activeCoordinateFace x.ofLp

      Continuous-dual reformulation of Proposition 3.23 obtained by applying the canonical Riesz map to the vector-side active face.

      theorem euclidean_subdifferentialAt_coordinatewiseMax_const_eq_stdSimplex {ι : Type u} [Fintype ι] [Nonempty ι] (α : ) :
      euclideanSubdifferentialAt (fun (y : EuclideanSpace ι) => coordinatewiseMax y.ofLp) (WithLp.toLp 2 fun (x : ι) => α) = WithLp.toLp 2 '' stdSimplex ι

      At a constant vector α e, every coordinate is active, so the vector-side subdifferential of the max function is the whole standard simplex.

      theorem subdifferentialAt_coordinatewiseMax_const_eq_image_stdSimplex {ι : Type u} [Fintype ι] [Nonempty ι] (α : ) :
      subdifferentialAt (fun (y : EuclideanSpace ι) => coordinatewiseMax y.ofLp) (WithLp.toLp 2 fun (x : ι) => α) = (InnerProductSpace.toDualMap (EuclideanSpace ι)) '' WithLp.toLp 2 '' stdSimplex ι

      Continuous-dual reformulation of the constant-vector case of Proposition 3.23.