Documentation

IntroductoryLecturesOnConvexOptimization_Nesterov_2004.Chap01.Definition_1_4_16

@[reducible, inline]
noncomputable abbrev hessian {X : Type u} [NormedAddCommGroup X] [InnerProductSpace X] [CompleteSpace X] (f : X) (x : X) :
X →L[] X

The Hessian of f at x, viewed intrinsically as the derivative of the gradient map.

Instances For
    @[reducible, inline]
    noncomputable abbrev hessianMatrix {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) :
    Matrix (Fin n) (Fin n)

    Definition 1.4.16: if f : ℝⁿ → ℝ, the Hessian of f at x is the matrix of the derivative of the gradient map in the standard orthonormal basis of ℝⁿ.

    Instances For
      def Gradient.«term∇²» :
      Lean.ParserDescr

      Definition 1.4.16: if f : ℝⁿ → ℝ, the Hessian of f at x is the matrix of the derivative of the gradient map in the standard orthonormal basis of ℝⁿ.

      Instances For
        theorem hessianMatrix_apply {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) (i j : Fin n) :
        hessianMatrix f x i j = inner ((EuclideanSpace.basisFun (Fin n) ) i) ((hessian f x) ((EuclideanSpace.basisFun (Fin n) ) j))

        The (i,j) entry of the Hessian matrix is the inner product of the ith standard basis vector with the Hessian operator applied to the jth standard basis vector.

        theorem gradient_coordinate_eq_inner_basis {n : } (f : EuclideanSpace (Fin n)) (i : Fin n) :
        (fun (y : EuclideanSpace (Fin n)) => (gradient f y).ofLp i) = fun (y : EuclideanSpace (Fin n)) => inner ((EuclideanSpace.basisFun (Fin n) ) i) (gradient f y)

        Helper for Definition 1.4.16: the ith coordinate of the Euclidean gradient is the inner product with the ith standard basis vector.

        theorem hasFDerivAt_gradient_coordinate {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) (i : Fin n) (hgrad : DifferentiableAt (gradient f) x) :
        HasFDerivAt (fun (y : EuclideanSpace (Fin n)) => (gradient f y).ofLp i) ((innerSL ) ((EuclideanSpace.basisFun (Fin n) ) i) ∘SL hessian f x) x

        Helper for Definition 1.4.16: the derivative of a gradient coordinate is obtained by composing the Hessian operator with the corresponding coordinate functional.

        theorem fderiv_gradient_coordinate_apply_basis {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) (i j : Fin n) (hgrad : DifferentiableAt (gradient f) x) :
        (fderiv (fun (y : EuclideanSpace (Fin n)) => (gradient f y).ofLp i) x) ((EuclideanSpace.basisFun (Fin n) ) j) = inner ((EuclideanSpace.basisFun (Fin n) ) i) ((hessian f x) ((EuclideanSpace.basisFun (Fin n) ) j))

        Helper for Definition 1.4.16: evaluating the derivative of the ith gradient coordinate on the jth standard basis vector gives the corresponding Hessian inner-product entry.

        theorem hessianMatrix_apply_eq_fderiv_gradient_coordinate {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) (i j : Fin n) (hgrad : DifferentiableAt (gradient f) x) :
        hessianMatrix f x i j = (fderiv (fun (y : EuclideanSpace (Fin n)) => (gradient f y).ofLp i) x) ((EuclideanSpace.basisFun (Fin n) ) j)

        Under differentiability of the gradient at x, the (i,j) entry of the Hessian matrix is the derivative of the ith gradient coordinate in the jth standard basis direction, i.e. the textbook second partial derivative.

        theorem hessianMatrix_toEuclideanLin {n : } (f : EuclideanSpace (Fin n)) (x : EuclideanSpace (Fin n)) :
        Matrix.toEuclideanLin (hessianMatrix f x) = (hessian f x)

        Turning the Hessian matrix back into its Euclidean linear action recovers the intrinsic Hessian operator.