Documentation

IntroductoryLecturesOnConvexOptimization_Nesterov_2004.Chap04.Definition_4_1_4

noncomputable def cubicRegularizationLocalOptimalityMeasure {E : Type u} [NormedAddCommGroup E] [InnerProductSpace E] [FiniteDimensional E] (f : E) (L M : ) (x : E) :

Definition 4.1.4: the local optimality measure μ_M(x) for cubic regularization is the maximum of the square root of the scaled gradient norm term and the scaled negative least Hessian eigenvalue term.

Instances For
    @[simp]
    theorem cubicRegularizationLocalOptimalityMeasure_eq_max {E : Type u} [NormedAddCommGroup E] [InnerProductSpace E] [FiniteDimensional E] (f : E) (L M : ) (x : E) :
    cubicRegularizationLocalOptimalityMeasure f L M x = max ((2 / (L + M) * gradient f x)) (-(2 / (2 * L + M)) * sInf (spectrum (hessian f x)))

    The local optimality measure μ[f; L; M](x) is given by the textbook maximum formula.

    theorem sqrt_scaledGradientNorm_le_cubicRegularizationLocalOptimalityMeasure {E : Type u} [NormedAddCommGroup E] [InnerProductSpace E] [FiniteDimensional E] (f : E) (L M : ) (x : E) :
    (2 / (L + M) * gradient f x) cubicRegularizationLocalOptimalityMeasure f L M x

    The scaled gradient term is bounded above by the local optimality measure.

    theorem scaledNegLeastHessianEigenvalue_le_cubicRegularizationLocalOptimalityMeasure {E : Type u} [NormedAddCommGroup E] [InnerProductSpace E] [FiniteDimensional E] (f : E) (L M : ) (x : E) :
    -(2 / (2 * L + M)) * sInf (spectrum (hessian f x)) cubicRegularizationLocalOptimalityMeasure f L M x

    The scaled negative least-Hessian-eigenvalue term is bounded above by the local optimality measure.