Documentation

Papers.SmoothMinimization_Nesterov_2004.Sections.section04_part7

theorem Section04Part7.matrixGame_entropy_opNorm_bound (n m : ) (A : (PiLp 1 fun (x : Fin n) => ) →L[] (PiLp 1 fun (x : Fin m) => ) →L[] ) (f : (PiLp 1 fun (x : Fin n) => )) (φ : (PiLp 1 fun (x : Fin m) => )) (xhat : PiLp 1 fun (x : Fin n) => ) (uhat : PiLp 1 fun (x : Fin m) => ) (N : ) :
have A' := { toFun := fun (x : PiLp 1 fun (x : Fin n) => ) => (A x), map_add' := , map_smul' := }; have AEntry := fun (i : Fin n) (j : Fin m) => (A' ((PiLp.basisFun 1 (Fin n)) i)) ((PiLp.basisFun 1 (Fin m)) j); have maxEntry := sSup {r : | ∃ (i : Fin n) (j : Fin m), r = |AEntry i j|}; OperatorNormDef A' = sSup {r : | ∃ (x : PiLp 1 fun (x : Fin n) => ), x = 1 r = DualNormDef (A' x)} OperatorNormDef A' = maxEntry (0 f xhat - φ uhat f xhat - φ uhat 4 * (Real.log n * Real.log m) / (N + 1) * OperatorNormDef A'0 f xhat - φ uhat f xhat - φ uhat 4 * (Real.log n * Real.log m) / (N + 1) * maxEntry)

Proposition 1.4.1.2. Under the entropy-distance setup of Lemma 1.4.1.1, the operator norm satisfies ‖A‖_{1,2} = max_{‖x‖_1=1} ‖A x‖_{2,*} = max_{i,j} |A^{(i,j)}| (eq:opnorm_entropy). Consequently, since M = 0 for the linear term fhat(x) = ⟪c,x⟫_1, the estimate (4.3) of Theorem 1.4.1 becomes 0 ≤ f(ĥx) - φ(ĥu) ≤ (4 * sqrt(ln n ln m)/(N+1)) * max_{i,j} |A^{(i,j)}| (4.12).

theorem Section04Part7.matrixGame.standardSimplex_coord_le_one {n : } {x : Fin n} (hx : x standardSimplex n) (i : Fin n) :
x i 1

A coordinate of a point in the standard simplex is at most 1.

theorem Section04Part7.matrixGame.quadratic_prox_sumSq_identity (n : ) (x : Fin n) (hx : x standardSimplex n) :
i : Fin n, (x i - 1 / n) ^ 2 = i : Fin n, x i ^ 2 - 1 / n

A standard algebraic identity that simplifies the quadratic prox on the simplex.

theorem Section04Part7.matrixGame.norm_sq_le_sum_sq (n : ) (z : Fin n) :
z ^ 2 i : Fin n, z i ^ 2

The squared sup norm on Fin n → ℝ is bounded by the sum of squared coordinates.

theorem Section04Part7.matrixGame.quadratic_prox_diameter_bound (n : ) :
IsProxDiameterBound (standardSimplex n) (fun (x : Fin n) => 1 / 2 * i : Fin n, (x i - 1 / n) ^ 2) (1 - 1 / n)

The quadratic prox-function has prox-diameter bounded by 1 - 1/n on the standard simplex.

theorem Section04Part7.matrixGame.quadratic_prox_strongConvexOn (n : ) :
StrongConvexOn (standardSimplex n) 1 fun (x : Fin n) => 1 / 2 * i : Fin n, (x i - 1 / n) ^ 2

The quadratic prox-function is 1-strongly convex on the standard simplex.

theorem Section04Part7.matrixGame.operatorNormDef_eq_sSup_dualNormDef (n m : ) (A : (Fin n) →L[] (Fin m) →L[] ) :
have A' := { toFun := fun (x : Fin n) => (A x), map_add' := , map_smul' := }; OperatorNormDef A' = sSup {r : | ∃ (x : Fin n), x = 1 r = DualNormDef (A' x)}

For the linear map A' induced from A, OperatorNormDef is the supremum of DualNormDef over unit vectors.

theorem Section04Part7.matrixGame.D_nonneg (k : ) (hk : k 0) :
0 1 - 1 / k

For a positive natural k, the value 1 - 1/k is nonnegative.

theorem Section04Part7.matrixGame.sqrt_mul_le_one_of_le_one {a b : } (ha0 : 0 a) (ha1 : a 1) (hb0 : 0 b) (hb1 : b 1) :
(a * b) 1

If a, b ∈ [0, 1], then Real.sqrt (a * b) ≤ 1.

theorem Section04Part7.matrixGame.duality_gap_simplify_from_thm141_M0 {gap op lambdaMax D1 D2 : } (N : ) (hop : op = lambdaMax) (hop_nonneg : 0 op) (hD1_0 : 0 D1) (hD1_1 : D1 1) (hD2_0 : 0 D2) (hD2_1 : D2 1) (hgap : gap 4 * op / (N + 1) * (D1 * D2)) :
gap 4 * lambdaMax / (N + 1)

Simplify a Theorem 1.4.1-style duality-gap bound in the Euclidean simplex setup (M = 0).