Helper for Lemma 9.25: every optimal point of the composite problem lies in
effective_domain g.
Helper for Lemma 9.25: an optimal point attains the recorded optimal value in real form.
Helper for Lemma 9.25: the Chapter 9 three-point identity can be written directly in add form for the Mirror-C trajectory.
Helper for Lemma 9.25: the one-step perturbation fed into the Chapter 9 second-prox theorem.
Instances For
Helper for Lemma 9.25: Text 9.10 rewrites the stored Mirror-C update minimizer into the
equation (9.33) Bregman-form objective.
Helper for Lemma 9.25: along a Mirror-C trajectory, each finite composite objective value
splits into the sum of the finite real parts of f and g.
Helper for Lemma 9.25: positive stepsizes preserve the effective domain when passing from g
to the linear-plus-penalty perturbation.
Helper for Lemma 9.25: on dom(g), the second-prox perturbation has the expected real value.
Helper for Lemma 9.25: the second-prox perturbation is proper and convex for positive stepsizes.
First-order comparison for a second-prox minimizer when membership in dom(∂ω) is already
known. This directional proof avoids the relative-interior sum-rule qualification needed only
to derive that membership in Theorem 9.12.
Helper for Lemma 9.25: each Mirror-C step satisfies the textbook pairing-plus-penalty inequality.
Helper for Lemma 9.25: the optimality of xStar rewrites the shifted composite objective gap
into the current subgradient pairing plus the shifted penalty difference.
Helper for Lemma 9.25: the mixed linear/Bregman term is controlled by the usual Young inequality and the lower quadratic bound for the Bregman distance.
Helper for Lemma 9.25: the one-step shifted Mirror-C estimate.
Helper for Lemma 9.25: summing the one-step shifted Mirror-C estimate gives the shifted prefix gap bound.
Helper for Lemma 9.25: the weighted prefix sum of penalty values is bounded by the initial penalty term plus the shifted weighted prefix sum.
Helper for Lemma 9.25: the shifted penalty bookkeeping dominates the weighted prefix sum of composite objective gaps.
Companion to Lemma 9.25: under the composite convex minimization assumptions of Definition 9.4,
together with the mirror-map assumptions of Definition 9.5 and the Mirror-C trajectory data of
Definition 9.6, if g is nonnegative on dom(g) and the Mirror-C stepsizes are nonincreasing,
then for every optimal point xStar ∈ XStar = X^* and every iteration index k, the weighted
prefix sum of composite objective gaps is bounded by
t₀ g(x⁰) + B_ω(xStar, x⁰) + (1 / (2σ)) * ∑_{n=0}^k t_n^2 ‖f'(x^n)‖^2.
Lemma 9.25: under the composite convex minimization assumptions extracted from Definition 9.4,
together with the mirror-map assumptions of Definition 9.5 and the Mirror-C trajectory data of
Definition 9.6, if g is nonnegative on dom(g) and the Mirror-C stepsizes are nonincreasing,
then for every optimal point xStar ∈ XStar = X^* and every iteration index k, the
running-best composite objective gap up to time k is bounded by the weighted ratio
(t₀ g(x⁰) + B_ω(xStar, x⁰) + (1 / (2σ)) * ∑_{n=0}^k t_n^2 ‖f'(x^n)‖^2) / ∑_{n=0}^k t_n.