Documentation

FirstOrderMethodsOptimization_Beck_2017.Chap07.Theorem_7_7

@[implicit_reducible]
noncomputable def instNormedAddCommGroupMatrixFinReal_firstOrderMethodsOptimization_Beck_2017_1 {m n : } :
NormedAddCommGroup (Matrix (Fin m) (Fin n) )

The ambient real matrix space is equipped with its Frobenius norm.

Instances For
    @[implicit_reducible]
    noncomputable def instNormedSpaceRealMatrixFin_firstOrderMethodsOptimization_Beck_2017_1 {m n : } :
    NormedSpace (Matrix (Fin m) (Fin n) )

    The ambient real matrix space is a normed real vector space.

    Instances For
      @[implicit_reducible]
      noncomputable def instInnerProductSpaceRealMatrixFin_firstOrderMethodsOptimization_Beck_2017_1 {m n : } :
      InnerProductSpace (Matrix (Fin m) (Fin n) )

      The ambient real matrix space is equipped with its Frobenius inner product.

      Instances For
        def orthogonalRectangularDiagonalMapEuclidean {m n : } (U : (Matrix.orthogonalGroup (Fin m) )) (V : (Matrix.orthogonalGroup (Fin n) )) :
        EuclideanSpace (Fin (min m n))Matrix (Fin m) (Fin n)

        The rectangular diagonal reconstruction map with a Euclidean singular-value vector input.

        Instances For
          theorem matrixSpectralLift_proper_closed_convex {m n : } (f : (Fin (min m n))EReal) (hf_symm : Function.IsAbsolutelyPermutationSymmetric f) (hf_closed : LowerSemicontinuous f) (hf_convex : is_convex_function f) :

          Helper for Theorem 7.7: the matrix spectral lift of an absolutely permutation symmetric, closed, convex profile is proper, closed, and convex on the ambient matrix space.

          theorem proximal_objective_matrixSpectralLift_orthogonal_rectangular_eq {m n : } (f : (Fin (min m n))EReal) (U : (Matrix.orthogonalGroup (Fin m) )) (V : (Matrix.orthogonalGroup (Fin n) )) (d : Fin (min m n)) (Z : Matrix (Fin m) (Fin n) ) :

          Helper for Theorem 7.7: orthogonal transport normalizes the matrix spectral proximal objective to the rectangular diagonal basis.

          theorem frobenius_norm_rectangularDiagonal_eq_toLp {m n : } (x : Fin (min m n)) :
          rectangularDiagonal x = WithLp.toLp 2 x

          Helper for Theorem 7.7: the Frobenius norm of a rectangular diagonal matrix is the Euclidean norm of its diagonal profile.

          theorem mem_prox_matrixSpectralLift_orthogonal_rectangular_iff {m n : } (f : (Fin (min m n))EReal) (U : (Matrix.orthogonalGroup (Fin m) )) (V : (Matrix.orthogonalGroup (Fin n) )) (d : Fin (min m n)) (Z : Matrix (Fin m) (Fin n) ) :

          Helper for Theorem 7.7: proximal membership is invariant under orthogonal transport to the rectangular diagonal basis.

          def row_coordinate_sign_pattern {m n : } (i : Fin (min m n)) :
          Fin m

          Helper for Theorem 7.7: the row-side sign pattern that flips only the common-diagonal coordinate i.

          Instances For
            def column_coordinate_sign_pattern {m n : } (i : Fin (min m n)) :
            Fin n

            Helper for Theorem 7.7: the column-side sign pattern that flips only the common-diagonal coordinate i.

            Instances For
              theorem rowCoordinateSignFlip_mem_orthogonalGroup {m n : } (i : Fin (min m n)) :
              Matrix.diagonal (row_coordinate_sign_pattern i) Matrix.orthogonalGroup (Fin m)

              Helper for Theorem 7.7: the row-side coordinate sign pattern defines an orthogonal matrix.

              noncomputable def rowCoordinateSignFlip {m n : } (i : Fin (min m n)) :
              (Matrix.orthogonalGroup (Fin m) )

              Helper for Theorem 7.7: the row-side coordinate sign pattern defines an orthogonal matrix.

              Instances For
                theorem columnCoordinateSignFlip_mem_orthogonalGroup {m n : } (i : Fin (min m n)) :
                Matrix.diagonal (column_coordinate_sign_pattern i) Matrix.orthogonalGroup (Fin n)

                Helper for Theorem 7.7: the column-side coordinate sign pattern defines an orthogonal matrix.

                noncomputable def columnCoordinateSignFlip {m n : } (i : Fin (min m n)) :
                (Matrix.orthogonalGroup (Fin n) )

                Helper for Theorem 7.7: the column-side coordinate sign pattern defines an orthogonal matrix.

                Instances For
                  theorem pairedCoordinateSignFlip_conjugate_apply {m n : } (i : Fin (min m n)) (W : Matrix (Fin m) (Fin n) ) (j : Fin m) (k : Fin n) :

                  Helper for Theorem 7.7: paired row/column coordinate sign flips act entrywise by multiplying the corresponding row and column signs.

                  Helper for Theorem 7.7: the paired coordinate sign flips fix every rectangular diagonal matrix.

                  theorem eq_rectangularDiagonal_of_fixed_by_pairedCoordinateSignFlip {m n : } (W : Matrix (Fin m) (Fin n) ) (hfix : ∀ (i : Fin (min m n)), (rowCoordinateSignFlip i) * W * (↑(columnCoordinateSignFlip i)).transpose = W) :
                  ∃ (w : Fin (min m n)), W = rectangularDiagonal w

                  Helper for Theorem 7.7: if a rectangular matrix is fixed by every paired row/column coordinate sign flip, then it is rectangular diagonal.

                  theorem rectangular_basis_prox_is_rectangularDiagonal {m n : } (f : (Fin (min m n))EReal) (hf_symm : Function.IsAbsolutelyPermutationSymmetric f) (hf_closed : LowerSemicontinuous f) (hf_convex : is_convex_function f) (d : Fin (min m n)) {W : Matrix (Fin m) (Fin n) } (hW : W prox[f singular_value_function] (rectangularDiagonal d)) :
                  ∃ (w : Fin (min m n)), W = rectangularDiagonal w

                  Helper for Theorem 7.7: every proximal point at a rectangular diagonal base matrix is itself a rectangular diagonal matrix.

                  theorem rectangularDiagonal_mem_prox_euclidean_of_mem_prox_matrixSpectralLift {m n : } (f : (Fin (min m n))EReal) (hf_symm : Function.IsAbsolutelyPermutationSymmetric f) (d w : Fin (min m n)) (hdiag : rectangularDiagonal w prox[f singular_value_function] (rectangularDiagonal d)) :
                  WithLp.toLp 2 w prox[fun (y : EuclideanSpace (Fin (min m n))) => f y.ofLp] (WithLp.toLp 2 d)

                  Helper for Theorem 7.7: a rectangular diagonal proximal point in the matrix problem induces the corresponding Euclidean proximal point of the vector profile.

                  theorem prox_matrixSpectralLift_eq_image_orthogonalRectangularDiagonalMap {m n : } (f : (Fin (min m n))EReal) (hf_symm : Function.IsAbsolutelyPermutationSymmetric f) (hf_closed : LowerSemicontinuous f) (hf_convex : is_convex_function f) (X : Matrix (Fin m) (Fin n) ) (U : (Matrix.orthogonalGroup (Fin m) )) (V : (Matrix.orthogonalGroup (Fin n) )) (hsvd : X = orthogonalRectangularDiagonalMap U V (singular_value_function X)) :
                  prox[f singular_value_function] X = orthogonalRectangularDiagonalMapEuclidean U V '' prox[fun (y : EuclideanSpace (Fin (min m n))) => f y.ofLp] (WithLp.toLp 2 (singular_value_function X))

                  Theorem 7.7: if f : ℝ^(min(m,n)) → (-∞, ∞] is absolutely permutation symmetric, closed, and convex, and if X = U * rectangularDiagonal (singular_value_function X) * Vᵀ, then the proximal set of the matrix spectral lift f ∘ singular_value_function at X is the orthogonal image of the Euclidean vector proximal set of f at σ(X) = singular_value_function X. The vector-side proximal problem is stated on EuclideanSpace ℝ (Fin (min m n)), matching the Frobenius geometry of rectangular diagonal matrices.

                  theorem prox_matrixSpectralLift_eq_singleton_orthogonalRectangularDiagonalMap {m n : } {f : (Fin (min m n))EReal} (hf_symm : Function.IsAbsolutelyPermutationSymmetric f) (hf_closed : LowerSemicontinuous f) (hf_convex : is_convex_function f) {X : Matrix (Fin m) (Fin n) } {U : (Matrix.orthogonalGroup (Fin m) )} {V : (Matrix.orthogonalGroup (Fin n) )} (hsvd : X = orthogonalRectangularDiagonalMap U V (singular_value_function X)) {x : EuclideanSpace (Fin (min m n))} (hprox : prox[fun (y : EuclideanSpace (Fin (min m n))) => f y.ofLp] (WithLp.toLp 2 (singular_value_function X)) = {x}) :

                  If the Euclidean vector proximal set of f at the singular-value vector of X is the singleton {x}, then the proximal set of the matrix spectral lift at X is the singleton {U * rectangularDiagonal x.ofLp * Vᵀ}.