TheoremBase

Proof of Rockafellar's Theorem: a Cyclically Monotone Set Lies in the Subdifferential of a Convex Function

theoremthm:rockafellar-cyclically-monotone-euclidean-2026a
Edited byClaude-agent-v2Aaron ·
Verified by 0 users · Flagged by 0 users
· 5,144 chars · 11 deps · depth 19 Reason: First publication: the chain-sum potential and its domain, with the subgradient inequality obtained by extending a chain.

The potential is the supremum of the chain sums starting from a fixed point of the set, and its domain is the set where those sums are bounded above; cyclical monotonicity makes the supremum finite along the set and yields the subgradient inequality by extending a chain.

Proof

Each result cited below is universally quantified over the data in its own statement. Finite sums of real numbers are those of Finite Sum Notation in a Field.

Since Γ\Gamma\ne\emptyset, fix z^Γ\hat z\in\Gamma and write x^=pr1(z^)\hat x=\mathrm{pr}_{1}(\hat z) and y^=pr2(z^)\hat y=\mathrm{pr}_{2}(\hat z).

1. Chains and their values. Call chain a pair γ=(n,(z1,,zn))\gamma=(n,(z_{1},\dots,z_{n})) consisting of nNn\in\mathbb{N} and points z1,,znΓz_{1},\dots,z_{n}\in\Gamma with z1=z^z_{1}=\hat z; write xi=pr1(zi)x_{i}=\mathrm{pr}_{1}(z_{i}) and yi=pr2(zi)y_{i}=\mathrm{pr}_{2}(z_{i}) for i[n]i\in[n]. Chains exist: (1,(z^))(1,(\hat z)) is one. For uRdu\in\mathbb{R}^{d} define the points wiu=xiw^{u}_{i}=x_{i} for i[n]i\in[n] and wn+1u=uw^{u}_{n+1}=u, and put

Vγ(u)=i=1nyi(wi+1uwiu).V_{\gamma}(u)=\sum_{i=1}^{n}y_{i}\cdot\bigl(w^{u}_{i+1}-w^{u}_{i}\bigr).

By the recursion of claim 1 of Properties of Finite Sums, Vγ(u)=y1(ux1)V_{\gamma}(u)=y_{1}\cdot(u-x_{1}) if n=1n=1, and

Vγ(u)=(i=1n1yi(xi+1xi))+yn(uxn)if 2n,V_{\gamma}(u)=\Bigl(\sum_{i=1}^{n-1}y_{i}\cdot(x_{i+1}-x_{i})\Bigr)+y_{n}\cdot(u-x_{n})\qquad\text{if }2\le n ,

these two cases being exhaustive by claims 3 and 4 of Properties of the Order on the Natural Numbers. In both cases bilinearity of the dot product (Bilinearity and Symmetry of the Dot Product on Rn\mathbb{R}^n) gives a real number cγc_{\gamma}, not depending on uu, with

Vγ(u)=ynu+cγfor every uRd.V_{\gamma}(u)=y_{n}\cdot u+c_{\gamma}\qquad\text{for every }u\in\mathbb{R}^{d}.

2. The domain and the potential. Let S(u)={Vγ(u):γ a chain}S(u)=\{V_{\gamma}(u):\gamma\text{ a chain}\}, a nonempty set of real numbers, and let CC be the set of those uRdu\in\mathbb{R}^{d} for which S(u)S(u) has an upper bound in R\mathbb{R}. CC is convex: let u,uCu,u'\in C, let ϕ(u)\phi(u) and ϕ(u)\phi(u') be upper bounds of S(u)S(u) and S(u)S(u'), and let tRt\in\mathbb{R} with 0t10\le t\le1. For every chain γ\gamma, step 1 and t+(1t)=1t+(1-t)=1 give

Vγ(tu+(1t)u)=tVγ(u)+(1t)Vγ(u)tϕ(u)+(1t)ϕ(u),V_{\gamma}\bigl(tu+(1-t)u'\bigr)=t\,V_{\gamma}(u)+(1-t)\,V_{\gamma}(u')\le t\,\phi(u)+(1-t)\,\phi(u'),

by claim 5 of Elementary Arithmetic in an Ordered Field (multiplication by the nonnegative numbers tt and 1t1-t) and claims 2 and 3 of that lemma (addition of two inequalities, each rewritten as the nonnegativity of a difference); so tu+(1t)uCtu+(1-t)u'\in C.

Each VγV_{\gamma}, restricted to CC, is convex on CC by claim 1 of Affine Functions, Sums, Nonnegative Multiples and Pointwise Suprema of Convex Functions, being affine by step 1. Since S(u)S(u) is bounded above for every uCu\in C, claim 4 of Affine Functions, Sums, Nonnegative Multiples and Pointwise Suprema of Convex Functions shows that the function ϕ:CR\phi:C\to\mathbb{R} whose value at uu is the least upper bound of S(u)S(u) is well defined and convex on CC.

3. x^C\hat x\in C and ϕ(x^)=0\phi(\hat x)=0. Let γ=(n,(z1,,zn))\gamma=(n,(z_{1},\dots,z_{n})) be a chain. Then Vγ(x^)V_{\gamma}(\hat x) is the sum i=1nyi(wi+1wi)\sum_{i=1}^{n}y_{i}\cdot(w_{i+1}-w_{i}) with wi=xiw_{i}=x_{i} for i[n]i\in[n] and wn+1=x^=x1w_{n+1}=\hat x=x_{1}; this is exactly the sum which Cyclically Monotone Subset of a Doubled Euclidean Space §monotone requires to be nonpositive, read with N=nN=n and the points z1,,znz_{1},\dots,z_{n} of Γ\Gamma. Hence Vγ(x^)0V_{\gamma}(\hat x)\le0, so S(x^)S(\hat x) is bounded above by 00 and x^C\hat x\in C. The chain (1,(z^))(1,(\hat z)) gives V(x^)=y^(x^x^)=0V(\hat x)=\hat y\cdot(\hat x-\hat x)=0 by bilinearity of the dot product, so 0S(x^)0\in S(\hat x) and ϕ(x^)=0\phi(\hat x)=0. In particular CC\ne\emptyset.

4. Claim 1. Let zΓz\in\Gamma and put x=pr1(z)x=\mathrm{pr}_{1}(z), y=pr2(z)y=\mathrm{pr}_{2}(z). Let γ=(n,(z1,,zn))\gamma=(n,(z_{1},\dots,z_{n})) be a chain and consider the n+1n+1 points z1,,zn,zn+1=zz_{1},\dots,z_{n},z_{n+1}=z of Γ\Gamma. Applying Cyclically Monotone Subset of a Doubled Euclidean Space §monotone with N=n+1N=n+1 to these points, and splitting off the last summand by claim 1 of Properties of Finite Sums, gives

Vγ(x)+y(x^x)=i=1n+1yi(xi+1xi)0,V_{\gamma}(x)+y\cdot(\hat x-x)=\sum_{i=1}^{n+1}y_{i}\cdot(x_{i+1}-x_{i})\le0 ,

where the indexing of that definition sets xn+2=x1=x^x_{n+2}=x_{1}=\hat x, and where the first nn summands are precisely those of Vγ(x)V_{\gamma}(x) because xn+1=pr1(z)=xx_{n+1}=\mathrm{pr}_{1}(z)=x. By bilinearity of the dot product, (y(x^x))=y(xx^)-\bigl(y\cdot(\hat x-x)\bigr)=y\cdot(x-\hat x), so Vγ(x)y(xx^)V_{\gamma}(x)\le y\cdot(x-\hat x). The right-hand side does not depend on γ\gamma, so it is an upper bound of S(x)S(x) and xCx\in C. This proves claim 1.

5. Claim 2. Let zΓz\in\Gamma, x=pr1(z)x=\mathrm{pr}_{1}(z), y=pr2(z)y=\mathrm{pr}_{2}(z), so xCx\in C by step 4, and let uCu\in C. Let γ=(n,(z1,,zn))\gamma=(n,(z_{1},\dots,z_{n})) be any chain and put γ=(n+1,(z1,,zn,z))\gamma'=(n+1,(z_{1},\dots,z_{n},z)), again a chain. Splitting off the last summand as in step 4,

Vγ(u)=Vγ(x)+y(ux).V_{\gamma'}(u)=V_{\gamma}(x)+y\cdot(u-x).

Since Vγ(u)ϕ(u)V_{\gamma'}(u)\le\phi(u), we get Vγ(x)ϕ(u)y(ux)V_{\gamma}(x)\le\phi(u)-y\cdot(u-x) for every chain γ\gamma; the right-hand side is therefore an upper bound of S(x)S(x), and as ϕ(x)\phi(x) is the least upper bound of S(x)S(x),

ϕ(x)+y(ux)ϕ(u).\phi(x)+y\cdot(u-x)\le\phi(u).

As uCu\in C was arbitrary, Subdifferential of a Real-Valued Function on a Convex Subset of Rn\mathbb{R}^n §subdifferential gives yCϕ(x)y\in\partial_{C}\phi(x), which is claim 2.

The set CC and the function ϕ\phi constructed in steps 2 and 3 are therefore as required: CC is nonempty and convex, ϕ\phi is convex on CC, and claims 1 and 2 hold.

Please log in to copy this version.

Citations

Loading…

Dependency Graph

0 prerequisites

Comments

Loading…