We use the notation of the statement. Algebraic manipulations of dot products use Bilinearity and Symmetry of the Dot Product on Rn. For (z,q)βS let βz,qβ:RnβR be given by βz,qβ(x)=f(z)+qβ
(xβz), and let F be the set of all functions βz,qβ with (z,q)βS, so that A(x)={g(x):gβF} for every xβRn.
The subgradients are bounded. Since BΛ(y0β,2r)βU and f satisfies the stated Lipschitz bound on BΛ(y0β,2r), claim 2 of Elementary Calculus of the Subdifferential of a Convex Function gives
β₯qβ₯β€MforΒ everyΒ (z,q)βS.(B)
Claim 1. The set U is open and convex and y0ββBΛ(y0β,r)βU, so The Subdifferential of a Convex Function on an Open Convex Set is Nonempty Β§nonempty provides some qββUβf(y0β); hence (y0β,q)βS and S is nonempty, and therefore so are F and each A(x).
Let xβRn and (z,q)βS. By Cauchy-Schwarz Inequality for the Euclidean Dot Product, claim 3 of Properties of the Absolute Value in an Ordered Field and (B),
qβ
(xβz)β€β£qβ
(xβz)β£β€β₯qβ₯β₯xβzβ₯β€M(β₯xβy0ββ₯+r),
using claim 6 of Elementary Properties of the Euclidean Norm on Rn and β₯zβy0ββ₯β€r. The Lipschitz hypothesis gives f(z)β€f(y0β)+Mβ₯zβy0ββ₯β€f(y0β)+Mr. Hence every element of A(x) is at most f(y0β)+Mr+M(β₯xβy0ββ₯+r), so A(x) is bounded above.
Each βz,qβ is convex on Rn: for x1β,x2ββRn and ΞΈβR with 0β€ΞΈβ€1, Bilinearity and Symmetry of the Dot Product on Rn gives
βz,qβ(ΞΈx1β+(1βΞΈ)x2β)=f(z)+qβ
(ΞΈx1β+(1βΞΈ)x2ββz)=ΞΈβz,qβ(x1β)+(1βΞΈ)βz,qβ(x2β),
so the defining inequality of Convex Real-Valued Function on a Convex Subset of Rn holds with equality. Claim 4 of Affine Functions, Sums, Nonnegative Multiples and Pointwise Suprema of Convex Functions, applied to the nonempty set F of convex functions on the convex set Rn, therefore shows both that F is well defined, its value at x being the least upper bound of A(x), and that F is convex on Rn. This proves claims 1 and 2.
Claim 3. Let xβBΛ(y0β,r). For (z,q)βS we have qββUβf(z) and xβBΛ(y0β,r)βU, so Subdifferential of a Real-Valued Function on a Convex Subset of Rn Β§subdifferential gives f(x)β₯f(z)+qβ
(xβz)=βz,qβ(x). Hence f(x) is an upper bound of A(x) and F(x)β€f(x).
Conversely, xβU and U is open and convex, so The Subdifferential of a Convex Function on an Open Convex Set is Nonempty Β§nonempty provides qxβββUβf(x); then (x,qxβ)βS and βx,qxββ(x)=f(x)+qxββ
(xβx)=f(x), so f(x)βA(x) and F(x)β₯f(x). Therefore F(x)=f(x).
Claim 4. Let x,xβ²βRn and (z,q)βS. By Bilinearity and Symmetry of the Dot Product on Rn, Cauchy-Schwarz Inequality for the Euclidean Dot Product, claim 3 of Properties of the Absolute Value in an Ordered Field and (B),
βz,qβ(x)=βz,qβ(xβ²)+qβ
(xβxβ²)β€βz,qβ(xβ²)+Mβ₯xβxβ²β₯β€F(xβ²)+Mβ₯xβxβ²β₯.
Thus F(xβ²)+Mβ₯xβxβ²β₯ is an upper bound of A(x), so F(x)β€F(xβ²)+Mβ₯xβxβ²β₯. Exchanging x and xβ² and using β₯xβ²βxβ₯=β₯xβxβ²β₯, which is claim 5 of Elementary Properties of the Euclidean Norm on Rn with the scalar β1, gives F(xβ²)βF(x)β€Mβ₯xβxβ²β₯. By claim 6 of Properties of the Absolute Value in an Ordered Field the two inequalities give β£F(x)βF(xβ²)β£β€Mβ₯xβxβ²β₯, so F is Lipschitz with constant M.