Claim 1. A C3 map is in particular differentiable, hence continuous at every point (directly from the definition of the derivative and limit arithmetic), so f is Borel measurable by the generator criterion of that definition (preimages of open sets are open). Consequently f∘Y is a random variable, as preimages compose. If ∣f∣≤M pointwise, then ∣f∘Y∣≤M pointwise; the constant M is a nonnegative simple function with integral M⋅P(Ω)=M on a probability space, so by monotonicity (claim 1 of Linearity and Monotonicity of the Lebesgue Integral) ∫∣f∘Y∣dP≤M<∞ and f∘Y is integrable; its expectation is a real number.
Claim 2, Step 1 (smooth monotone transitions). Let h:R→R be the function h(v)=exp(−1/v) for v>0 and h(v)=0 for v≤0, which is a smooth map with 0≤h and h>0 exactly on (0,∞), by Step 1 of the proof of Existence of Smooth Bump Functions on Euclidean Space (with the exponential function now the published one; the argument is identical). For real a<b define
ηa,b(x)=h(b−x)+h(x−a)h(b−x).
The denominator is everywhere positive (for each x at least one of b−x>0, x−a>0 holds), so ηa,b is smooth by Products and Quotients of C^k Real-Valued Maps on Euclidean Open Sets Are C^k (quotient with nonvanishing denominator) and the smoothness of the two affine compositions; moreover 0≤ηa,b≤1, ηa,b=1 on (−∞,a] (there h(x−a)=0 and h(b−x)>0) and ηa,b=0 on [b,∞). Every derivative of ηa,b is continuous and vanishes on (−∞,a)∪(b,∞) (where the function is locally constant), hence is bounded: on the compact interval [a,b] it attains a maximum and minimum by Extreme Value Theorem on a Compact Interval, and it vanishes elsewhere. Therefore ηa,b is an admissible test function in the sense of the statement.
Claim 2, Step 2 (squeezing the distribution functions). Fix t∈R at which FX is continuous, and let ε>0. Consider η+=ηt,t+ε and η−=ηt−ε,t. Pointwise,
1(−∞,t] ≤ η+ ≤ 1(−∞,t+ε],1(−∞,t−ε] ≤ η− ≤ 1(−∞,t].
Taking expectations of the compositions with Xm and X and using monotonicity (Linearity and Monotonicity of the Lebesgue Integral) together with E[1(−∞,u](Y)]=P(Y≤u)=FY(u) (Simple Function and Its Integral, Distribution and Cumulative Distribution Function of a Random Variable),
FXm(t) ≤ E[η+(Xm)],E[η+(X)] ≤ FX(t+ε),
E[η−(Xm)] ≤ FXm(t),FX(t−ε) ≤ E[η−(X)].
By hypothesis E[η±(Xm)]→E[η±(X)], so with liminf and limsup of bounded real sequences as in the proof of Dominated Convergence Theorem,
FX(t−ε) ≤ mliminfFXm(t) ≤ mlimsupFXm(t) ≤ FX(t+ε).
Letting ε→0 and using continuity of FX at t, both outer bounds converge to FX(t); hence FXm(t)→FX(t). Since t was an arbitrary continuity point, Xm→X in distribution by Almost Sure Convergence, Convergence in Probability, and Convergence in Distribution. ■