Skip to content

Sequences and Series of Functions

Let (fn)(f_n) be a sequence of functions defined on a set ERE \subseteq \mathbb{R}.

Definition. (fn)(f_n) converges pointwise to ff on EE if for every xEx \in E and every ε>0\varepsilon > 0There exists NNN \in \mathbb{N} (depending on both xx and ε\varepsilon) such that fn(x)f(x)<ε|f_n(x) - f(x)| \lt \varepsilon for all nNn \geq N.

Example. Let fn(x)=xnf_n(x) = x^n on E=[0,1]E = [0, 1]. For each x[0,1)x \in [0, 1), fn(x)=xn0f_n(x) = x^n \to 0 And fn(1)=1f_n(1) = 1 for all nn. So fnf_n converges pointwise to

f(x)={0if 0x<11if x=1f(x) = \begin{cases} 0 & \mathrm{if\ } 0 \leq x \lt 1 \\ 1 & \mathrm{if\ } x = 1 \end{cases}

Note that each fnf_n is continuous, but the pointwise limit ff is not continuous at x=1x = 1.

Definition. (fn)(f_n) converges uniformly to ff on EE if for every ε>0\varepsilon > 0There Exists NNN \in \mathbb{N} (depending only on ε\varepsilonNot on xx) such that for all xEx \in E:

fn(x)f(x)<εfor all nN|f_n(x) - f(x)| \lt \varepsilon \quad \mathrm{for\ all\ } n \geq N

Equivalently, supxEfn(x)f(x)0\sup_{x \in E} |f_n(x) - f(x)| \to 0 as nn \to \infty.

Proposition 7.1. Uniform convergence implies pointwise convergence. The converse is false.

Example (continued). fn(x)=xnf_n(x) = x^n on [0,1][0, 1] converges pointwise but not uniformly. We have supx[0,1]fn(x)f(x)=supx[0,1)xn=1\sup_{x \in [0,1]} |f_n(x) - f(x)| = \sup_{x \in [0,1)} x^n = 1 for all nn (since the supremum is Approached as x1x \to 1^-). This does not tend to 00.

However, on [0,r][0, r] for any r<1r \lt 1: supx[0,r]xn=rn0\sup_{x \in [0,r]} |x^n| = r^n \to 0 So the convergence Is uniform on [0,r][0, r].

Theorem 7.1 (Weierstrass M-Test). Let (fn)(f_n) be a sequence of functions on EE. If there exists a Sequence (Mn)(M_n) of non-negative real numbers such that fn(x)Mn|f_n(x)| \leq M_n for all xEx \in E and all nn And n=1Mn<\sum_{n=1}^{\infty} M_n \lt \infty Then n=1fn\sum_{n=1}^{\infty} f_n converges uniformly on EE.

Proof. Let Sn(x)=k=1nfk(x)S_n(x) = \sum_{k=1}^{n} f_k(x) and Tn=k=1nMkT_n = \sum_{k=1}^{n} M_k. Since Mk\sum M_k converges, (Tn)(T_n) is a Cauchy sequence. Given ε>0\varepsilon > 0There exists NN such that for m>nNm > n \geq N:

TmTn=k=n+1mMk<εT_m - T_n = \sum_{k=n+1}^{m} M_k \lt \varepsilon

Then for all xEx \in E and m>nNm > n \geq N:

Sm(x)Sn(x)=k=n+1mfk(x)k=n+1mfk(x)k=n+1mMk<ε|S_m(x) - S_n(x)| = \left|\sum_{k=n+1}^{m} f_k(x)\right| \leq \sum_{k=n+1}^{m} |f_k(x)| \leq \sum_{k=n+1}^{m} M_k \lt \varepsilon

So the partial sums (Sn)(S_n) satisfy the uniform Cauchy criterion on EEHence converge uniformly. \blacksquare

Theorem 7.2. If (fn)(f_n) is a sequence of continuous functions on EE converging uniformly to ff On EE Then ff is continuous on EE.

Proof. Let cEc \in E and ε>0\varepsilon > 0. Since fnff_n \to f uniformly, choose NN such that fN(x)f(x)<ε/3|f_N(x) - f(x)| \lt \varepsilon/3 for all xEx \in E. Since fNf_N is continuous at ccChoose δ>0\delta > 0 such that xc<δ|x - c| \lt \delta implies fN(x)fN(c)<ε/3|f_N(x) - f_N(c)| \lt \varepsilon/3. Then:

f(x)f(c)f(x)fN(x)+fN(x)fN(c)+fN(c)f(c)<ε3+ε3+ε3=ε|f(x) - f(c)| \leq |f(x) - f_N(x)| + |f_N(x) - f_N(c)| + |f_N(c) - f(c)| \lt \frac{\varepsilon}{3} + \frac{\varepsilon}{3} + \frac{\varepsilon}{3} = \varepsilon

\blacksquare

Theorem 7.3. If (fn)(f_n) is a sequence of Riemann integrable functions on [a,b][a, b] converging Uniformly to ff on [a,b][a, b] Then ff is Riemann integrable and

limnabfn(x)dx=abf(x)dx\lim_{n \to \infty} \int_a^b f_n(x)\, dx = \int_a^b f(x)\, dx

Proof. Since (fn)(f_n) converges uniformly, ff is the uniform limit of integrable functions. Given ε>0\varepsilon > 0Choose NN with supfN(x)f(x)<ε/(2(ba))\sup |f_N(x) - f(x)| \lt \varepsilon/(2(b-a)) for all x[a,b]x \in [a, b]. Then fNε/(2(ba))f(x)fN(x)+ε/(2(ba))f_N - \varepsilon/(2(b-a)) \leq f(x) \leq f_N(x) + \varepsilon/(2(b-a)) for all xx And by Integrability of fNf_N:

abfNε2abfabfabfN+ε2\int_a^b f_N - \frac{\varepsilon}{2} \leq \underline{\int_a^b} f \leq \overline{\int_a^b} f \leq \int_a^b f_N + \frac{\varepsilon}{2}

So ffε\overline{\int} f - \underline{\int} f \leq \varepsilonProving ff is integrable. For the limit:

abfnabfabfnf(ba)sup[a,b]fnf0\left|\int_a^b f_n - \int_a^b f\right| \leq \int_a^b |f_n - f| \leq (b-a) \cdot \sup_{[a,b]} |f_n - f| \to 0

\blacksquare

7.6 Uniform Convergence and Differentiation

Section titled “7.6 Uniform Convergence and Differentiation”

Uniform convergence of functions does not guarantee convergence of derivatives. A stronger Hypothesis is needed.

Theorem 7.4. Suppose (fn)(f_n) is a sequence of differentiable functions on [a,b][a, b] such that:

  1. (fn(c))(f_n(c)) converges for some c[a,b]c \in [a, b]
  2. (fn")(f_n") converges uniformly on [a,b][a, b]

Then (fn)(f_n) converges uniformly to a differentiable function ff on [a,b][a, b] And f(x)=limnfn(x)f'(x) = \lim_{n \to \infty} f_n'(x).

Proof. Let g=limfng = \lim f_n' (uniform limit). Define f(x)=limn[fn(c)+cxfn(t)dt]f(x) = \lim_{n \to \infty} \left[f_n(c) + \int_c^x f_n'(t)\, dt\right]. By Theorem 7.3, cxfn(t)dtcxg(t)dt\int_c^x f_n'(t)\, dt \to \int_c^x g(t)\, dt So f(x)=f(c)+cxg(t)dtf(x) = f(c) + \int_c^x g(t)\, dt. By FTC Part 1, ff is differentiable and f(x)=g(x)f'(x) = g(x). Uniform convergence of fnf_n to ff follows From the estimate fn(x)f(x)fn(c)f(c)+abfn(t)g(t)dt|f_n(x) - f(x)| \leq |f_n(c) - f(c)| + \int_a^b |f_n'(t) - g(t)|\, dt. \blacksquare

A power series centered at aa is a series of the form n=0cn(xa)n\sum_{n=0}^{\infty} c_n (x - a)^n.

Theorem 7.5 (Radius of Convergence). Every power series cn(xa)n\sum c_n (x - a)^n has a radius of Convergence R[0,]R \in [0, \infty] such that:

  • The series converges absolutely for xa<R|x - a| \lt R
  • The series diverges for xa>R|x - a| > R
  • The behavior at xa=R|x - a| = R must be checked separately

The radius is given by 1/R=lim supncnn1/R = \limsup_{n \to \infty} \sqrt[n]{|c_n|} (Cauchy-Hadamard formula), or When the limit exists, R=limncn/cn+1R = \lim_{n \to \infty} |c_n/c_{n+1}|.

Proof. Apply the root test to cn(xa)n\sum |c_n (x-a)^n|: lim supcnnxa=xa/R\limsup \sqrt[n]{|c_n|} |x-a| = |x-a|/R (where 1/R=lim supcnn1/R = \limsup \sqrt[n]{|c_n|}). The root test gives convergence when xa/R<1|x-a|/R \lt 1 And divergence when xa/R>1|x-a|/R > 1. \blacksquare

Theorem 7.6. A power series converges uniformly on every compact subset of its open disk of Convergence.

Theorem 7.6a (Differentiation and Integration of Power Series). If f(x)=n=0cn(xa)nf(x) = \sum_{n=0}^{\infty} c_n (x-a)^n Has radius of convergence R>0R > 0 Then:

  1. ff is differentiable on (aR,a+R)(a - R, a + R) and f(x)=n=1ncn(xa)n1f'(x) = \sum_{n=1}^{\infty} n c_n (x - a)^{n-1} (same RR).
  2. ff is infinitely differentiable on (aR,a+R)(a - R, a + R) And f(k)(x)=n=kn!(nk)!cn(xa)nkf^{(k)}(x) = \sum_{n=k}^{\infty} \frac{n!}{(n-k)!} c_n (x - a)^{n-k}.
  3. axf(t)dt=n=0cnn+1(xa)n+1\int_a^x f(t)\, dt = \sum_{n=0}^{\infty} \frac{c_n}{n+1}(x - a)^{n+1} for xa<R|x - a| \lt R.
  4. cn=f(n)(a)/n!c_n = f^{(n)}(a)/n! (uniqueness of power series coefficients).

Proof. The differentiated series ncn(xa)n1\sum n c_n (x-a)^{n-1} has the same radius of convergence as The original (by the Cauchy-Hadamard formula, since nn1\sqrt[n]{n} \to 1). By Theorem 7.4, the Derivative of the sum equals the sum of the derivatives. Parts (2), (3), and (4) follow by Induction and the FTC. \blacksquare

Theorem 7.6b (Abel’s Theorem). If n=0cn\sum_{n=0}^{\infty} c_n converges to LL Then

limx1n=0cnxn=L\lim_{x \to 1^-} \sum_{n=0}^{\infty} c_n x^n = L

That is, the power series is continuous from the left at the endpoint x=1x = 1.

Proof (sketch). Let sn=k=0ncks_n = \sum_{k=0}^{n} c_k and snLs_n \to L. Write the partial sum k=0nckxk=k=0n(sksk1)xk\sum_{k=0}^{n} c_k x^k = \sum_{k=0}^{n}(s_k - s_{k-1})x^k (with s1=0s_{-1} = 0) and use summation by Parts to express this as snxn+k=0n1sk(xkxk+1)s_n x^n + \sum_{k=0}^{n-1} s_k(x^k - x^{k+1}). Letting nn \to \infty and using That snLs_n \to L and xn0x^n \to 0 for x<1|x| \lt 1One shows the expression tends to LL as x1x \to 1^-. \blacksquare

Example. Since k=1(1)k+1/k=ln2\sum_{k=1}^{\infty} (-1)^{k+1}/k = \ln 2Abel’s theorem gives limx1k=1(1)k+1xk/k=ln2\lim_{x \to 1^-} \sum_{k=1}^{\infty} (-1)^{k+1} x^k/k = \ln 2I.e., ln2\ln 2 is the left-hand limit Of ln(1x)-\ln(1 - x) at x=1x = 1.

The Taylor series of ff at aa is n=0f(n)(a)n!(xa)n\sum_{n=0}^{\infty} \frac{f^{(n)}(a)}{n!}(x - a)^n.

Definition. A function ff is analytic at aa if its Taylor series at aa converges to f(x)f(x) In some neighborhood of aa.

Not every CC^{\infty} function is analytic. The standard counterexample is:

f(x)={e1/x2x00x=0f(x) = \begin{cases} e^{-1/x^2} & x \neq 0 \\ 0 & x = 0 \end{cases}

f(n)(0)=0f^{(n)}(0) = 0 for all nn So the Taylor series at 00 is identically zero, which Converges only to 00Not to f(x)f(x) for x0x \neq 0.

Worked Example: Show $\sum_{n=1}^{\infty} \frac{x^n}{n^2}$ converges uniformly on $[-1, 1]$

Solution. For x[1,1]x \in [-1, 1]: xnn21n2\left|\frac{x^n}{n^2}\right| \leq \frac{1}{n^2}. Since n=11n2\sum_{n=1}^{\infty} \frac{1}{n^2} converges (it is a pp-series with p=2>1p = 2 > 1), the Weierstrass M-Test with Mn=1/n2M_n = 1/n^2 implies the series converges uniformly on [1,1][-1, 1]. \blacksquare

Worked Example: Find the radius of convergence of $\sum_{n=0}^{\infty} \frac{x^n}{n!}$

Solution. Apply the ratio test to the coefficients: limncn+1cn=limnn!(n+1)!=limn1n+1=0\lim_{n \to \infty} \left|\frac{c_{n+1}}{c_n}\right| = \lim_{n \to \infty} \frac{n!}{(n+1)!} = \lim_{n \to \infty} \frac{1}{n+1} = 0.

So R=R = \infty and the series converges for all xRx \in \mathbb{R}. This is the power series for exe^x. By Theorem 7.4, the derivative of the sum equals n=1nxn1n!=n=1xn1(n1)!=k=0xkk!=ex\sum_{n=1}^{\infty} \frac{n x^{n-1}}{n!} = \sum_{n=1}^{\infty} \frac{x^{n-1}}{(n-1)!} = \sum_{k=0}^{\infty} \frac{x^k}{k!} = e^x, confirming That exe^x is its own derivative. \blacksquare

Worked Example: Find the radius of convergence of $\sum_{n=1}^{\infty} n! \, x^n$

Solution. Apply the ratio test to the coefficients:

limncn+1cn=limn(n+1)!n!=limn(n+1)=\lim_{n \to \infty} \left|\frac{c_{n+1}}{c_n}\right| = \lim_{n \to \infty} \frac{(n+1)!}{n!} = \lim_{n \to \infty} (n+1) = \infty

So R=0R = 0Meaning the series converges only at x=0x = 0. \blacksquare

Worked Example: Show $f_n(x) = \frac{x}{1 + nx}$ converges uniformly on $[1, \infty)$

Solution. Pointwise limit: For x1x \geq 1: limnx1+nx=limn11/x+n=0\lim_{n \to \infty} \frac{x}{1 + nx} = \lim_{n \to \infty} \frac{1}{1/x + n} = 0.

Uniform convergence: supx[1,)x1+nx0=supx1x1+nx\sup_{x \in [1, \infty)} \left|\frac{x}{1 + nx} - 0\right| = \sup_{x \geq 1} \frac{x}{1 + nx}. To find the maximum, differentiate with respect to xx: ddx(x1+nx)=1(1+nx)2>0\frac{d}{dx}\left(\frac{x}{1+nx}\right) = \frac{1}{(1+nx)^2} > 0. So the function is increasing in xx on [1,)[1, \infty) And:

supx1x1+nx=limxx1+nx=1n\sup_{x \geq 1} \frac{x}{1 + nx} = \lim_{x \to \infty} \frac{x}{1 + nx} = \frac{1}{n}

Since supfn=1/n0\sup |f_n| = 1/n \to 0The convergence is uniform on [1,)[1, \infty). \blacksquare

Mistake 1: Assuming pointwise convergence preserves continuity Students often assume that if a sequence of continuous functions converges pointwise, the limit must be continuous. The classic counterexample is fn(x)=xnf_n(x) = x^n on [0,1][0,1], which converges pointwise to a discontinuous function. Only uniform convergence guarantees that the limit of continuous functions is continuous.

Mistake 2: Confusing uniform convergence of fnf_n with uniform convergence of fnf_n' The Weierstrass M-test or direct estimation shows that fnff_n \to f uniformly, but students incorrectly conclude fnff_n' \to f' uniformly. Theorem 7.4 requires uniform convergence of the derivatives fnf_n', not the functions fnf_n themselves, to interchange differentiation and limits.

Mistake 3: Forgetting to check endpoints when computing radius of convergence When applying the ratio or root test, students find RR but assume the series converges for xa=R|x-a| = R. The boundary behaviour must be checked separately — a series may converge at one endpoint, both, or neither. For example, xn/n\sum x^n/n has R=1R=1 but converges only at x=1x=-1 on the boundary.

  • Series: The Weierstrass M-test and convergence criteria for function series build directly on the numerical series tests from this chapter.

  • Sequences and Limits: Pointwise and uniform convergence are generalisations of the sequence convergence concepts from the first chapter.

  • Partial Derivatives: Taylor series convergence and analyticity connect real analysis to the partial derivative computations in multivariable calculus.

  • Fourier Series: Fourier series are function series whose convergence properties are analysed using the uniform convergence theory developed here.

  • Classical Mechanics

  • Electromagnetism

flowchart TD
A[7_Sequences And Series Of Functions] --> B[Key Concepts]
A --> C[Core Principles]
A --> D[Practical Applications]
B --> E[Fundamental definitions]
C --> F[Design patterns]
D --> G[Real-world usage]

A sequence of functions converges pointwise if each point eventually stabilises, but this is too weak to preserve analytical properties — the limit of continuous functions can be discontinuous. Uniform convergence demands that all points stabilise simultaneously: given any tolerance, there is a single NN beyond which every point in the domain is within that tolerance. Think of it as the difference between each person eventually sitting down (pointwise) versus everyone sitting down at the same command (uniform). Power series are the paradigmatic example: within their radius of convergence, they converge uniformly on compact sets, which justifies term-by-term differentiation and integration.