The Fundamental Theorems
Infinite-dimensional analysis fails in ways finite-dimensional analysis does not. A linear functional on every finite-dimensional space is automatically continuous; on an infinite-dimensional normed space it need not be. A linear operator between finite-dimensional spaces is automatically bounded, and on infinite-dimensional ones it need not be. Compactness, closedness and continuity come apart in ways that have no finite-dimensional analogue.
The four theorems in this section are the repairs. Each one says that a plausible pathology cannot occur, provided the spaces are complete:
- an everywhere-defined linear functional on a Banach space is bounded;
- a surjective bounded operator between Banach spaces is open;
- an everywhere-defined linear operator between Banach spaces with a closed graph is bounded;
- a pointwise bounded family of bounded operators is uniformly bounded.
Completeness is not decoration. Every one of these is false on an incomplete space, and section 4.9 shows why: the proofs all consume the same ingredient, Baire’s theorem, which is a theorem about complete metric spaces and nothing else.
Intuition
Section titled “Intuition”The shared idea is this. Completeness means a convergent Cauchy sequence lands somewhere in the space. Baire’s theorem turns that single property into: a complete space cannot be a countable union of thin sets. Once you have that, the three Baire-based theorems below all follow from the same three moves — assume a pathology, write the space as a countable union of closed sets, invoke Baire to find one with interior, and use the interior to bootstrap a uniform estimate out of a pointwise one.
This is the standard “principle of uniform boundedness” pattern, and seeing it three times in a row is the point of the section. What makes it feel like a trick the first time and like a tool the third time is that the pointwise-to-uniform gap is exactly what completeness closes.
4.1 The Baire Category Theorem
Section titled “4.1 The Baire Category Theorem”Definition. A subset of a topological space is nowhere dense if its closure has empty interior. A space is meagre (or of first category) if it is a countable union of nowhere dense sets.
Theorem 4.1 (Baire Category Theorem). A complete metric space is not meagre in itself. Equivalently, if are closed subsets of a complete metric space and their interiors are dense, then is dense — and in particular nonempty.
Proof. Let be a Cauchy sequence and suppose all are closed with dense interior. Define
Each is closed, and has empty interior: is dense and disjoint from , because a point of is within of some , so a small ball about any point of avoids . Hence is nowhere dense.
Since is complete and not meagre, , so there is . As there is with . Having with and , there is with . So is Cauchy and lies in for all .
For each , is closed and contains all for , so . Completeness is used precisely here, and nowhere else. Hence .
That completeness is load-bearing is not a rhetorical point: an incomplete metric space can be meagre in itself. is a countable union of singletons, each nowhere dense. So Baire fails, and with it the open mapping theorem. This is why “Banach” appears in every hypothesis below.
4.2 Hahn-Banach
Section titled “4.2 Hahn-Banach”Theorem 4.2 (Hahn-Banach, analytic form). Let be a real vector space and sublinear, meaning and for . Let be a subspace and linear with for all . Then there is a linear with and for all .
Proof (one-dimensional extension, then Zorn). Given , we seek so that stays below on all of . The constraint must hold for every and every , so
the inequality flipping when dividing by a negative number. Hence we need where
Sublinearity gives . To see it, fix and write with . By sublinearity of and linearity of ,
Dividing by , the -quotient is at most by definition, and the -quotient is at least . Since and the right-hand term is at most , we get . Choose ; then on is linear and bounded above by .
Order the set of pairs where is a subspace with and is linear on with and on , ordered by extension. This set is inductive by the one-dimensional step. By Zorn there is a maximal element . If , pick ; the one-dimensional step produces a strictly larger element, a contradiction. So .
Theorem 4.3 (Hahn-Banach, normed form). If is a subspace of a normed space and , then extends to with .
Proof. Apply 4.2 with . Then , so the hypothesis holds, and we get . Applying the same to gives , so , i.e. . Since extends , , hence .
Corollary 4.4 (separating functionals). For there is with and .
Proof. Let and . Then on and ; extend.
Consequence. separates points, so is the only vector annihilated by every . Equivalently, the canonical embedding , , is injective. Recall from Bounded Linear Operators that is an isometry, so it is also a homeomorphism onto its image. For a Hilbert space is onto — that is the Riesz representation theorem. For a general Banach space it is onto only for reflexive spaces, and the Hahn-Banach corollary is exactly the “one half” that always holds.
Banach limits
Section titled “Banach limits”Hahn-Banach builds the objects the theory needs. On consider
where means . This is bounded: , and is finite but not , so does not yet dominate and Hahn-Banach cannot be applied directly to it.
The fix is to define the limiting set in a larger space, show is convex and does not absorb , and apply Hahn-Banach to obtain dominated by and dominating . Then extends the ordinary limit, is linear, satisfies for the shift , and is positive. Such an object cannot be a multiple of the usual limit: it agrees with the limit on convergent sequences yet is non-zero on others, which is possible precisely because has no continuous extension of the limit functional. That non-uniqueness is the phenomenon Banach limits were invented to exhibit.
4.3 The Open Mapping Theorem
Section titled “4.3 The Open Mapping Theorem”Theorem 4.5 (Open Mapping, surjective form). Let be Banach spaces and surjective. Then there is with
Theorem 4.6 (Open Mapping). Under the same hypotheses maps open sets to open sets.
Proof. Set for . Surjectivity gives .
Each is closed: if with and for , then is Cauchy, so being complete gives with and . Hence with and , so .
By Baire, some has nonempty interior: , so contains for , and contains a ball with . Thus .
Write with , so and for some . Given with for some , choose with and , so with . Then , and
with and because and , so . Thus with . Applying this times, with .
Since and , we get . Taking gives . This is 4.5.
For 4.6, let be open and . With , , so . For as above, , so contains a ball about , i.e. is open.
Corollary 4.7 (Bounded Inverse). If is bijective and are Banach, then .
Proof. By 4.6, is open. So is continuous at , hence everywhere; and linear. Its norm is .
Equivalent norms, correctly stated
Section titled “Equivalent norms, correctly stated”Theorem 4.8. Let be a vector space that is Banach under both norms and . Suppose for some , for all . Then for some ; the norms are equivalent.
Proof. Let be the identity. It is linear and bijective, and , so . Both spaces are Banach, so 4.7 gives with . Then .
The completeness hypothesis on both norms is essential, and it is easy to misread the theorem as saying that one domination suffices. It does not. If is complete under only , one inequality gives a continuous bijection whose inverse may be discontinuous — the canonical embedding of into , or the identity from to , are the standard examples. Equivalence requires both directions, and it is completeness that produces the second one.
4.4 The Closed Graph Theorem
Section titled “4.4 The Closed Graph Theorem”Theorem 4.9 (Closed Graph). Let be Banach spaces and linear (no boundedness assumed). Then is bounded if and only if its graph is closed in .
Proof (). A continuous map has closed graph when the codomain is Hausdorff: if then by continuity and also , so .
() Suppose is closed. The naive route — restricting to and recursing — is circular, because the recursive instance is a closed graph theorem in its own right. The way out is to make the restricted domain complete.
Let , a subspace, and let be its closure in (so is Banach). Define on the closure by implies . This limit exists: is Cauchy in , and is complete; and it is independent of the approximating sequence, since if and then , so by continuity of , and . So is well defined and continuous, and it extends on . It is surjective, because is surjective and every has for some , hence .
Both and are Banach, so 4.5 gives with . Since , we get and therefore for .
Finally, : for any take , so and . A vector space cannot be a finite union of proper subspaces — pick the largest index with and a point outside it, and it lies in none of the others — so . Hence on all of .
Theorem 4.10 (Closed Range). For with Banach, these are equivalent: (i) is closed in ; (ii) is closed in ; (iii) there is such that every has with and .
Proof sketch. (iii) (i) is immediate from the estimate. For (i) (iii), is open onto , giving (iii) with the norm of ; for (ii) (i), apply the open mapping theorem to between and and use .
4.5 The Uniform Boundedness Principle
Section titled “4.5 The Uniform Boundedness Principle”Theorem 4.11 (Banach-Steinhaus). Let be a Banach space, a normed space, and with for each . Then .
Proof. Let . By hypothesis . Each is closed: if with then for each , so .
By Baire, some has nonempty interior, so for some and . Given , both and lie in , so by linearity
for every . Rescaling, .
This is the Baire pattern in its purest form, and it is worth being explicit about where each hypothesis is used. Pointwise boundedness gives the cover ; linearity makes each closed; completeness gives Baire; Baire gives an interior point; and the interior is what turns a bound that may depend on into one that does not.
Corollary 4.12 (Resonance Theorem). If and exists for every , then defines .
Proof. A convergent sequence is bounded, so for each , and 4.11 applies to give . Then is linear (interchange limits and finite sums) and
so , i.e. .
Applications
Section titled “Applications”Fourier series diverge for some continuous functions. Let be the -th partial sum operator on . If every continuous had bounded for each fixed , 4.11 would give . But with , so
So , and by contraposition some has : a continuous function whose Fourier series diverges. This is the classical existence proof, and it is worth noticing what it needed — no explicit bad function, only the failure of a uniform bound that the theorem makes unavoidable.
Weakly bounded implies norm bounded. For a single family, for all implies . Weak convergence is weaker than norm convergence at the level of sequences, but for families the two notions of boundedness coincide on a Banach domain. That contrast is the content of Weak and Weak* Convergence.
Higher derivatives are unbounded, and nowhere-differentiable functions are generic. Let , . With the norm on , each is unbounded: take , so while . The operator norms blow up like . This is a fact about the domain, not the operator — on with , is bounded with norm . Which norm you equip a space with is part of specifying an operator.
The same Baire argument that proves uniform boundedness produces the classical consequence. Let be the set of continuous that are not differentiable on any interval of length . Each is closed, and each is dense: a polynomial plus a small multiple of the Weierstrass nowhere-differentiable function stays inside while being arbitrarily close to the polynomial. Baire gives dense, so nowhere-differentiable continuous functions are residual — generic, not exotic.
4.6 How the Four Theorems Relate
Section titled “4.6 How the Four Theorems Relate”They are not four independent facts.
- Hahn-Banach is the odd one out: it needs no Baire and no completeness. Its content is that is large enough to separate points.
- Open mapping, closed graph and uniform boundedness are all Baire, and all three share the skeleton: write the space as a countable union of closed sets indexed by a bound, let Baire select a set with interior, and use the interior to upgrade a pointwise estimate to a uniform one.
- Closed graph is derived from open mapping in 4.4, by completing the domain and then showing the domain was already everything.
- Hahn-Banach + the open mapping theorem give the closed range theorem, and Hahn-Banach + reflexivity give the Riesz representation theorem.
The one-line summary: completeness plus Baire is what stops a pointwise statement from being a uniform one, and the three Baire-based theorems are three faces of that single fact.
4.7 Applications in Partial Differential Equations
Section titled “4.7 Applications in Partial Differential Equations”Weak solutions of the Dirichlet problem. Let be bounded. The operator , with zero trace, is bounded, and the form is continuous and coercive on :
with by Poincare. The Lax-Milgram lemma — which is Hahn-Banach for coercivity plus the Hilbert-space geometry — gives a unique with for every . Existence, uniqueness and continuous dependence on all come from the functional-analytic theorems, not from regularity estimates on .
Neumann series. If with , then is invertible with
because the series converges in operator norm (so by comparing geometric series) and is injective: gives , so unless ; surjectivity then follows from 4.7. This is the resolvent of a bounded operator off the closed unit disc, and it is what makes spectral theory for bounded operators work.
Compactness of the embedding. In finite dimensions every bounded set is compact. The failure of that in infinite dimensions — the unit ball of has no convergent subsequence — is what makes compactness arguments, and hence the Arzela-Ascoli and Rellich-Kondrachov theorems, carry real content here. The repairs are exactly the theorems above: a weakly convergent sequence that is bounded has a weakly convergent subsequence in a separable reflexive space, and the boundedness comes from uniform boundedness applied to the evaluation functionals.
4.8 Practice Problems
Section titled “4.8 Practice Problems”Problem 1. Let be a closed subspace of a Hilbert space . Show that and that is the orthogonal projection, with if .
Problem 2. Show that is bounded whenever is a bijective bounded operator between Banach spaces. Do not cite the open mapping theorem; prove it, and identify where completeness of both spaces is used.
Problem 3. Let and suppose exists for every . Show the limit functional is bounded. Which theorem applies, and what would fail if were only a normed space?
Problem 4. Show the differentiation operator , is unbounded when carries , and bounded when it carries . What does this say about why a domain is part of an operator’s definition?
Problem 5. Prove that if with then is invertible, constructing the inverse explicitly.
Problem 6. Show the closed graph theorem follows from the open mapping theorem and the bounded inverse theorem.
Problem 7. Prove that if is linear between Banach spaces and with forces , then is bounded.
Problem 8 (important). Someone claims: “for any closed subspace of a Banach space , the quotient map has an isometric right inverse.” Find the flaw. The claim is true when is a Hilbert space (Problem 1), so the argument is to identify exactly which step uses Hilbert structure, and then to give an example of a Banach space with a closed subspace admitting no complement at all.
Key Relationships
Section titled “Key Relationships”- All three Baire-based theorems are one theorem applied three times, each following the pattern: assume a pathology, cover the space by level sets of a bound, get interior from Baire, upgrade pointwise to uniform.
- Completeness is necessary and not decorative. is meagre in itself, so Baire fails there and so does the open mapping theorem.
- Hahn-Banach needs neither Baire nor completeness, and is the only one of the four that holds on a bare vector space with a sublinear gauge.
- Closed graph follows from open mapping by completing the domain, then showing the domain was everything.
- A bijective bounded operator between Banach spaces has a bounded inverse. Drop completeness on either side and this fails, which is the standard way to exhibit incomplete spaces.
- One norm dominating another is not equivalence unless both norms make the space Banach.
Common Pitfalls
Section titled “Common Pitfalls”- Confusing Hahn-Banach with the open mapping theorem. Hahn-Banach extends functionals from subspaces while preserving the norm; the open mapping theorem is about surjectivity of operators and openness of images. Extension versus mapping. Substituting one for the other is the most common confusion in the subject.
- Applying the open mapping theorem without checking hypotheses. Both spaces must be Banach and must be surjective. The identity from an incomplete normed space to its completion is bijective and continuous but not open.
- Reading uniform boundedness as pointwise boundedness. UBP’s hypothesis is for each , with the bound allowed to depend on ; the conclusion is a bound independent of . That gap is the content of the theorem, and it needs Banach.
- Assuming one norm inequality gives equivalence. It gives continuity in one direction only. Equivalence needs both, and completeness is what manufactures the second from the first.
- Claiming every closed subspace of a Banach space has a complement. True for Hilbert spaces via orthogonal complements; false in general. See Problem 8.
- Proving the closed graph theorem by recursion on the graph. It is circular: the recursive step needs the theorem. Complete the domain and use openness, then argue the domain was everything.
- Believing completeness is technical. Every Baire-based theorem above is false on an incomplete space. shows the mechanism in one line.
Cross-References
Section titled “Cross-References”- Normed Spaces and Banach Spaces — completeness, and the fact that finite-dimensional spaces are automatically complete.
- Bounded Linear Operators — , operator norm, and the unbounded operators these theorems exclude.
- Compact Operators — the Fredholm alternative, which uses the bounded inverse theorem.
- Weak and Weak* Convergence — Banach-Alaoglu, a weak*-compactness statement, and the weak/norm boundedness contrast from uniform boundedness.
- Sequences and Limits — Cauchy sequences and completeness.
- Homomorphisms and Isomorphism Theorems — quotients, which is what in Problem 8 is.
- Classical Mechanics