Normed Spaces and Banach Spaces
1.1 Normed Spaces
Section titled “1.1 Normed Spaces”A normed space is a vector space over or together with a norm satisfying:
- (positive definiteness).
- for all scalars (homogeneity).
- (triangle inequality).
A norm induces a metric , making a metric space.
Example 1. with .
Example 2. with . This norm is weaker: convergence in does not imply pointwise convergence.
Example 3. with for .
Example 4. with .
1.2 Banach Spaces
Section titled “1.2 Banach Spaces”A Banach space is a complete normed space (every Cauchy sequence converges).
Theorem 1.1. is a Banach space for .
Proof. First, is a normed space: positive definiteness and homogeneity are immediate, and the triangle inequality is Minkowski’s inequality, proved in §1.8 below.
Let and let be a Cauchy sequence in , where . For each coordinate ,
so is Cauchy in and converges; define and .
Given , choose with for all . For any finite and ,
The sum is finite, so we may let inside it: . This holds for every ; take the supremum over to get for all . The case is identical with sums replaced by suprema. In particular , so , and in norm.
Note the mechanism, which recurs throughout functional analysis: Cauchy in norm forces coordinatewise convergence; the candidate limit is then shown to lie in the space and to be the norm limit, by letting a finite partial sum absorb the limit.
Theorem 1.2. is a Banach space for .
Proof. The norm axioms again reduce to Minkowski (the integral version, proved identically to §1.8 with sums replaced by integrals; see the page in the measure theory track). For completeness, let be Cauchy in , . Extract a subsequence with
Let , a function in . By monotone convergence and Minkowski,
so is finite almost everywhere. On the full-measure set , the telescoping series converges absolutely, hence converges; define
and set on the null set where the series diverges. Then gives , and for each ,
So the subsequence converges in to . Finally, a Cauchy sequence with a convergent subsequence converges: , choosing with large. The case is simpler: Cauchy in is uniform Cauchy, and a uniform limit of essentially bounded measurable functions is essentially bounded.
Theorem 1.3. is a Banach space, but is not.
Proof. Supremum norm. Let be Cauchy in . For each fixed , the real sequence satisfies , so it is Cauchy; define . Given , choose with for all and all ; holding and fixed and letting gives for all ; the convergence is uniform. A uniform limit of continuous functions is continuous: given and , pick with and use the continuity of at in the bound
So and in .
norm. Not complete; the explicit Cauchy sequence converging to a discontinuous limit is constructed in Practice Problem 1 below.
1.3 Finite-Dimensional Normed Spaces
Section titled “1.3 Finite-Dimensional Normed Spaces”Theorem 1.4. All norms on a finite-dimensional vector space are equivalent.
Proof. Let have dimension with basis , and let be the auxiliary norm . It suffices to show every norm on is equivalent to : equivalence of norms is transitive, and both inequalities below compose.
Upper bound. For ,
Lower bound. By the upper bound, , so is continuous as a function on with the metric. The set is compact (closed and bounded in finite dimensions; Heine—Borel), and the function is strictly positive on : if then (positive definiteness), so all (basis), contradicting . A continuous function on a compact set attains its infimum, so . For the vector lies on , so
Corollary 1.5. Every finite-dimensional normed space is a Banach space.
Proof. Let be finite-dimensional. A -Cauchy sequence is -Cauchy by Theorem 1.4, i.e. each coordinate is Cauchy in , hence convergent ( and are complete). Convergence in implies convergence in , again by Theorem 1.4.
One consequence used constantly: every finite-dimensional subspace of a normed space is closed, being complete in its own right (a complete subspace of a metric space is closed; its complement is open, since a point at distance zero from it is its limit point).
Theorem 1.6 (Riesz’s Lemma). Let be a normed space and a proper closed subspace. For every , there exists with and .
Proof. Pick any . Since is closed, is open, so some ball around misses and . Choose with ; possible since makes . Set
For any ,
and (a subspace absorbs scaling and addition), so the last quantity is at least .
Corollary 1.7. The closed unit ball of a normed space is compact if and only if the space is finite-dimensional.
Proof. () If is finite-dimensional, fix a linear isomorphism with . By Theorem 1.4 the closed unit ball is closed in, and contained in a multiple of, the Euclidean unit ball under this identification; closed and bounded in ; hence compact by Heine—Borel.
() Contrapositive. Suppose is infinite-dimensional and build a sequence in the unit ball with no Cauchy subsequence. Pick with . Inductively, having chosen , let ; a finite-dimensional subspace, hence closed (Corollary 1.5), and proper (as is infinite-dimensional). Riesz’s lemma with produces with and .
For the point lies in , so . No subsequence is Cauchy, so the closed unit ball is not (sequentially) compact; and in a metric space compactness and sequential compactness coincide.
This corollary is the first taste of what makes infinite dimensions genuinely different: in finite dimensions, closed and bounded is compact; in infinite dimensions it never is.
1.4 Quotient Spaces
Section titled “1.4 Quotient Spaces”Let be a normed space and a closed subspace. The quotient space consists of equivalence classes with the quotient norm:
Theorem 1.8. If is a Banach space and is a closed subspace, then is a Banach space.
Proof. The quotient norm is a norm. Homogeneity and positivity of the infimum are clear, and the triangle inequality follows since for any ,
so taking infima over and separately gives . Finally, means is a limit of points of , i.e. (closedness is exactly what is used here), so .
Completeness. Let be Cauchy in . Extract a subsequence with . Since , choose with
Now define and inductively . The increments are absolutely summable, so converges in the Banach space ; write the limit as . Passing to quotients, the recursion telescopes:
the last step by induction from . Hence
so the subsequence converges, and a Cauchy sequence with a convergent subsequence converges, as in Theorem 1.2.
Proposition 1.9. The quotient map , , is a bounded linear operator with (for a proper closed subspace).
Proof. Linearity is inherited from the vector space quotient. Since , , so . Conversely, Riesz’s lemma provides, for every , a unit vector with and ; so for all , whence . Combining: .
Note the sup is generally not attained: Riesz’s lemma gives for each but not necessarily . In finite dimensions the unit sphere is compact and the sup is attained; in infinite dimensions it can genuinely fail to be.
1.5 Dual Spaces
Section titled “1.5 Dual Spaces”The dual space of a normed space is the space of all bounded linear functionals , equipped with the operator norm:
Theorem 1.10. The dual space is always a Banach space, regardless of whether is complete.
Proof. Linearity of the candidate limit. Let be Cauchy in the operator norm. For each fixed , , so is Cauchy in ; define . Taking limits in the linearity identity gives linearity of .
Boundedness. Cauchy sequences are bounded in norm: for all . So for every and ; let : , so .
Convergence in norm. Given , choose with for . Fix and with . Then for every ,
Let : the first term tends to , giving for all . Taking the supremum over such : .
Note where completeness of would have been used; nowhere. The dual is complete because the scalar field is, and the operator norm controls convergence uniformly on the unit ball.
Examples of dual spaces:
- where for .
- , where is the space of sequences converging to .
- for and .
1.6 The Completion of a Normed Space
Section titled “1.6 The Completion of a Normed Space”Theorem 1.11. Every normed space has a completion: a Banach space and an isometric embedding with dense image. The completion is unique up to isometric isomorphism.
Proof. Construction. Let be the set of Cauchy sequences in , with iff (an equivalence relation; check transitivity via the argument). Set and define
The limit exists because (reverse triangle inequality) makes Cauchy in . It is well defined: replacing by an equivalent sequence changes each by at most . The norm axioms pass to the limit from each coordinate.
The embedding. is linear, and : isometric. Its image is dense: given and , pick with for ; then
Completeness. Let be Cauchy in . Choose representatives with (density). Then for large,
so is Cauchy in ; let . A three-term estimate with the same ingredients gives . So is complete.
Uniqueness. Given two completions and , define on the dense subspace by . On , is isometric:
An isometry on a dense subspace of a metric space extends uniquely to an isometry on the whole space (the extension sends along any sequence in the subspace converging to ; well defined by isometry and Cauchy). The extension is surjective: its image is complete; being isometric to a complete space; hence closed in , and it contains the dense set .
Example. The completion of is .
1.7 Infinite-Dimensional Normed Spaces
Section titled “1.7 Infinite-Dimensional Normed Spaces”Infinite-dimensional normed spaces have properties that contrast sharply with finite-dimensional ones:
- The closed unit ball is not compact (Riesz’s lemma).
- There exist discontinuous linear operators (requires the axiom of choice).
- Not every linear subspace is closed.
- The weak topology differs from the norm topology.
1.8 Hölder and Minkowski Inequalities
Section titled “1.8 Hölder and Minkowski Inequalities”Lemma 1.12.0 (Young’s inequality). For and , all :
Proof. If or both sides vanish. Otherwise fix and minimise over . Then , which vanishes at , and , so this is the global minimum (with confirming the boundary is worse). The value there:
Since , the minimum is . So everywhere.
Theorem 1.12 (Hölder’s Inequality). For with :
Proof. Case . If or the inequality is trivial. Otherwise normalise: and satisfy , and both sides scale by the same factor , so it suffices to prove .
For every and every , Young’s inequality with , gives . Summing over :
The partial sums are increasing and bounded, so the full series converges with sum .
Case , : termwise, then sum. Case symmetrically.
Theorem 1.13 (Minkowski’s Inequality). For :
Proof. is the ordinary triangle inequality in , summed; is the supremum version. Let and its conjugate. The case is trivial; otherwise expand:
Apply Hölder to each sum. Since , the Hölder factor for the second argument is
so
If , divide both sides by ; the exponent satisfies , leaving .
These inequalities prove that and are normed spaces. The integral versions follow by the identical arguments with sums replaced by integrals; see the page in the measure theory track, where the completeness of is also treated.
1.9 Practice Problems
Section titled “1.9 Practice Problems”Problem 1. Show that with is not complete.
Solution. Consider . This is a Cauchy sequence in but converges to the discontinuous step function.
Problem 2. Prove that for .
Problem 3. Show that for .
Problem 4. Prove that the dual of is .
1.10 Weak Topologies
Section titled “1.10 Weak Topologies”A normed space carries the weak topology , the coarsest topology making all continuous. A sequence converges weakly () if for every .
The dual space carries the weak-* topology , the coarsest topology making all evaluation maps continuous.
Theorem 1.14 (Banach-Alaoglu). The closed unit ball of is compact in the weak-* topology.
Proof. Let . For each let , a closed disc; compact by Heine—Borel in or . Consider the product and the map
The weak-* topology on is exactly the subspace topology inherited from : both are initial topologies for the same family of coordinate maps . So is compact iff is compact as a subspace of .
is compact by Tychonoff’s theorem (Theorem 8.4 in the topology track). And is closed in : a point lies in iff
and each of these conditions is closed; the map is a finite combination of coordinate projections, hence continuous, and the condition is the preimage of . (Positivity of the norm needs no separate condition: is built into , and it reproduces by taking suprema.) A closed subset of a compact space is compact, so ; hence ; is compact.
1.11 Separable Normed Spaces
Section titled “1.11 Separable Normed Spaces”A normed space is separable if it contains a countable dense subset.
Examples: is separable for . is not separable. is separable (polynomials with rational coefficients are dense).
Theorem 1.15. If is separable, then is separable. The converse does not hold: is separable but is not.
Proof. Let be a countable dense subset of the unit sphere ; separability of gives a countable dense set in all of , and intersecting with spheres (or normalising) yields one in the sphere. For each pick with and (the unit norm is a supremum, so values arbitrarily close to are attained).
Claim: the rational span of is dense in . is countable. Suppose not dense; then some and have . The distance functional extends: by Hahn—Banach (Theorem 1.3 of the fundamental-theorems page) there is with , , and .
Density of in the sphere gives a subsequence in operator norm. But for every ,
since . The right side tends to ; contradiction. So is dense and is separable.
1.12 Reflexive Spaces
Section titled “1.12 Reflexive Spaces”A Banach space is reflexive if the natural embedding defined by is surjective.
Examples: is reflexive for . and are not reflexive. Every finite-dimensional space is reflexive.
Theorem 1.16. A Banach space is reflexive if and only if its closed unit ball is weakly compact.
Proof. () Suppose is weakly compact. The canonical embedding is weak-to-weak-* continuous: for each , the composition is weakly continuous by definition of . Moreover the weak-* topology of restricted to is the weak topology of transported by ; both are initial topologies for the same set of functionals, .
By Goldstine’s theorem (a consequence of Hahn—Banach; see the fundamental-theorems page), is weak-* dense in . As a weakly compact set, is compact in the subspace topology; which is the weak-* topology just identified; and a compact subset of a Hausdorff space is closed in the ambient space. So is weak-* closed, and closed and dense in forces . Scaling: every with is a multiple of a point of , so is surjective.
() Suppose is surjective. Since is an isometry ( by the Hahn—Banach corollary on norming functionals), . Banach—Alaoglu (Theorem 1.14) makes compact in . And is a homeomorphism between and its image with the weak-* subspace topology; continuous, injective, and open onto the image, because the coordinate functionals agree. Compactness is a property of the topology on a set, not of the ambient space, so is weakly compact.
Problem 5. Show that (sequences converging to 0 with sup norm) is not reflexive.
Problem 6. Prove that for is reflexive using the fact that via the natural embedding.
Cross-References
Section titled “Cross-References”Spaces: Provides concrete examples of Banach spaces that are fundamental throughout analysis, with the completeness result proved here.
Inner Product Spaces and Hilbert Spaces: Specialises the normed space theory to spaces where the norm comes from an inner product, enabling orthogonal projections.
Bounded Linear Operators: Develops the theory of continuous linear maps between normed spaces, building on the dual space concept.
Intuition
Section titled “Intuition”Functional analysis extends linear algebra to infinite dimensions. A normed space is a vector space where you can measure the “size” of vectors, and a Banach space is one where Cauchy sequences converge, the space has no “holes.” Think of it as doing linear algebra with functions instead of finite arrays. The dual space contains all continuous linear functionals: machines that take in a vector and return a number. Boundedness and continuity coincide for linear maps, a fact that fails in nonlinear settings. The key challenge of infinite dimensions is that bounded sequences need not have convergent subsequences, compactness becomes a rare and precious property, requiring special conditions like reflexivity.
1.13 Common Mistakes
Section titled “1.13 Common Mistakes”Mistake 1: Confusing a norm with a metric A norm on a vector space induces a metric , but not every metric comes from a norm. The discrete metric for is not induced by any norm because norms are homogeneous (), which the discrete metric violates. Always verify that a metric is translation-invariant and homogeneous before assuming it comes from a norm.
Mistake 2: Assuming bounded linear operators are automatically continuous In the context of linear operators, boundedness and continuity are equivalent for linear maps between normed spaces. However, students sometimes confuse bounded linear functionals with bounded sets. A bounded linear functional satisfies for some constant , not that is a bounded set.
Mistake 3: Forgetting that is not complete The space of continuous functions with the -norm is not a Banach space because Cauchy sequences can converge to discontinuous functions. Only is complete. When completeness is required, always verify the norm, not just the underlying set.