Level 1B: Linear Algebra Done Wrong
The Defect. The standard linear algebra course starts with matrices and row reduction, a computational approach that treats vectors as column arrays and linear maps as grids of numbers. This works for computation but obscures the geometry: a vector is not a column of numbers; a linear map is not a grid. The coordinate-free approach of Sergei Treil’s Linear Algebra Done Wrong treats vectors as abstract elements of a vector space and linear maps as structure-preserving functions, introducing coordinates only at the very end as a computational convenience. This page follows that approach.
The One-Line Reveal. The entire page follows from one definition: a vector space is a set with addition and scalar multiplication satisfying eight axioms. Everything else (dual spaces, quotient spaces, exterior algebra, determinants) is constructed from this single definition by universal properties and dimension counting.
Scope. All vector spaces in this course are finitely generated: spanned by finitely many vectors. For spaces not spanned by any finite list, even the existence of a basis is equivalent to the axiom of choice; that set-theoretic territory is never needed downstream and is avoided here. A field is a system of scalars with addition, multiplication, and division, of characteristic different from , such as , , or ; nothing below uses more than the field axioms together with , which the polarisation step of Lemma 4.4 needs.
1. Vector Spaces and Linear Maps
Section titled “1. Vector Spaces and Linear Maps”Definition. A vector space over a field is a set with addition and scalar multiplication satisfying eight axioms: associativity and commutativity of addition, additive identity, additive inverses, scalar identity , compatibility , and distributivity of scalar multiplication over vector addition and over scalar addition.
Definition. A function between vector spaces is a linear map if for all and . The set of all linear maps from to is denoted or .
Theorem 1.1. is itself a vector space under pointwise addition and scalar multiplication.
Proof. Each axiom is inherited from . The zero map is the additive identity. For , the pointwise sum is linear: it distributes over arguments because each does and ‘s addition does. Likewise is linear. The remaining axioms (associativity, commutativity, distributivity, identities, inverses ) hold pointwise because they hold in at every argument.
Bases and Dimension
Section titled “Bases and Dimension”Definition. A list of vectors of is linearly independent if the only scalars with are ; it spans if every can be written . A basis is a list that is both.
Coordinates and their uniqueness. If is a basis, every has an expression , and the scalars (the coordinates of ) are unique: if , then , so independence forces for every .
Theorem 1.2 (bases exist). If finitely many vectors span , then has a basis.
Proof. Among all lists spanning , choose one of minimal length, . If it were dependent, some nontrivial combination would have for some ; solving gives . Deleting leaves a shorter list that still spans: any expression over the full list can be rewritten with replaced by that combination. This contradicts minimality, so the minimal spanning list is independent, hence a basis.
Lemma 1.3 (exchange). If are linearly independent and span , then .
Proof. We show by induction on that for each there is a subset with such that the list together with spans . For , take . Assume the claim for , with . Since lies in the span of the list, . If all were zero, then would be a nontrivial dependence among (its coefficient is ), contradicting independence. So some with ; solving for shows the list with replaced by still spans, which is the claim for with . If , the induction runs to , giving : the list alone spans . Applying the induction step once more would express as a combination of (there are no ‘s left to carry any ), contradicting independence. Hence .
Corollary 1.4 (dimension is well defined). Any two bases of have the same length. This common length is the dimension .
Proof. Apply Lemma 1.3 twice: with basis one playing the independent list and basis two the spanning list, and vice versa.
Lemma 1.5 (basis extension). If are linearly independent in and span , then the ‘s can be extended, using some of the ‘s, to a basis of .
Proof. Choose maximal such that together with remains independent. Such an exists (the empty set works) and there are finitely many subsets, so a maximal one can be chosen. We claim and together span . If not, some lies outside their span; then adjoining keeps the list independent. Indeed, suppose with some coefficient nonzero. If , then is a combination of the others, contrary to its choice; so , and then all other coefficients vanish because the shorter list is already independent. This contradicts the maximality of . So the list is independent and spans , i.e. it is a basis extending the ‘s.
Theorem 1.6 (subspaces are finitely spanned). Every subspace of a finitely spanned space is finitely spanned.
Proof. Let span . By the exchange lemma (Lemma 1.3), every linearly independent list in has at most members (apply the lemma with the list in question playing the independent part and the ‘s the spanning part). So the independent lists in have lengths bounded by ; among them, choose one of maximal length, (the empty list qualifies, so a maximal one exists). We claim the ‘s span . If some lay outside their span, then would be a longer independent list in : a dependence with would solve for as a combination of the ‘s, forcing , and then all by independence; so the longer list is independent, contradicting maximality. Hence the ‘s span .
Theorem 1.7 (rank–nullity). For every linear map ,
Proof. The kernel is a subspace of the finitely spanned , so by Theorem 1.6 it is finitely spanned and by Theorem 1.2 it has a basis (empty, with , if ). Extend it to a basis of by Lemma 1.5. The images span : any decomposes as , and because the -terms map to zero. They are independent: if , then , so equals some ; moving everything to one side gives a vanishing combination of the full basis , so every coefficient is zero, in particular every . Hence is a basis of , so , while because is a basis of .
The One-Line Reveal. The proof splits into two pieces: the part that maps to zero (the kernel) and the part that maps injectively (the extension). The splitting is possible by basis extension, and then the theorem is just counting.
Quick check.
- Recite the eight vector-space axioms in one breath.
- Why must a minimal spanning list be independent?
- State the exchange lemma.
- Why is dimension well defined?
- What does basis extension give?
Answers: 1. Associative commutative addition with identity and inverses; ; ; two distributivities. 2. A dependent member can be deleted while still spanning, contradicting minimality (Theorem 1.2). 3. An independent list in a finitely spanned space has length at most the spanning list (Lemma 1.3). 4. Lemma 1.3 applied in both directions between two bases (Corollary 1.4). 5. Any independent list extends, using pieces of a spanning list, to a basis (Lemma 1.5).
2. Dual Spaces
Section titled “2. Dual Spaces”Definition. The dual space is the space of all linear functionals on : linear maps .
Theorem 2.1. .
Proof. Let be a basis of . Define (the dual basis) by (Kronecker delta). These are linearly independent: if , evaluate on to get . They span: for any and any , linearity gives , and since ( is linear and kills every with ), we get
So , and the dual basis spans . Hence is a basis of and .
The One-Line Reveal. The dual basis is defined by where it sends the basis vectors, and the delta ensures it picks out exactly one coordinate. This is the coordinate-free version of “the transpose.”
Theorem 2.2. The map defined by is an isomorphism.
Proof. is linear in : for fixed , the assignment is linear, so agrees with on every , and two functionals agreeing on all arguments are equal. It is injective: if , then for all ; taking gives for every , so by the uniqueness of coordinates. Since (Theorem 2.1 applied twice), injective plus equal dimensions gives surjective.
Definition. For a linear map , the dual map is , . It is linear, because . Applying the construction twice gives .
Proposition 2.3 (naturality of ). For every linear map , the square
commutes: .
Proof. Take and . Then : the first step is the definition of the dual of a dual map, the middle step is the definition of , and the last is the definition of . Since the two elements of agree on every , they are equal; and this holds for every .
Why this is “natural.” The isomorphism is canonical: it does not require choosing a basis. In contrast, the isomorphism (represented, once a basis is chosen, by ) does require a basis. This is why the double dual is “better” than the dual: the isomorphism is not an artefact of coordinates. In the language of category theory, Proposition 2.3 says precisely that is a natural transformation from the identity functor to the double-dual functor: the square above is exactly the commuting square from the definition of a natural transformation.
Quick check.
- What is the dual basis of ?
- Why is canonical while is not?
- Define the dual map .
- What does Proposition 2.3 say?
- Compute for .
Answers: 1. Functionals with . 2. uses no choice of basis; the isomorphism needs one. 3. . 4. : the square commutes. 5. .
3. Quotient Spaces
Section titled “3. Quotient Spaces”Definition. Let be a subspace. The quotient space is the set of equivalence classes under the relation iff .
Theorem 3.1. is a vector space with .
Proof. Addition and scalar multiplication are well defined: if and , then , so ; likewise for scalars. The vector space axioms hold because they hold for representatives. The zero vector is . The dimension formula follows from rank–nullity (Theorem 1.7) applied to the quotient map , : by definition of the relation, and is surjective by construction, so .
The One-Line Reveal. The quotient space “sets to zero”: every vector in becomes the zero vector of , and rank–nullity counts what you collapse () plus what remains ().
Theorem 3.2 (universal property of the quotient). Let be the quotient map. A linear map with induces a unique linear map with .
Proof. Define . This is well defined: if , then , so . It is linear because is: , and likewise for scalars. By construction . For uniqueness: every element of has the form (surjectivity, Theorem 3.1), so any with must send to ; there is no freedom left.
Quick check.
- When do two cosets coincide?
- Why is the kernel of the quotient map equal to U?
- State the universal property of the quotient.
- What is the dimension of the quotient?
- What makes a map out of the quotient well defined?
Answers: 1. v + U = v’ + U exactly when v - v’ lies in U. 2. The quotient map sends v to U exactly when v lies in U. 3. A map killing U factors uniquely through the quotient map (Theorem 3.2). 4. dim V minus dim U. 5. It must take the same value on every representative: its pre-composition must kill U.
4. Alternating Forms and the Determinant
Section titled “4. Alternating Forms and the Determinant”This section constructs the determinant honestly: not as an opaque formula, but as the unique normalised alternating multilinear form, with the formula derived rather than decreed. The only combinatorial input is the sign of a permutation, which is proved from scratch.
Permutations and their sign
Section titled “Permutations and their sign”Definition. A permutation of is a bijection . A transposition is a permutation that swaps two elements and fixes all others.
Lemma 4.1 (cycle decomposition). Every permutation is a product of transpositions.
Proof. Powers of act injectively: if with , applying (which exists, being a bijection) gives . So among (that is values in an -element set), two coincide, and by injectivity of the powers the first coincidence is a return: for some . The permutation that cycles the orbit and fixes everything else is a product of transpositions, : following any element through the factors confirms this (check the orbit elements; all others are fixed by every factor). Now let agree with off the orbit of and fix the orbit pointwise; then (apply first: on the orbit it is the identity and reproduces ; off the orbit is the identity and reproduces ), and moves strictly fewer elements than . Induct on the number of moved elements.
Lemma 4.2 (the sign polynomial). Let , a polynomial in . Swapping the variables and (with ) carries to .
Proof. Inspect the factors of in three groups. Factors with are unchanged. The factor becomes . Each remaining factor involves exactly one of and some third index , and the two factors involving multiply to the same value before and after the substitution: if they are , which becomes , the same product; if they are , which becomes , the same product; if they are , which becomes , again the same product. So every factor is preserved except , which negates; the total product negates.
Definition (action on polynomials). For and a polynomial in , let be the polynomial . With this convention , since both sides substitute for .
Proposition 4.3 (the sign). For every there is a sign with . Moreover: (i) if is a product of transpositions, then , so the parity of is the same for every factorisation; (ii) .
Proof. The polynomial runs over each unordered pair exactly once, because is a bijection; each factor is up to an overall sign. So . Also : substituting makes every factor with a nonzero number. So is well defined. For (i), induct on : the case is , and gives ; if is a transposition swapping , then is with those variables swapped, which is by Lemma 4.2, so ; and the induction step follows from together with linearity of the action, . For (ii): , and cancelling the nonzero gives the claim.
Alternating forms
Section titled “Alternating forms”Definition. Let be a vector space and . An alternating -form on is a function , linear in each argument separately (making it multilinear), with whenever two arguments coincide. The alternating -forms form a vector space under pointwise operations: every axiom is checked argument by argument, exactly as in Theorem 1.1.
Lemma 4.4 (swapping negates; the converse). An alternating form negates under the exchange of any two arguments; conversely, a -linear form whose values negate under every exchange of two arguments is alternating.
Proof. Put into two positions of the form and expand by multilinearity in those positions: , the two pure terms vanishing by alternation; so the value swaps sign under the exchange. Conversely, if every exchange negates the value, then , so , and since the field’s characteristic is not (Scope), .
Lemma 4.5 (sorting). For and any alternating -form on with basis : .
Proof. By Lemma 4.1 write as a product of transpositions, and induct on . The case is trivial. For the step, let be a transposition and suppose the claim for ; then the tuple agrees with except that the entries in the two positions moved by are exchanged, so Lemma 4.4 gives . By Proposition 4.3(ii) and , , completing the induction.
The determinant
Section titled “The determinant”Theorem 4.6 (determination). Let be an alternating -form on with basis , and write for the coordinates. Then
In particular, an alternating -form is determined by the single scalar .
Proof. Expand the arguments one at a time by multilinearity:
the sum running over all ordered -tuples of indices. If two coincide, the term vanishes by alternation. The surviving terms have all distinct; an injective self-map of a finite set is a bijection, so is a permutation , and Lemma 4.5 evaluates as . Summing the surviving terms gives the display.
Theorem 4.7 (existence: the Leibniz form). The function
is an alternating -linear form with .
Proof. -linearity. In the -term exactly one factor, , involves , and it is the coordinate of along , a linear function of . A sum of functions each linear in is linear in ; this holds for every .
Alternation. Let be a transposition and compare with term by term. The -term of the former is (the -th argument is , whose coordinates are indexed by ). Reindex the product with : since , the product becomes where . And by Proposition 4.3(ii). So the terms of are exactly the negatives of the terms of , and ; taking to be any two positions proves alternation via Lemma 4.4’s equivalence.
Normalisation. The coordinates of are . The -term is : nonzero only if for every , i.e. , contributing .
Definition (determinant). The determinant of an matrix is the value of the Leibniz form on its columns: . The determinant of a linear map is , where is the matrix of in any basis; Corollary 4.9 shows the choice of basis does not matter.
Convention (matrices). The matrix of in a basis is the array whose -th column holds the coordinates of ; matrices act on coordinate columns by producing coordinates, and the matrix of a composition is the product of the matrices, because the -th column of the product is applied to the -th column of , which is exactly the image of under the composition computed in coordinates. This columnwise check is the only matrix-composition fact used below.
Theorem 4.8 (multiplicativity). For linear maps , .
Proof. Fix and consider , an alternating -linear form: composing each argument with the linear map preserves multilinearity, and repeated arguments still give zero. By Theorem 4.6, is determined by its value on the basis: with . So for all arguments,
Apply this twice:
The left side is itself an alternating -form in the , so by Theorem 4.6 it equals its own basis value times , and that basis value is . Cancelling the nonzero form (Theorem 4.7 gives ) yields .
Corollary 4.9. A linear map is invertible if and only if ; and does not depend on the basis used to compute it.
Proof. If is invertible with inverse , then (the Leibniz sum of the identity matrix is , and multiplicativity applies), so . Conversely, if and an inverse existed, the same computation would give the absurdity ; so no inverse exists. For basis independence: if and are the matrices of in bases and , let be the matrix whose -th column holds the -coordinates of . Then the -th column of holds the -coordinates of , and applying converts -coordinates to -coordinates; so . Hence , since by the invertibility computation above.
The One-Line Reveal. The determinant is not decreed; it is forced. An alternating -form is determined by one scalar (Theorem 4.6), a normalised one exists (Theorem 4.7), so the determinant exists and is unique, and the Leibniz formula is exactly what uniqueness dictates. Multiplicativity then falls out of composing an alternating form with a linear map.
Quick check.
- How is the sign of a permutation defined on this page?
- What is the sign of a product of permutations?
- State the determination theorem in one line.
- Why does the Leibniz form equal one on the basis?
- What is the determinant of the inverse in terms of the determinant?
Answers: 1. sigma P equals the sign times P, for P the product of (x_i - x_j) over i less than j (Proposition 4.3). 2. Signs multiply: a transposition has sign minus one (Proposition 4.3). 3. An alternating n-form is the Leibniz form times its value on the basis (Theorem 4.6). 4. Only the identity permutation survives the delta coordinates. 5. Its reciprocal: the two determinants multiply to the determinant of the identity, which is one.
5. The Exterior Algebra
Section titled “5. The Exterior Algebra”The exterior powers are the spaces of -dimensional volume measurements: measures signed areas, measures signed -volume. They are what later levels use to build differential forms.
Definition (free vector space). For a set , the free vector space on is the set of formal finite linear combinations with (all but finitely many coefficients zero), with coordinatewise addition and scalar multiplication. The symbols form a basis: a linear map from a free vector space is uniquely determined by arbitrary prescribed values on the symbols .
Definition (exterior power). Fix and let be the free vector space on (the set of -tuples of vectors), writing for the symbol of a tuple. Let be the subspace spanned by every instance of the multilinearity relations in each argument,
and every instance of the repetition relations (any two positions equal). The -th exterior power is the quotient (a quotient of vector spaces, Section 3), and the coset of is written , a pure wedge. We also set .
By construction, the map is -linear (the multilinearity relations say exactly this) and alternating: a tuple with a repeated entry lies in , so its wedge is zero.
Theorem 5.1 (anticommutativity). Exchanging any two positions of a pure wedge negates it: for .
Proof. The tuple with in both positions and has a repeated entry, so its wedge is zero. Expand by -linearity in those two positions: , where is the wedge with in the two positions, with them exchanged, and the wedges with one vector repeated in both positions. The last two vanish; so .
Corollary 5.2. If are linearly dependent, then .
Proof. Exchanging positions only changes a wedge by a sign (Theorem 5.1), so reorder so that the dependent vector is last: some . Then by linearity in the last argument, , and every summand has in two positions, hence vanishes.
Theorem 5.3 (universal property). For every alternating -linear map (with any vector space) there is a unique linear map with .
Proof. Let be the linear map sending each symbol to ; a linear map out of a free vector space is determined by arbitrary values on the basis symbols. The subspace lies in : each multilinearity relation maps to because is multilinear, and each repetition relation maps to because is alternating. By the universal property of the quotient (Theorem 3.2, with in place of and in place of ), induces a linear with for the quotient map ; evaluating on symbols gives the claimed formula. For uniqueness: the symbols span , so their images, the pure wedges, span (surjectivity of preserves spanning), and a linear map is determined by its values on a spanning set.
Theorem 5.4 (dimension). for , and for .
Proof. Spanning. Expand each argument of a pure wedge in the basis, using -linearity:
If some index repeats, the wedge vanishes (Corollary 5.2). Otherwise the indices are distinct, and reordering into increasing order negates the wedge by at each exchange of positions (Theorem 5.1), for a total sign when exchanges are used. The parity of is independent of how the reordering is performed (Proposition 4.3(i) applied to the reordering permutation), so the sign is well defined, and the wedge equals with . Hence the increasing wedges , one for each -element subset of , span . For there are no such subsets, and .
Independence. For each increasing tuple we build a linear functional with if and otherwise. First define, using the dual basis from Section 2 and the determinant of Section 4, the function
the determinant of the matrix whose entry is the -coordinate of . Each entry is linear in , so is -linear. It is alternating: if two arguments coincide, two columns of the matrix coincide, and the term-pairing computation in the proof of Theorem 4.7 shows the Leibniz sum of a matrix with two equal columns negates under their exchange, so it is zero. By the universal property (Theorem 5.3), induces a linear functional on . Now evaluate on basis wedges: , so . If , the matrix is the identity and the value is . If , the two increasing tuples differ as sets, so some appears in no : the -th row of the matrix is zero, and the determinant is .
Finally, if , apply : for every . So all coefficients vanish: the increasing wedges are independent. Together with spanning, they are a basis, and is the number of -element subsets of an -element set, .
Corollary 5.5 (the top wedge and the determinant). is one-dimensional, spanned by , and for all ,
where is the matrix whose -th column holds the coordinates of .
Proof. with that spanning vector, by Theorem 5.4. The identity is the spanning computation specialised to : expanding gives ; non-increasing tuples either repeat an index (vanishing) or form a permutation of , whose reordering into increasing order contributes exactly the sign (as in the proof of Theorem 5.4, with well-definedness from Proposition 4.3(i)). The surviving coefficient is .
Remark (the full exterior algebra). The direct sum has dimension and carries a multiplication extending , with a -wedge and a -wedge multiplying into . Proving that multiplication well defined on the quotients is a short universal-property argument, constructed when it is first needed for differential forms; the individual powers built here are what the intervening levels use.
Quick check.
- What is a pure wedge?
- Why does ?
- Why do dependent vectors wedge to zero?
- State the universal property of .
- What is , and what for ?
- Write in terms of the determinant.
Answers: 1. The coset in of a tuple’s symbol. 2. Expand (Theorem 5.1). 3. Substitute the dependence; every resulting term repeats a factor (Corollary 5.2). 4. Alternating -linear maps factor uniquely through the wedge (Theorem 5.3). 5. ; and (Theorem 5.4). 6. (Corollary 5.5).
6. Problems
Section titled “6. Problems”- Prove that the coordinates of a vector in a basis are unique. (§1 – two expressions for the same vector subtract to a vanishing combination, and independence forces every coefficient of the difference to be zero.)
- A space is spanned by four vectors and contains a linearly independent list of five. Which lemma rules this out, and what does its proof do when the independent list is longer than the spanning one? (§1 – the exchange lemma, Lemma 1.3; it replaces spanning vectors one at a time until none remain, and the next replacement attempt exhibits a dependence among the independent list, a contradiction.)
- Prove that is linear. (§2 – composition distributes over pointwise sums and scalar multiples of functionals, evaluated at an arbitrary .)
- Compute of the 3-cycle and prove that . (§4 – , two transpositions, sign ; and by multiplicativity.)
- Prove without expanding either side. (§4 – the assignment is an alternating -form, so Theorem 4.6 reduces it to its basis value, which factors as the two determinant evaluations.)
- Prove that in if and only if are linearly dependent. (§5 – Corollary 5.2 gives one direction; for the other, extend the independent pair to a basis (Lemma 1.5) and evaluate the functional from Theorem 5.4, which sends to .)
Problems. The quick checks above tested recall. These chain several results and require full written arguments; hints are included where the jump is large.
- Prove that the determinant of a triangular matrix is the product of its diagonal entries. (In the Leibniz sum, forces for some , where the entry is zero.)
- Prove that any vectors in an -dimensional space are linearly dependent. (Exchange lemma, Lemma 1.3, with a basis as the spanning list.)
- Prove that the determinant of a matrix with a zero row is zero. (The Leibniz form is alternating and linear; one argument is the zero vector.)
The One-Line Reveal (for this page)
Section titled “The One-Line Reveal (for this page)”The entire page follows from one shift: treat vectors as geometric objects, not as coordinate arrays. Coordinates appear only when a basis is fixed, and every structural theorem states exactly what does and does not depend on that choice. The exchange lemma fixes dimension without matrices; the dual basis fixes the measurements on ; the universal properties fix what survives quotienting and wedging; and the determinant emerges as the unique normalised alternating form, with the Leibniz formula derived rather than decreed.
Where to go next
Section titled “Where to go next”- Level 2: Topology – continuity, connectedness, and compactness proved from the open-set axioms, building directly on the quotient and universal-property machinery of this page.
- Real Analysis – the rigorous – foundations that underpin the measure theory of Level 4.
- Linear Algebra Done Wrong – Treil’s free book, which develops this material at full depth.