Core Concepts of Vector Spaces

Vector Spaces: Definition, Properties, and Dimension Introduction A vector space is one of the most fundamental structures in linear algebra. It's a mathematical system where you can add elements together and multiply them by scalars (numbers) in ways that follow predictable rules. Understanding vector spaces is essential because many mathematical objects—functions, matrices, polynomials, and more—can all be studied as vector spaces. This abstract framework lets us apply powerful tools and insights across all these different contexts. What is a Vector Space? Formally, a vector space over a field $F$ is a non-empty set $V$ together with two operations: vector addition and scalar multiplication. These operations must satisfy certain rules (the axioms) that we'll discuss next. Vector Addition and Scalar Multiplication Vector addition is an operation that takes any two vectors $u, v \in V$ and produces another vector $u + v \in V$. This operation is straightforward and intuitive—you're combining two vectors to get a third. Scalar multiplication takes a scalar $a \in F$ (a number from the field) and a vector $v \in V$, producing the vector $av \in V$. This stretches, shrinks, or reverses the direction of vectors. The Vector Space Axioms For a set with addition and scalar multiplication to be a true vector space, eight axioms must hold: Closure under addition: If $u, v \in V$, then $u + v \in V$ Associativity of addition: $(u + v) + w = u + (v + w)$ for all $u, v, w \in V$ Commutativity of addition: $u + v = v + u$ for all $u, v \in V$ Existence of zero vector: There exists a vector $\mathbf{0} \in V$ such that $v + \mathbf{0} = v$ for all $v \in V$ Existence of additive inverses: For each $v \in V$, there exists $-v \in V$ such that $v + (-v) = \mathbf{0}$ Closure under scalar multiplication: If $a \in F$ and $v \in V$, then $av \in V$ Compatibility of scalar multiplication: $a(bv) = (ab)v$ for all $a, b \in F$ and $v \in V$ Distributivity: $a(u + v) = au + av$ and $(a + b)v = av + bv$ for all scalars and vectors These axioms ensure that vector spaces have a consistent algebraic structure. The first four axioms tell us that $(V, +)$ forms an abelian group—a structure where addition is well-behaved. The remaining four axioms govern how scalar multiplication interacts with the field structure and vector addition. Real and Complex Vector Spaces The most common vector spaces are real vector spaces, where the field $F$ is $\mathbb{R}$ (the real numbers), and complex vector spaces, where $F$ is $\mathbb{C}$ (the complex numbers). When we say "$\mathbb{R}^n$" or "$\mathbb{C}^n$," we're referring to real or complex vector spaces, respectively. Subspaces and Span Subspaces: Smaller Vector Spaces Not every subset of a vector space is itself a vector space. A subspace is a non-empty subset $W \subseteq V$ that is closed under vector addition and scalar multiplication. This means: If $u, w \in W$, then $u + w \in W$ If $a \in F$ and $v \in W$, then $av \in W$ The key insight is that if these closure properties hold, then $W$ automatically inherits the zero vector from $V$ and satisfies all other vector space axioms, making it a vector space itself. For example, in $\mathbb{R}^3$, any line or plane passing through the origin is a subspace. However, a line or plane that doesn't pass through the origin is not a subspace (because it doesn't contain the zero vector). Span: Building Subspaces from Vectors Given any set $S$ of vectors in $V$, we can ask: what's the smallest subspace containing all of them? The answer is the span of $S$, denoted $\text{span}(S)$. The span consists of all finite linear combinations of vectors in $S$. That is, every vector in $\text{span}(S)$ can be written as: $$a1 v1 + a2 v2 + \cdots + an vn$$ where $v1, v2, \ldots, vn \in S$ and $a1, a2, \ldots, an \in F$. This is a powerful concept: starting with just a few vectors, we can generate an entire subspace by considering all possible linear combinations. Bases and Dimension What is a Basis? A basis of a vector space $V$ is a set of vectors that satisfies two properties: Linear independence: No vector in the basis can be written as a linear combination of the others Spanning property: The span of the basis equals all of $V$ In other words, a basis is a minimal spanning set—it generates the entire space with no redundancy. Why Bases Matter: Unique Representation The beauty of a basis is that every vector in $V$ can be written uniquely as a linear combination of basis vectors. If $\{b1, b2, \ldots, bn\}$ is a basis for $V$, then any vector $v \in V$ can be written in exactly one way as: $$v = c1 b1 + c2 b2 + \cdots + cn bn$$ The scalars $c1, c2, \ldots, cn$ are called the coordinates of $v$ with respect to this basis. These coordinates essentially give you a way to represent abstract vectors using concrete numbers. Dimension The dimension of a vector space is the number of vectors in any basis. This is a fundamental property: remarkably, all bases of the same vector space have the same number of elements. If a vector space has a basis with $n$ vectors, we say it has dimension $n$ and write $\dim(V) = n$. Finite-dimensional vector spaces are those whose dimension is a natural number. Examples include $\mathbb{R}^n$ (dimension $n$), the space of polynomials of degree at most 2 (dimension 3), and the space of $2 \times 3$ matrices (dimension 6). <extrainfo> Infinite-dimensional vector spaces are those whose dimension is an infinite cardinal. Examples include the space of all polynomials (of any degree), the space of all continuous functions on an interval, or the space of all sequences of real numbers. These spaces are important but typically studied in more advanced courses. </extrainfo> Key Takeaway Vector spaces provide an abstract framework for studying linear structures. The concepts of subspace, basis, and dimension are the tools you'll use to understand and work with vector spaces. A basis gives you coordinates—a way to describe vectors concretely—and the dimension tells you how many independent directions you need to span the entire space. Master these fundamental ideas, and you'll have the tools to tackle more advanced topics in linear algebra.