Introduction to Vector Spaces

Understanding Vector Spaces Vector spaces are one of the most fundamental structures in linear algebra. They provide a unified framework for working with many different mathematical objects—from geometric arrows to polynomials to functions. By understanding what makes something a vector space, you unlock the ability to apply powerful linear algebra techniques across all of mathematics and science. What Are Vectors and Scalars? Before we define a vector space formally, let's understand its building blocks. Vectors are objects that can be added together and scaled. You might think of vectors as arrows in space, but they're actually much more general. Vectors are abstract objects that follow certain rules. Scalars are numbers that we use to scale (multiply) vectors. In most contexts, scalars come from the real numbers $\mathbb{R}$ or the complex numbers $\mathbb{C}$. More formally, scalars form a field—a set of numbers where you can add, subtract, multiply, and divide (except by zero) following the usual rules of arithmetic. The Formal Definition A vector space is a set $V$ equipped with two operations: Vector addition: takes any two vectors $\mathbf{u}, \mathbf{v} \in V$ and produces a vector $\mathbf{u} + \mathbf{v} \in V$ Scalar multiplication: takes any scalar $a$ and any vector $\mathbf{v} \in V$ and produces a vector $a\mathbf{v} \in V$ These operations must satisfy eight axioms (rules). Think of axioms as the definition itself—if these properties hold, then you have a vector space. If even one fails, it's not a vector space. The Eight Axioms The axioms organize naturally into four groups. These aren't arbitrary rules; they capture the essential algebraic structure that makes vectors useful. Closure Axioms The first two axioms ensure that operations don't take us outside our set $V$. Closure under addition: For any $\mathbf{u}, \mathbf{v} \in V$, we have $\mathbf{u} + \mathbf{v} \in V$ Closure under scalar multiplication: For any scalar $a$ and vector $\mathbf{v} \in V$, we have $a\mathbf{v} \in V$ Without these, addition and scalar multiplication wouldn't be proper operations on $V$. Addition Axioms Vector addition must behave like ordinary arithmetic in three ways. Commutativity: $\mathbf{u} + \mathbf{v} = \mathbf{v} + \mathbf{u}$ for all $\mathbf{u}, \mathbf{v} \in V$ Associativity: $(\mathbf{u} + \mathbf{v}) + \mathbf{w} = \mathbf{u} + (\mathbf{v} + \mathbf{w})$ for all $\mathbf{u}, \mathbf{v}, \mathbf{w} \in V$ Zero vector: There exists a special vector $\mathbf{0} \in V$ such that $\mathbf{v} + \mathbf{0} = \mathbf{v}$ for every $\mathbf{v} \in V$ These ensure that addition works the way you expect. Note that commutativity means order doesn't matter—a crucial property for calculation. Inverse and Scalar Multiplication Axioms Vectors need additive inverses, and scalar multiplication needs to interact properly with field operations. Additive inverses: For each $\mathbf{v} \in V$, there exists a vector $-\mathbf{v} \in V$ such that $\mathbf{v} + (-\mathbf{v}) = \mathbf{0}$ Associativity of scalar multiplication: $(ab)\mathbf{v} = a(b\mathbf{v})$ for all scalars $a, b$ and vectors $\mathbf{v}$ Scalar identity: $1\mathbf{v} = \mathbf{v}$ for every vector $\mathbf{v}$ (where 1 is the multiplicative identity in the field) Distributive Laws Scalar multiplication must distribute over both vector and scalar addition. Distribution over vector addition: $a(\mathbf{u} + \mathbf{v}) = a\mathbf{u} + a\mathbf{v}$ for any scalar $a$ and vectors $\mathbf{u}, \mathbf{v}$ Distribution over scalar addition: $(a + b)\mathbf{v} = a\mathbf{v} + b\mathbf{v}$ for any scalars $a, b$ and vector $\mathbf{v}$ These ensure that scalar multiplication interacts nicely with addition on both sides. Why eight axioms? A common point of confusion is why we need all eight. The answer is that each axiom captures something essential. Together, they ensure that linear combinations (weighted sums of vectors) make sense and that concepts like dimension and linear independence are well-defined. If you omitted any axiom, some of these important properties would fail. Common Examples of Vector Spaces Now that you understand the definition, let's see where vector spaces actually appear. Euclidean Space $\mathbb{R}^n$ The most familiar example is $\mathbb{R}^n$, the set of all ordered $n$-tuples of real numbers: $$\mathbb{R}^n = \{(x1, x2, \ldots, xn) : xi \in \mathbb{R}\}$$ Operations are defined componentwise: Addition: $(x1, \ldots, xn) + (y1, \ldots, yn) = (x1 + y1, \ldots, xn + yn)$ Scalar multiplication: $a(x1, \ldots, xn) = (ax1, \ldots, axn)$ $\mathbb{R}^2$ (vectors in the plane) and $\mathbb{R}^3$ (vectors in space) are the cases you likely visualized as geometric arrows. But $\mathbb{R}^n$ works for any positive integer $n$—we just can't draw it for $n > 3$. You can verify that all eight axioms hold. The zero vector is $(0, 0, \ldots, 0)$, and the additive inverse of $(x1, \ldots, xn)$ is $(-x1, \ldots, -xn)$. Polynomial Spaces Let $Pk$ denote the set of all polynomials of degree at most $k$: $$Pk = \{a0 + a1x + a2x^2 + \cdots + akx^k : ai \in \mathbb{R}\}$$ With standard polynomial addition and scalar multiplication, $Pk$ is a vector space. For example, in $P2$: $(3 + 2x + x^2) + (1 + x) = 4 + 3x + x^2$ ✓ (still degree at most 2) $2(3 + 2x + x^2) = 6 + 4x + 2x^2$ ✓ (still degree at most 2) The zero vector is the zero polynomial. This is a natural example where vectors aren't numbers or coordinates—they're functions. Function Spaces Consider the set $C([a,b])$ of all continuous functions on an interval $[a,b]$. With pointwise addition and scalar multiplication: $(f + g)(x) = f(x) + g(x)$ $(af)(x) = a \cdot f(x)$ This is a vector space. The zero vector is the function that equals 0 everywhere. This example shows that vectors can be genuinely infinite-dimensional objects. Why Vector Spaces Matter Understanding vector spaces isn't just about satisfying axioms—it opens doors to powerful mathematical tools. Unified Framework Once you recognize that a set is a vector space, you automatically have access to important concepts: Linear combinations: Any weighted sum $a1\mathbf{v}1 + a2\mathbf{v}2 + \cdots + ak\mathbf{v}k$ makes sense Bases and dimension: You can ask how many "independent directions" your space has Subspaces: Collections of vectors that form vector spaces within a larger space Linear transformations: Maps that preserve the vector space structure Solving Systems of Equations Vector spaces provide the language for solving systems of linear equations. A system like: $$\begin{align} x + 2y &= 5\\ 3x - y &= 4 \end{align}$$ can be viewed as asking: what vector $(x, y)$ satisfies certain constraints? This perspective extends to far more complicated problems. <extrainfo> Applications Across Mathematics and Science The abstract definition of vector spaces makes them useful far beyond basic algebra. They appear in: Differential equations: Solutions to differential equations form vector spaces Computer graphics: Transformations of 3D objects use linear algebra Data analysis: Datasets can be viewed as vectors in high-dimensional spaces Quantum mechanics: The states of quantum systems form vector spaces </extrainfo> Building Blocks for Advanced Study Linear algebra courses build systematically on vector spaces. Once you understand them, you're ready to learn about eigenvalues, diagonalization, and applications to real-world problems. The axioms you memorize now form the foundation for everything that follows.