Introduction to Differential Equations

Introduction to Differential Equations What is a Differential Equation? A differential equation is a mathematical equation that relates an unknown function to one or more of its derivatives. In other words, it's an equation involving a function and how that function changes. The key insight is this: differential equations describe the rate of change of a quantity. They tell us how fast something is changing, and how that rate of change depends on the quantity itself and possibly on other variables (like time or position). For example, the equation $\frac{dy}{dt} = 2y$ relates a function $y(t)$ to its derivative $\frac{dy}{dt}$. This particular equation says: "the rate at which $y$ changes is proportional to $y$ itself." What Does It Mean to Solve a Differential Equation? Solving a differential equation means finding a function (or family of functions) that satisfies the given relationship. When we solve $\frac{dy}{dt} = 2y$, we're looking for function(s) $y(t)$ such that when we take the derivative, we get exactly $2y$. It turns out that $y(t) = Ce^{2t}$ (for any constant $C$) is a solution—try differentiating it and you'll see that $\frac{d}{dt}(Ce^{2t}) = 2Ce^{2t} = 2y$. ✓ The word "family" is important: differential equations typically have many solutions, differing by constants. We'll see later how to pin down a specific solution using additional information. Types of Differential Equations Ordinary vs. Partial Differential Equations There are two main types of differential equations, distinguished by how many independent variables appear: Ordinary Differential Equations (ODEs) involve an unknown function of a single independent variable. For instance, $y(t)$ might depend only on time $t$, or $y(x)$ might depend only on position $x$. The derivatives are written as ordinary derivatives like $\frac{dy}{dt}$ or $y'$. Partial Differential Equations (PDEs) involve a function of multiple independent variables, and we take partial derivatives with respect to those variables. For example, $\frac{\partial u}{\partial t} + \frac{\partial u}{\partial x} = 0$ involves a function $u(t,x)$ that depends on both time and space. This course focuses on ordinary differential equations. PDEs are more complex and typically studied in advanced courses. The mathematical framework for ODEs—their solutions, their behavior, and methods for solving them—is the foundation you need. Classification of Ordinary Differential Equations Once we know we're dealing with an ODE, we classify them further in two important ways: by order and by linearity. Order of an ODE The order of a differential equation is the highest derivative that appears in the equation. A first-order ODE contains only the first derivative $y'$ (or $\frac{dy}{dt}$). Example: $y' + 2y = t$ A second-order ODE contains the second derivative $y''$ (or $\frac{d^2y}{dt^2}$). Example: $y'' + 3y' + 2y = 0$ Order matters because it tells you something important: a first-order ODE needs one piece of additional information to have a unique solution, and a second-order ODE needs two pieces of information. We'll explore this more in the next section. Linearity of an ODE An ODE is linear when: The unknown function $y$ and all its derivatives appear only to the first power They are not multiplied together Linear equations look like: $y'' + 3y' + 2y = e^t$ or $y' + 5y = \sin(t)$ Nonlinear equations have products or powers, like: $y' = y^2$ or $yy'' + y' = 1$ Linear ODEs are much easier to solve systematically, and we have powerful general methods for them. Nonlinear ODEs are often more difficult and may require specialized techniques. Homogeneous vs. Non-Homogeneous Linear ODEs For linear equations specifically, we make one more distinction based on what's on the right-hand side: A homogeneous linear ODE has zero on the right-hand side: $y'' + 4y = 0$ or $y' + 2y = 0$ A non-homogeneous linear ODE has a non-zero term on the right: $y'' + 4y = \cos(t)$ or $y' + 2y = e^t$ This distinction matters because we solve them differently. For non-homogeneous equations, we typically find the solution to the homogeneous version first, then add a particular solution to the non-homogeneous part. Initial and Boundary Conditions Why Additional Information is Needed A differential equation by itself typically has infinitely many solutions (a family of solutions). For example, $\frac{dy}{dt} = 3y$ has solution $y(t) = Ce^{3t}$ for any constant $C$. To pin down which particular solution we want, we need additional information. This is where initial conditions or boundary conditions come in. Initial-Value Problems An initial-value problem provides the value(s) of the function (and possibly its derivatives) at a single point, usually at the start of an interval. For a first-order ODE, we need one initial condition: $$y(t0) = y0$$ This tells us the value of $y$ at some starting time $t0$. This single condition uniquely determines the constant $C$ in the general solution. Example: Solve $\frac{dy}{dt} = 3y$ with $y(0) = 2$. The general solution is $y(t) = Ce^{3t}$. The initial condition gives us $y(0) = Ce^0 = C = 2$, so the unique solution is $y(t) = 2e^{3t}$. For a second-order ODE, we need two initial conditions. A common form is: $$y(t0) = y0 \quad \text{and} \quad y'(t0) = v0$$ The first tells us the position (or value of $y$) at time $t0$, and the second tells us the velocity (or rate of change) at that same point. These two pieces of information uniquely determine the two constants in the general solution. Boundary-Value Problems A boundary-value problem provides values of the function at two or more distinct points in the domain—typically at the boundaries of an interval. For example: Find $y(x)$ satisfying $y'' + y = 0$ with $y(0) = 0$ and $y(\pi) = 1$. Here we know the value of $y$ at $x=0$ and at $x=\pi$, but not information about the derivative. This is often used in spatial problems (like the temperature distribution along a rod) rather than time-evolution problems. A practical note: Initial conditions are more common in introductory courses because they model how systems evolve over time starting from known initial states. Boundary-value problems are more specialized. Classic Examples of Differential Equations These examples appear frequently because they model real-world phenomena and are tractable to solve. Knowing them helps you recognize patterns. Exponential Growth and Decay One of the most important models is: $$\frac{dy}{dt} = ky$$ where $k$ is a constant (positive for growth, negative for decay). This equation says: the rate of change of $y$ is proportional to $y$ itself. This describes: Population growth (or decline) Radioactive decay Charging or discharging of a capacitor Cooling of a hot object The general solution is: $$y(t) = Ce^{kt}$$ If $k > 0$, the solution grows exponentially. If $k < 0$, it decays to zero. The constant $C$ is determined by an initial condition like $y(0) = y0$. Newton's Law of Cooling When an object at temperature $T$ sits in an environment at temperature $T{\text{env}}$, the object's temperature changes according to: $$\frac{dT}{dt} = k(T{\text{env}} - T)$$ The rate of cooling is proportional to the temperature difference. As the object cools and $T$ approaches $T{\text{env}}$, the difference gets smaller, so the cooling slows down. Eventually the object reaches ambient temperature and stops changing. Simple Harmonic Motion A mass attached to a spring (with no damping and no external force) follows: $$m\frac{d^2x}{dt^2} + kx = 0$$ where $m$ is the mass, $k$ is the spring stiffness, and $x$ is the displacement from equilibrium. Dividing by $m$ and defining $\omega^2 = k/m$, this becomes: $$x'' + \omega^2 x = 0$$ This is a second-order linear homogeneous ODE. Its general solution is: $$x(t) = A\cos(\omega t) + B\sin(\omega t)$$ The object oscillates with angular frequency $\omega$. The constants $A$ and $B$ are determined by two initial conditions: initial position $x(0)$ and initial velocity $x'(0)$. Alternatively, you might see this solution written as $x(t) = C\cos(\omega t + \phi)$ for amplitude $C$ and phase $\phi$. Methods for Solving Ordinary Differential Equations The general strategy for solving ODEs depends on their type. Here are the main techniques: Separation of Variables This method works for first-order ODEs that can be written in the form: $$\frac{dy}{dt} = f(t) \cdot g(y)$$ where the right side is a product of a function of $t$ and a function of $y$. The idea is to "separate" the variables: rearrange to get all $y$ terms on one side and all $t$ terms on the other, then integrate both sides. Example: $\frac{dy}{dt} = 3ty$ Separate: $\frac{dy}{y} = 3t \, dt$ Integrate: $\ln|y| = \frac{3t^2}{2} + C1$ Solve for $y$: $y = Ce^{3t^2/2}$ This method is straightforward but only works when you can actually separate the variables. Many equations can't be separated. Integrating Factor for Linear First-Order Equations When you have a first-order linear equation of the form: $$y' + p(t)y = q(t)$$ you can multiply both sides by an integrating factor $\mu(t) = e^{\int p(t) dt}$. This transforms the left side into the derivative of a product, making the equation easy to integrate. This method is systematic and always works for this form of equation—even when separation of variables won't work. Characteristic Equation for Constant-Coefficient Linear Equations For linear equations with constant coefficients—like $y'' + 3y' + 2y = 0$—we use the characteristic equation method. The idea: assume a solution of the form $y = e^{rt}$, substitute into the equation, and solve for $r$. This converts the differential equation into an algebraic equation (the "characteristic equation") in $r$. For a second-order equation like $y'' + 3y' + 2y = 0$, you get: $$r^2 + 3r + 2 = 0$$ Solving gives $r = -1$ or $r = -2$, so the general solution is: $$y(t) = C1 e^{-t} + C2 e^{-2t}$$ This method is powerful for homogeneous constant-coefficient equations. For non-homogeneous equations, you find the solution to the homogeneous part this way, then add a particular solution. <extrainfo> Laplace Transforms Laplace transforms are particularly useful for linear ODEs when initial conditions are given and the equation has piecewise or discontinuous forcing functions. The Laplace transform converts a differential equation into an algebraic equation, which is often easier to solve. You then take the inverse transform to get back to the original domain. While this is a legitimate and sometimes elegant method, it's typically introduced after the fundamental techniques above. </extrainfo> <extrainfo> Applications and Importance Differential equations are the language of science and engineering because they naturally describe how systems change: Mechanical systems: spring-mass systems, pendulums, oscillators Electrical systems: circuits with resistors, capacitors, and inductors Thermal systems: heat diffusion, cooling, and temperature dynamics Biological systems: population dynamics, disease spread, chemical kinetics Control systems: feedback mechanisms in engineering applications When you can set up the differential equation that governs a system and solve it, you can predict the system's behavior, design it better, or understand why it behaves the way it does. This is why differential equations are so fundamental to science and engineering. </extrainfo>