Integral - Integration Techniques
Understand analytical, symbolic, and numerical integration techniques such as substitution, parts, series expansion, and advanced quadrature methods.
Summary
Read Summary
Flashcards
Save Flashcards
Quiz
Take Quiz
Quick Practice
According to the fundamental theorem of calculus, what is the value of $\int{a}^{b} f(x)\,dx$?
1 of 12
Summary
Methods of Computing Integrals
Introduction
Computing integrals is one of the most important skills in calculus. While some integrals can be evaluated using analytical techniques (finding exact symbolic answers), others are too complex for closed-form solutions and require numerical approximation. This guide covers the primary strategies for both approaches, helping you choose the right method for any integral you encounter.
Analytical Techniques
The Fundamental Theorem of Calculus
The Fundamental Theorem of Calculus is the foundation of all integral evaluation. It states that if $F$ is an antiderivative of $f$ on the interval $[a,b]$, then:
$$\int{a}^{b} f(x)\,dx = F(b) - F(a)$$
This theorem transforms the problem of computing an integral into finding an antiderivative. The challenge lies in discovering $F$, which is why we need additional techniques.
Integration by Substitution
Integration by substitution (also called u-substitution) simplifies integrals by changing variables. The strategy is to identify an inner function whose derivative appears somewhere in the integrand.
If we let $u = g(x)$, then $du = g'(x)\,dx$, and:
$$\int f(g(x)) \cdot g'(x)\,dx = \int f(u)\,du$$
Example: For $\int 2x \cos(x^2)\,dx$, let $u = x^2$, so $du = 2x\,dx$. This gives us $\int \cos(u)\,du = \sin(u) + C = \sin(x^2) + C$.
The key is recognizing patterns where part of the integrand is the derivative of another part.
Integration by Parts
Integration by parts is used when the integrand is a product of functions where substitution doesn't work. It uses the formula:
$$\int u\,dv = uv - \int v\,du$$
To apply this method, you must choose which part of your integrand to call $u$ and which to call $dv$. A useful guideline is the LIATE rule: prioritize $u$ in this order—Logarithmic, Inverse trig, Algebraic, Trigonometric, Exponential.
Example: For $\int x e^x\,dx$, let $u = x$ (algebraic) and $dv = e^x\,dx$. Then $du = dx$ and $v = e^x$, giving:
$$\int x e^x\,dx = x e^x - \int e^x\,dx = x e^x - e^x + C = e^x(x-1) + C$$
Sometimes you need to apply integration by parts multiple times until the remaining integral becomes manageable.
Trigonometric Substitution
Trigonometric substitution handles integrals containing expressions like $\sqrt{a^2 - x^2}$, $\sqrt{a^2 + x^2}$, or $\sqrt{x^2 - a^2}$. By replacing $x$ with a trigonometric function, these square roots simplify using trigonometric identities.
The standard substitutions are:
For $\sqrt{a^2 - x^2}$: let $x = a\sin(\theta)$
For $\sqrt{a^2 + x^2}$: let $x = a\tan(\theta)$
For $\sqrt{x^2 - a^2}$: let $x = a\sec(\theta)$
After substitution, simplify using identities, integrate with respect to $\theta$, then convert back to $x$ using a right triangle diagram.
Partial Fraction Decomposition
Partial fraction decomposition breaks down a rational function (a fraction of polynomials) into simpler fractions that are easier to integrate. This technique applies when the numerator's degree is less than the denominator's degree.
The basic process:
Factor the denominator completely
Write the fraction as a sum of simpler fractions with unknown constants
Solve for those constants (usually by substitution or matching coefficients)
Integrate each simpler fraction
Example: $$\frac{5x - 1}{(x-1)(x+2)} = \frac{A}{x-1} + \frac{B}{x+2}$$
Multiplying both sides by $(x-1)(x+2)$ gives $5x - 1 = A(x+2) + B(x-1)$. Setting $x = 1$ yields $A = \frac{4}{3}$; setting $x = -2$ yields $B = \frac{11}{3}$.
This method is essential for integrating rational functions that aren't easily handled by substitution.
Series Expansion
For integrands that don't have elementary antiderivatives (like $e^{-x^2}$ or $\frac{\sin(x)}{x}$), we can express them as power series and integrate term by term:
$$\int \sum{n=0}^{\infty} an x^n \,dx = \sum{n=0}^{\infty} \frac{an}{n+1} x^{n+1} + C$$
This technique is particularly valuable because even though the original integral has no closed form, the series representation often does (or provides a useful approximation).
Symbolic vs. Numerical Integration
Symbolic integration seeks a closed-form antiderivative using elementary functions (polynomials, exponentials, logarithms, trigonometric functions, etc.). The analytical techniques above are all symbolic methods. However, not every function has an elementary antiderivative—some integrals simply cannot be expressed in closed form.
When symbolic methods fail, or when we only need a numerical answer, numerical integration provides an alternative. These methods compute approximate values of definite integrals using function evaluations at specific points.
Numerical Integration Methods
Numerical integration is essential when:
The antiderivative cannot be expressed in elementary functions
Only an approximate answer is needed
The integrand is known only from experimental data or discrete measurements
The Rectangle Method
The simplest numerical approach is the rectangle method (left, right, or midpoint). Divide the interval $[a,b]$ into $n$ subintervals of width $\Delta x = \frac{b-a}{n}$. Then approximate the integral as the sum of rectangular areas:
$$\inta^b f(x)\,dx \approx \sum{i=1}^{n} f(xi^) \cdot \Delta x$$
where $xi^$ is a point in each subinterval. The choice of $xi^$ (left endpoint, right endpoint, or midpoint) affects accuracy. The midpoint method typically provides better accuracy than the left or right endpoint methods.
The Trapezoidal Rule
The trapezoidal rule improves on the rectangle method by approximating the integrand with straight lines rather than horizontal lines. On each subinterval, the area is approximated as a trapezoid.
$$\inta^b f(x)\,dx \approx \frac{\Delta x}{2} \left[ f(x0) + 2f(x1) + 2f(x2) + \cdots + 2f(x{n-1}) + f(xn) \right]$$
Notice that interior points are weighted by 2, while the first and last points are weighted by 1 (and then divided by 2). This formula is more accurate than the rectangle method because it better captures the shape of the curve.
Simpson's Rule
Simpson's rule achieves higher accuracy by approximating the integrand with parabolas (quadratic polynomials) rather than straight lines. The formula is:
$$\inta^b f(x)\,dx \approx \frac{\Delta x}{3} \left[ f(x0) + 4f(x1) + 2f(x2) + 4f(x3) + \cdots + 4f(x{n-1}) + f(xn) \right]$$
The pattern of coefficients is 1, 4, 2, 4, 2, ..., 4, 1, where $n$ must be even. Simpson's rule converges much faster than the trapezoidal rule for smooth functions, making it a practical choice for many applications.
<extrainfo>
Newton–Cotes Formulas
The methods above (rectangle, trapezoidal, Simpson's) are all special cases of Newton–Cotes formulas, which generalize these rules by using polynomial approximations of degree $n$ on each subinterval. As $n$ increases, the methods become more accurate but also more computationally complex. Simpson's rule uses degree-2 polynomials, and more advanced Newton–Cotes formulas use higher-degree polynomials.
Romberg Integration
Romberg integration is a sophisticated extrapolation technique that repeatedly applies the trapezoidal rule with successively smaller step sizes, then uses Richardson extrapolation to estimate what the result would be if the step size were zero. This method achieves high accuracy without requiring very small step sizes, making it computationally efficient.
Gaussian Quadrature
Gaussian quadrature is an advanced method that cleverly chooses both the evaluation points and their weights to maximize accuracy. Rather than using equally-spaced points, Gaussian quadrature places evaluation points at the roots of orthogonal polynomials (such as Legendre polynomials). With just $n$ evaluation points, this method can exactly integrate all polynomials of degree $2n-1$ or less, requiring far fewer function evaluations than Simpson's rule for comparable accuracy.
Monte Carlo Integration
Monte Carlo integration uses random sampling to estimate integrals, particularly useful for high-dimensional integrals. The method randomly samples points in the integration domain, evaluates the function at those points, and uses the average value to estimate the integral. While convergence is slower than deterministic methods, Monte Carlo becomes practical when the dimension is very large, where other numerical methods become prohibitively expensive.
</extrainfo>
Flashcards
According to the fundamental theorem of calculus, what is the value of $\int{a}^{b} f(x)\,dx$?
$F(b) - F(a)$ (where $F' = f$)
What is the formula used in integration by parts?
$\int u\,dv = uv - \int v\,du$
How is a non-elementary integrand integrated using series expansion?
The integrand is expressed as a power series and integrated term-by-term
What is the goal of symbolic integration?
Finding a closed-form antiderivative expressed with elementary functions
How does the rectangle method approximate an integral?
By summing the areas of rectangles of width $\Delta x$ (change in $x$)
How does the trapezoidal rule improve accuracy compared to the rectangle method?
By using trapezoids and weighting the first and last terms by one half
What geometric shape does Simpson’s rule use to approximate an integrand?
Piecewise quadratics
What defines the Newton–Cotes formulas in numerical integration?
They generalize rules to polynomials of degree $n$ on each subinterval
What iterative process is used in Romberg integration?
Repeatedly halving the step size and extrapolating to zero step width
Where does Gaussian quadrature choose its evaluation points?
At the roots of orthogonal polynomials
For what degree of polynomial is Gaussian quadrature exact?
Up to degree $2n-1$ (where $n$ is the number of evaluation points)
What technique does Monte Carlo integration use to estimate high-dimensional integrals?
Random sampling
Quiz
Integral - Integration Techniques Quiz Question 1: What does the fundamental theorem of calculus state about the definite integral of $f$ from $a$ to $b$?
- It equals $F(b)-F(a)$ where $F' = f$ (correct)
- It equals the product $F(b)\cdot F(a)$
- It equals the derivative $F'(b)-F'(a)$
- It equals the average value of $f$ on $[a,b]$
Integral - Integration Techniques Quiz Question 2: What is the primary purpose of integration by substitution?
- To change variables and simplify the integrand (correct)
- To approximate the integral using rectangles
- To differentiate the integrand
- To change the limits of integration without altering the integrand
Integral - Integration Techniques Quiz Question 3: What does partial‑fraction decomposition do to a rational function?
- Expresses it as a sum of simpler fractions (correct)
- Combines fractions into a single denominator
- Factors polynomials in the numerator
- Differentiates the rational function
Integral - Integration Techniques Quiz Question 4: Which method approximates an integral by summing the areas of rectangles of width Δx?
- Rectangle method (correct)
- Trapezoidal rule
- Simpson’s rule
- Monte Carlo method
Integral - Integration Techniques Quiz Question 5: What type of polynomial does Simpson’s rule use to approximate the integrand?
- Piecewise quadratics (correct)
- Linear segments
- High‑degree polynomials of degree 5
- Rectangular approximations
Integral - Integration Techniques Quiz Question 6: What technique does Monte Carlo integration use to estimate high‑dimensional integrals?
- Random sampling (correct)
- Deterministic grid of points
- Piecewise linear interpolation
- Trapezoidal rule
What does the fundamental theorem of calculus state about the definite integral of $f$ from $a$ to $b$?
1 of 6
Key Concepts
Analytical Integration Techniques
Fundamental theorem of calculus
Integration by substitution
Integration by parts
Trigonometric substitution
Partial‑fraction decomposition
Symbolic integration
Numerical Integration Methods
Rectangle method
Trapezoidal rule
Simpson’s rule
Newton–Cotes formulas
Romberg integration
Gaussian quadrature
Monte Carlo integration
Definitions
Fundamental theorem of calculus
Relates the definite integral of a function to the difference of its antiderivative evaluated at the interval endpoints.
Integration by substitution
Changes the variable of integration to simplify the integrand using a differentiable transformation.
Integration by parts
Applies the product rule in reverse to integrate a product of functions as uv minus the integral of v du.
Trigonometric substitution
Replaces algebraic expressions with trigonometric functions to exploit identities and simplify integrals.
Partial‑fraction decomposition
Expresses a rational function as a sum of simpler fractions to enable term‑wise integration.
Symbolic integration
Seeks a closed‑form antiderivative expressed with elementary functions using algebraic manipulation.
Rectangle method
Approximates a definite integral by summing the areas of rectangles of uniform width under the curve.
Trapezoidal rule
Improves rectangle approximations by using trapezoids, averaging the function values at interval endpoints.
Simpson’s rule
Approximates an integral by fitting piecewise quadratic polynomials to the integrand for higher accuracy.
Newton–Cotes formulas
Generalize rectangle, trapezoidal, and Simpson’s rules to polynomial interpolation of arbitrary degree on subintervals.
Romberg integration
Refines trapezoidal approximations by recursively halving step sizes and extrapolating to zero step width.
Gaussian quadrature
Chooses evaluation points at the roots of orthogonal polynomials to integrate polynomials exactly up to degree 2n − 1.
Monte Carlo integration
Estimates high‑dimensional integrals by averaging random samples drawn from the integration domain.