Skip to main content

Section 5.3 Differentiation and Integration of Power Series

One of the reasons that power series are so useful is that it turns out that differentiation and integration (the basic operations of calculus) can be applied to power series in a fairly simple way.
In particular, power series behave like polynomials (on their interval of convergence). This means that you can take their derivatives as if they were a polynomial, i.e. using the power rule, and differentiating term-by-term,
\begin{align*} \begin{array}{c|c} \text{power rule} \amp \text{sum rule} \\ \hline \rule{0pt}{22pt} \displaystyle \frac{d}{dx} x^n = n x^{n-1} \amp \displaystyle \frac{d}{dx} \brac{f(x)+g(x)} = \frac{d}{dx}f(x) + \frac{d}{dx}g(x) \end{array} \end{align*}
Similarly, integrals (or antiderivatives) can be done with the power rule, and done term-by-term,
\begin{align*} \begin{array}{c|c} \text{power rule for integrals} \amp \text{sum rule for integrals} \\ \hline \rule{0pt}{22pt} \displaystyle \int x^n \,dx = \frac{1}{n+1} x^{n+1} + C \amp \displaystyle\int \brac{f(x) + g(x)} \,dx = \int f(x) \, dx + \int g(x) \, dx \end{array} \end{align*}
It is not immediately obvious that the sum rule for derivatives can work here, since there is an infinite number of terms, but in fact, it does.

Subsection 5.3.1 Differentiation and Integration of Power Series

Consider a power series \(\sum_{n=0}^{\infty} a_n x^n\) which converges on \((-R,R)\text{.}\) This means that it defines a function of \(x\text{,}\)
\begin{gather*} f(x) = \sum_{n=0}^{\infty} a_n x^n = a_0 + a_1 x + a_2 x^2 + a_3 x^3 + \dots \end{gather*}
with domain \((-R,R)\text{.}\) Since this is a function, we can take its derivative. In fact, it can be done like a polynomial,
\begin{align*} f'(x) \amp = \frac{d}{dx} \brac{a_0 + a_1 x + a_2 x^2 + a_3 x^3 + \dots} \\\ \amp = a_1 + 2a_2 x + 3a_3 x^2 + 4a_4 x^3 + \dots \end{align*}
In summation notation, this can be thought of as the derivative being able to be brought ``through" the summation sign,
\begin{align*} f'(x) \amp = \frac{d}{dx} \sum_{n=0}^{\infty} a_n x^n \\\ \amp = \sum_{n=0}^{\infty} \frac{d}{dx} a_n x^n \amp\amp \text{interchanging the derivative and summation} \\\ \amp = \sum_{n=1}^{\infty} n a_n x^{n-1} \end{align*}
The last line comes from applying the power rule. Note the summation now starts at \(n=1\) instead of \(n=0\text{,}\) because the \(n = 0\) term (which is \(a_0\)) vanishes after taking the derivative. In summary,

Proof.

The proofs of these theorems are beyond the scope, requiring more advanced and subtle analysis arguments.
These properties will allow us to find power series representations for a few more functions.
Note that the theorem says that the radius of convergence doesn’t change, but not necessarily the interval of convergence. In particular, differentiating or integration can change convergence at the endpoints of the interval, in the following way:
  • With differentiation, one or both endpoints of convergence may be lost.
  • With integration, one or both endpoints may be gained.

Subsection 5.3.2 Power Series of Arctangent

Recall that,
\begin{gather*} \frac{d}{dx} \arctan{x} = \frac{1}{1 + x^2} \end{gather*}
Then,
\begin{align*} \frac{1}{1 + x^2} \amp = \frac{1}{1 - (-x^2)} \\\ \amp = \sum_{n=0}^{\infty} (-x^2)^n \\\ \amp = \sum_{n=0}^{\infty} (-1)^n x^{2n} \end{align*}
Then, taking the antiderivative of both sides,
\begin{align*} \int \frac{1}{1 + x^2} ,dx \amp = \int \sum_{n=0}^{\infty} (-1)^n x^{2n} ,dx \\\ \arctan{x} \amp = C + \sum_{n=0}^{\infty} (-1)^n \frac{x^{2n+1}}{2n + 1} \end{align*}
To find \(C\text{,}\) evaluate both sides at \(x=0\text{,}\) to get \(\arctan{0} = C\text{,}\) so \(C = 0\text{.}\) The series converges if \(\abs{-x^2} \lt 1\text{,}\) or \(x^2 \lt 1\text{,}\) or \(-1 \lt x \lt 1\text{.}\)
  • For \(x = 1\text{,}\) the series is \(\sum_{n=0}^{\infty} \frac{(-1)^n}{2n+1}\text{,}\) which converges by the alternating series test.
  • For \(x = -1\text{,}\) we get the same series.
Thus, the series converges for \(-1 \leq x \leq 1\text{.}\) In summary,

Subsection 5.3.3 Power Series of the Logarithm

A power series for the logarithmic function can be found by integrating the geometric series. Recall that,
\begin{gather*} \frac{1}{1 + x} = \sum_{n=0}^{\infty} (-1)^n x^n \end{gather*}
Then, integrating,
\begin{align*} \int \frac{1}{1 + x} ,dx \amp = \int \sum_{n=0}^{\infty} (-1)^n x^n \\\ \ln{(1 + x)} \amp = \sum_{n=0}^{\infty} \frac{x^{n+1}}{n+1} \end{align*}
This provides a series representation of \(\ln{(1 + x)}\text{.}\) Sometimes, the series is written with a shifted index, as \(\sum_{n=1}^{\infty} \frac{x^n}{n}\text{.}\) The series converges for \(-1 \lt x \lt 1\text{,}\) because the radius of convergence is still 1. However, we still have to check the endpoints, because endpoints can become convergent when you integrate.
  • For \(x = 1\text{,}\) \(\sum_{n=1}^{\infty} \frac{(-1)^n}{n}\text{,}\) the alternating harmonic series, which converges.
  • For \(x = -1\text{,}\) \(\sum_{n=0}^{\infty} (-1)^n \frac{(-1)^{n+1}}{n+1} = \sum_{n=0}^{\infty} \frac{1}{n+1}\text{,}\) the harmonic series, which diverges.
Thus, the power series converges for \((-1,1]\text{.}\)
This gives a series for \(\ln{(1 + x)}\text{,}\) which is the natural logarithm function, shifted left by one unit. For just the natural logarithm function \(\ln{x}\text{,}\) we can substitute \(x\) with \(x-1\text{.}\)
\begin{gather*} \boxed{\ln{x} = \sum_{n=0}^{\infty} (-1)^n \frac{(x - 1)^{n+1}}{n + 1}} \end{gather*}
This results in a power series centered at \(x = 1\text{,}\) which converges for \(x \in (0,2]\text{.}\)

Subsection 5.3.4 Derivative of Geometric Series

The geometric series can also be differentiated to obtain new series.

Example 5.3.5.

Recall the geometric series,
\begin{gather*} \frac{1}{1 - x} = \sum_{n=0}^{\infty} x^n = 1 + x + x^2 + x^3 + \dots \end{gather*}
which converges on \((-1,1)\text{.}\) Differentiating both sides gives a series for a new function,
\begin{gather*} \boxed{\frac{1}{(1-x)^2} = \sum_{n=1}^{\infty} n x^{n-1} = 1 + 2x + 3x^2 + \dots} \end{gather*}
which also converges on \((-1,1)\text{.}\)

Example 5.3.6.

The previous example can be taken one step further. Start with the equation,
\begin{gather*} \frac{1}{(1-x)^2} = \sum_{n=1}^{\infty} n x^{n-1} \end{gather*}
Differentiating both sides,
\begin{gather*} \frac{2}{(1-x)^3} = \sum_{n=2}^{\infty} n (n-1) x^{n-2} \end{gather*}
This gives a series for \(\frac{2}{(1-x)^3}\text{.}\)
  • If you instead just wanted \(\frac{1}{(1-x)^3}\text{,}\) you can divide both sides by 2,
    \begin{gather*} \frac{1}{(1-x)^3} = \sum_{n=2}^{\infty} \frac{n (n-1)}{2} x^{n-2} \end{gather*}
This kind of creative reasoning can be used to find power series for very particular functions.

Example 5.3.7.

Consider the function \(f(x) = \frac{x^2}{(1+x)^3}\text{.}\) Notice that the denominator is similar to \(1-x\text{,}\) except it is \(1+x\text{,}\) and cubed. Then, the entire expression is multiplied by \(x^2\text{.}\)
Start with the geometric series, and first replace \(x\) with \(-x\text{,}\) to get \(1+x\) in the denominator,
\begin{align*} \frac{1}{1 + x} \amp = \sum_{n=0}^{\infty} (-x)^n \\\ \amp = \sum_{n=0}^{\infty} (-1)^n x^n \end{align*}
Then, differentiate both sides, like before,
\begin{align*} -\frac{1}{(1+x)^2} \amp = \sum_{n=1}^{\infty} (-1)^n n x^{n-1} \end{align*}
Then, differentiate again,
\begin{align*} \frac{2}{(1+x)^3} \amp = \sum_{n=2}^{\infty} (-1)^n n(n-1) x^{n-2} \end{align*}
Then, we want the numerator to be \(x^2\) instead of 2, so we can divide both sides by 2, and multiply both sides by \(x^2\text{,}\)
\begin{align*} \frac{x^2}{(1+x)^3} \amp = \sum_{n=2}^{\infty} (-1)^n \frac{n(n-1)}{2} x^n \\\ \amp = x^2 - 3x^3 + 6x^4 - 10x^5 + \dots \end{align*}
In summary,
\begin{gather*} \boxed{\begin{array}{ll} \text{Geometric, } \abs{x} \lt 1 : \quad \dfrac{1}{1-x}=\displaystyle\sum_{n=0}^{\infty} x^n \\[20pt] \text{Differentiate once:}\quad \dfrac{1}{(1-x)^{2}}=\displaystyle\sum_{n=1}^{\infty} n,x^{n-1} \\[20pt] \text{Differentiate twice:}\quad \dfrac{2}{(1-x)^{3}}=\displaystyle\sum_{n=2}^{\infty} n(n-1)x^{n-2} \end{array}} \end{gather*}
You probably don’t want to try and memorize these formulas. The main idea is just that you can differentiate the geometric series to get power series representations for new, similar functions.

Exercises Exercises

Exercise Group.
Find a power series representation for each function (using the geometric series), and determine its radius of convergence.
1.
\(f(x) = \frac{x}{(1+4x)^2}\text{.}\)
Hint.
substitute \(x\) with \(-4x\text{,}\) differentiate, and multiply by \(x\text{.}\)
Answer.
\(\sum_{n=1}^{\infty} (-1)^{n+1} n \cdot 4^{n-1} x^n\text{,}\) \(R = \frac{1}{4}\text{.}\)
2.
\(f(x) = \brac{\frac{x}{2-x}}^3\text{.}\)
Hint.
factor out 2 to get into the form \(1-u\text{,}\) use the geometric series, differentiate two times, and multiply by \(x^3\text{.}\)
Answer.
\(\sum_{n=2}^{\infty} \frac{n(n-1)}{2^{n+2}} x^{n+1}\text{,}\) \(R = 2\text{.}\)